Shane Wiggins
shane-wiggins
Thought leadership
-
November 2, 2026

AI and data governance in Snowflake, Databricks, and Microsoft Purview: What built-in tools cover (and what they don’t)

9 min read

Shane Wiggins
Get Data Insights Delivered
Join hundreds of data professionals who subscribe to the Data Leaders Digest for actionable insights and expert advice.
Get the Best of Data Leadership
Subscribe to the Data Leaders Digest for exclusive content on data reliability, observability, and leadership from top industry experts.

Get the Best of Data Leadership

Subscribe to the Data Leaders Digest for exclusive content on data reliability, observability, and leadership from top industry experts.

Stay Informed

Sign up for the Data Leaders Digest and get the latest trends, insights, and strategies in data management delivered straight to your inbox.

Get Data Insights Delivered

Join hundreds of data professionals who subscribe to the Data Leaders Digest for actionable insights and expert advice.

If I already have the tool, why should I go to the hardware store? 

Built-in governance tools from Microsoft, Snowflake, and Databricks offer robust capabilities within their own environments, often without the cost or complexity of adding another vendor. But they don’t necessarily cover data and AI activity across an entire enterprise. When data lives across multiple clouds, servers, and repositories, native tools can leave visibility gaps that expose AI agents to costly mistakes.

However, whether in-platform governance will truly meet an organization’s needs has less to do with the built-in tools themselves and more to do with the enterprise’s data estate. If data resides in clouds, servers, and other repositories that extend beyond the data platform’s reach, built-in tools leave visibility gaps that expose AI agents to making costly data-related mistakes. 

This article compares the governance capabilities of Microsoft Purview, Snowflake, and Databricks, and explains when native tools are enough and when you may need broader coverage.

Key takeaways

  • Native tools govern well within their own environments. Purview, Snowflake, and Databricks each offer robust data and AI governance capabilities.
  • Gaps emerge across platforms. When data and AI agents cross platform boundaries, native tools may lose visibility and coverage.
  • Built-in governance is enough only for single-platform estates. Organizations operating across multiple platforms need broader oversight to govern data and AI consistently.

What’s the risk of relying on built-in governance in a multi-platform enterprise?

Built-in governance tools can leave visibility and policy enforcement gaps in multi-platform enterprises because their capabilities are strongest within their own environments. As data moves between clouds, pipelines, and legacy databases, organizations may lose a consistent view of how data is accessed and governed. Flexera’s 2026 State of the Cloud Report found that 73% of surveyed organizations use both public and private clouds.

Tools such as Microsoft Purview, Snowflake Horizon Catalog, and Databricks Unity Catalog provide access controls, lineage, and activity monitoring within their respective environments. A data estate that spans multiple platforms, however, requires governance that reaches beyond those boundaries. 

AI agents that access data autonomously amplify governance gaps. Through APIs, Model Context Protocol (MCP) servers, and other integrations, agents can access systems beyond the reach of a platform’s built-in governance features. A customer service agent might use outdated pricing to issue incorrect quotes, while a financial agent could initiate a payment using a stale account balance. Without cross-platform visibility, teams can’t prevent agents from acting on faulty data. 

Built-in governance tools at a glance

The table below compares the strengths and limitations of Microsoft Purview, Snowflake Horizon Catalog, and Databricks Unity Catalog.

Built-in governance tools compared: Microsoft Purview, Snowflake Horizon Catalog, and Databricks Unity Catalog
Tool Best for Top features Pros Cons
Microsoft PurviewMicrosoft-centric data estatesData discovery, DSPM for AI, data classificationBroad connector ecosystem; tight Microsoft integrationSome capabilities vary across data sources; data quality tooling is measurement-oriented rather than ML-driven
Snowflake Horizon CatalogSnowflake-centric data and AI workloadsAccess policies, agent governance, lineage, Iceberg supportNative integration with Snowflake workloadsLimited direct control over external data environments
Databricks Unity Catalog & Unity AI GatewayDatabricks-centric lakehouse and AI workloadsData and AI governance, runtime monitoring, usage controlsIntegrated governance for Databricks data and AI workloadsReduced visibility into activity outside Databricks

Exploring leading built-in governance tools in depth

Here are the specific capabilities, ideal use cases, and architectural boundaries of the built-in governance tools within three major cloud platforms. Because these native tools are designed to govern their own ecosystems, we will also examine how deploying a platform-neutral trust layer like Bigeye fills the resulting gaps when your data and AI agents inevitably cross platform borders. 

Microsoft Purview

Microsoft Purview is a unified data governance and security platform built to manage and protect information across Microsoft ecosystems. It integrates tightly with Azure and Microsoft 365, offering the Unified Catalog and Data Security Posture Management (DSPM) for AI to monitor how tools like Azure OpenAI and Microsoft Fabric handle sensitive records. 

Although Purview connects to more than 120 external systems, some capabilities remain limited by its underlying architecture. For example, automatic sensitive-data classification does not extend to Fabric lakehouse tables in the same way it does to Azure SQL, and its scheduled data quality scans also do not provide the same function as continuous, ML-driven anomaly detection. As a result, teams may not detect data issues that emerge between scans and affect an AI agent’s output. 

Bigeye complements Purview's catalog and scheduled scans by adding continuous, cross-platform data observability. Bigeye feeds live, ML-driven anomaly detection signals directly into the governance workflow. This provides real-time verification of data freshness and automatically extends sensitive-data classification to sources outside Purview's native reach.

Snowflake Horizon Catalog

Snowflake Horizon Catalog provides governance and security capabilities for workloads in the Snowflake ecosystem. These include AI agent identity controls, column-level lineage, and policies designed to protect sensitive data. Support for Apache Polaris and compatible Iceberg tables can extend governance to certain externally managed data lake architectures. 

However, Horizon may not be able to govern data in legacy on-premises systems, other cloud environments, or unsupported data lakes. If a data quality failure occurs in any of the repositories or pipelines outside of Snowflake’s purview, Horizon alone will not detect it, increasing the likelihood that AI agents will make data-related errors.  

Bigeye can serve as a powerful complement to Horizon Catalog by establishing a platform-neutral observability layer that spans the entire data lifecycle across architectural boundaries. While Horizon governs what happens inside Snowflake, Bigeye traces column-level lineage and monitors data health across external databases and upstream pipelines before the records ever reach a Snowflake-compatible engine. Bigeye catches schema drift and freshness issues early to ensure the data Snowflake governs is accurate before it feeds downstream AI applications.

Databricks Unity Catalog and Unity AI Gateway

Databricks Unity Catalog provides a centralized governance layer for data and AI assets across the Databricks environment. Through Unity Catalog and the Unity Gateway, the platform captures complete audit trails of model calls, applies workspace-level spend caps, and enforces contextual policies at the moment of interaction. For AI agents developed on Databricks, these governance tools can intercept interactions, log payloads automatically, and restrict unauthorized data access. 

Databricks’ deepest runtime monitoring and controls apply to activity flowing through its own ecosystem. External agents, direct calls to third-party models, and legacy upstream pipelines may fall outside Unity AI Gateway’s visibility, leaving gaps in cross-platform audit trails.

Bigeye can complement Databricks by monitoring pipelines outside its runtime to deliver end-to-end visibility. Bigeye’s Agent Trust Hub brings together signals from disparate catalogs, agent frameworks, and on-premises databases, helping teams identify external data anomalies before they affect models and agents running in Databricks. This allows teams to catch data anomalies in external systems before flawed records compromise the models and agents running inside Databricks.

How do I know if built-in governance is enough?

Whether native governance is sufficient depends on where your data and AI workloads run. A single-platform environment may be well served by native tools, while a distributed estate requires closer scrutiny and cross-platform coverage.

Assessing estate architecture

Data leaders should evaluate their data and AI estate across three dimensions:

  • Architectural fragmentation: Are workloads restricted to a single cloud provider or distributed across multi-cloud environments, hybrid pipelines, and legacy on-premises databases? 
  • Agent autonomy: Do autonomous AI agents operate strictly within one vendor's runtime, or frequently traverse external APIs, MCP servers, and multi-platform data stores?
  • Compliance readiness: Do regulatory obligations demand a consolidated audit trail spanning disparate systems, or would platform-specific logs satisfy internal risk requirements? 

When built-in governance is enough

After working through these questions, organizations whose data and AI workloads sit primarily within a single vendor ecosystem may deem native governance to be sufficient. This is most likely the case in organizations where data flows are relatively simple, legacy on-premises dependencies are limited, and external data sources are accessed through the platform’s governed query engine. In such environments, native controls can provide effective governance without requiring additional layers of oversight.

When you need a platform-neutral layer

Conversely, enterprises with data estates spanning public and private clouds may need a platform-neutral governance layer to maintain consistent oversight across environments. Without it, agents may consume stale or incomplete data, leading to unreliable outputs, wasted spending, or compliance risks. A cross-platform layer can extend observability and auditability beyond individual vendors’ environments. 

What is the best approach to AI and data governance across multiple platforms?

A strong cross-platform governance strategy takes advantage of the capabilities of built-in governance tools, and closes the gaps they leave with a platform-neutral solution that actively monitors data health and autonomous agent behavior. 

Don’t discard what works: Keep your native governance tools

Just because native governance tools do not deliver exhaustive coverage does not mean organizations should discard them entirely. Native governance tools can remain an essential piece of an enterprise’s governance suite by providing critical controls within their respective platforms, including access permissions, data masking, and resource limits.

These controls help teams protect sensitive information at query time and prevent runaway AI workloads from driving up cloud costs. Rather than replacing these capabilities entirely, a platform-neutral layer can complement them by extending governance across environments.

Avoid the maintenance quicksand pit of a homegrown trust layer

Once teams establish that they need a platform-neutral governance layer, it can be tempting to build one internally. This approach presents advantages, including avoiding recurring fees, retaining full autonomy, and avoiding platform lock-in.

But building and maintaining a governance layer can demand significant engineering time. Teams must keep connectors, schemas, monitoring logic, and compliance controls up to date as data systems and AI architectures evolve.

An internal solution may also struggle to match the breadth of a purpose-built platform. Capabilities like continuous anomaly detection and centralized monitoring, which are necessary for effective AI governance, are unlikely to fall within the scope of what an in-house engineering team can realistically deliver. For many teams, a purpose-built tool may reduce maintenance overhead and free engineers to focus on product development. 

Verify data quality before AI acts

Not all governance tools provide the same capabilities or address the same risks. For example, platforms oriented towards governance and data quality can help organizations manage models, enforce policies, and document compliance. However, they cannot necessarily verify that the data an agent is about to use is accurate, complete, and up to date, as this requires data quality monitoring at the pipeline level.

Consider a customer service agent retrieving order histories from a CRM. If a pipeline replaces records with empty values, the agent may tell customers they have no orders or repeatedly retry its searches. Without data quality monitoring, the issue may go undetected until customers are affected.

A platform-neutral trust layer, particularly one rooted in data-layer governance and observability capabilities, will actively monitor data quality, freshness, and schema changes across pipelines. This makes it much easier to catch problems before agents act on faulty data, and helps prevent a range of other agent-related issues stemming from poor data quality, including wasted computing resources and runaway spend.

Organizations should prioritize solutions that offer continuous data quality monitoring, cross-platform coverage, and early detection of pipeline issues. For more guidance, see our guide to platform-neutral AI governance. 

FAQs

How can I see what AI agents are doing across a fragmented, multi-cloud data estate? 

To achieve end-to-end visibility, deploying a platform-neutral trust layer can bring together metadata, data quality signals, and lineage across connected systems. Bigeye’s Agent Trust Hub is designed to help teams monitor data health and agent activity across cloud environments and legacy systems without routing every workload through one vendor’s runtime.

Why can't native governance tools in Purview, Snowflake, or Databricks see AI activity across my whole data estate?

Native governance platforms are architected to enforce policies specifically at their own compute layers. Snowflake Horizon Catalog governs what touches a Snowflake-compatible engine, while Databricks Unity AI Gateway calibrates its deepest tracing around activity flowing through the Databricks AI Runtime. 

When autonomous agents call external APIs, query non-native cloud environments, or route data through legacy upstream pipelines, those actions bypass the native execution-layer controls entirely, leaving data teams with visibility gaps and compliance teams with incomplete audit trails. 

What's the difference between data governance and AI governance in these platforms?

Data governance manages data assets by establishing quality standards, documenting lineage, applying sensitivity classifications, and determining who can access specific records. AI governance manages the AI systems themselves by tracking model lifecycles, enforcing usage policies, and generating audit evidence for regulatory frameworks like the EU AI Act. 

While built-in tools often handle AI governance well within their own platforms, organizations still require continuous, pipeline-level data observability to verify that the data feeding those models from other systems is fresh, complete, and schema-compliant at runtime. 

How does Unity Catalog compare to Microsoft Purview?

Unity Catalog emphasizes controls within the Databricks data and AI environment, while Purview provides broader discovery and security capabilities across supported Microsoft Azure systems. Neither should be assumed to provide complete, continuous observability across every upstream pipeline. Organizations with multi-platform estates should assess whether additional monitoring is needed.

share with a colleague
Resource
Monthly cost ($)
Number of resources
Time (months)
Total cost ($)
Software/Data engineer
$15,000
3
12
$540,000
Data analyst
$12,000
2
6
$144,000
Business analyst
$10,000
1
3
$30,000
Data/product manager
$20,000
2
6
$240,000
Total cost
$954,000
Role
Goals
Common needs
Data engineers
Overall data flow. Data is fresh and operating at full volume. Jobs are always running, so data outages don't impact downstream systems.
Freshness + volume
Monitoring
Schema change detection
Lineage monitoring
Data scientists
Specific datasets in great detail. Looking for outliers, duplication, and other—sometimes subtle—issues that could affect their analysis or machine learning models.
Freshness monitoringCompleteness monitoringDuplicate detectionOutlier detectionDistribution shift detectionDimensional slicing and dicing
Analytics engineers
Rapidly testing the changes they’re making within the data model. Move fast and not break things—without spending hours writing tons of pipeline tests.
Lineage monitoringETL blue/green testing
Business intelligence analysts
The business impact of data. Understand where they should spend their time digging in, and when they have a red herring caused by a data pipeline problem.
Integration with analytics toolsAnomaly detectionCustom business metricsDimensional slicing and dicing
Other stakeholders
Data reliability. Customers and stakeholders don’t want data issues to bog them down, delay deadlines, or provide inaccurate information.
Integration with analytics toolsReporting and insights
about the author

Shane Wiggins

Vice President, AI Strategy & Products | Bigeye

Shane Wiggins is an AI product executive and technology strategist who turns emerging technologies into durable business advantage. As Vice President of AI Strategy & Products, he leads enterprise AI strategy and product innovation helping organizations adopt enterprise AI responsibly and at scale.

Shane has built products at the inflection points of technology. From the early evolution of the Internet of Things to enterprise data governance and now artificial intelligence, he has consistently recognized where markets were headed and transformed emerging capabilities into commercially successful products. His leadership combines deep technical expertise with strategic vision, bringing together product, engineering, data, and go-to-market teams to deliver solutions that operate at global enterprise scale.

At OneTrust, Shane led a product portfolio generating more than $350 million in annual recurring revenue (ARR) while incubating the company's AI Governance platform from concept to commercial launch, helping establish one of the industry's defining enterprise AI governance solutions. He also drove the evolution of the Data Discovery & Classification platform, the data foundation responsible AI depends on, and built partnerships with hyperscalers and AI platform providers to extend the company's reach into the enterprise AI stack.

Earlier in his career, Shane helped Fortune 500 organizations modernize their operations as part of Accenture Digital's Internet of Things (IoT) practice, delivering connected solutions that created the data foundation for advanced analytics, machine learning, and intelligent automation. He later co-founded a Device-as-a-Service company focused on connected vehicle monitoring, leading product strategy from inception through commercialization and ultimately a successful acquisition by a device hardware manufacturer.

Shane holds engineering degrees from the University of Florida and the Georgia Institute of Technology and resides in Atlanta, Georgia. Throughout his career, he has focused on helping organizations navigate technology shifts before they become competitive necessities. Whether building connected systems, data platforms, or enterprise AI products, his work centers on creating the capabilities that allow companies to adapt, innovate, and lead in the next era of technology.

about the author

about the author

Shane Wiggins is an AI product executive and technology strategist who turns emerging technologies into durable business advantage. As Vice President of AI Strategy & Products, he leads enterprise AI strategy and product innovation helping organizations adopt enterprise AI responsibly and at scale.

Shane has built products at the inflection points of technology. From the early evolution of the Internet of Things to enterprise data governance and now artificial intelligence, he has consistently recognized where markets were headed and transformed emerging capabilities into commercially successful products. His leadership combines deep technical expertise with strategic vision, bringing together product, engineering, data, and go-to-market teams to deliver solutions that operate at global enterprise scale.

At OneTrust, Shane led a product portfolio generating more than $350 million in annual recurring revenue (ARR) while incubating the company's AI Governance platform from concept to commercial launch, helping establish one of the industry's defining enterprise AI governance solutions. He also drove the evolution of the Data Discovery & Classification platform, the data foundation responsible AI depends on, and built partnerships with hyperscalers and AI platform providers to extend the company's reach into the enterprise AI stack.

Earlier in his career, Shane helped Fortune 500 organizations modernize their operations as part of Accenture Digital's Internet of Things (IoT) practice, delivering connected solutions that created the data foundation for advanced analytics, machine learning, and intelligent automation. He later co-founded a Device-as-a-Service company focused on connected vehicle monitoring, leading product strategy from inception through commercialization and ultimately a successful acquisition by a device hardware manufacturer.

Shane holds engineering degrees from the University of Florida and the Georgia Institute of Technology and resides in Atlanta, Georgia. Throughout his career, he has focused on helping organizations navigate technology shifts before they become competitive necessities. Whether building connected systems, data platforms, or enterprise AI products, his work centers on creating the capabilities that allow companies to adapt, innovate, and lead in the next era of technology.

Get the Best of Data Leadership

Subscribe to the Data Leaders Digest for exclusive content on data reliability, observability, and leadership from top industry experts.

Want the practical playbook?

Join us on April 16 for The AI Trust Summit, a one-day virtual summit focused on the production blockers that keep enterprise AI from scaling: reliability, permissions, auditability, data readiness, and governance.

Get Data Insights Delivered

Join hundreds of data professionals who subscribe to the Data Leaders Digest for actionable insights and expert advice.

Join the Bigeye Newsletter

1x per month. Get the latest in data observability right in your inbox.