Technology

Databricks, Google stop copying lakehouse data

Databricks and Google now let BigQuery and Unity Catalog read one copy, and push Iceberg labels to carry governance.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

2 min read

Unity Catalog and Google Cloud lakehouse federation diagram
Credit: Databricks

Parth Desai, Alex Jiang and John Spencer, writing for Databricks, announced bidirectional access between Unity Catalog and Google's lakehouse. The company said customers can query the same copy from either BigQuery or Databricks without duplication.

No copies move.

In one direction, Databricks mounts Iceberg tables from Google's Lakehouse runtime catalog for use in its warehouse or Genie. The company said those tables can run in its serverless warehouse or Genie. Genie is its natural-language tool that recently learned to package team habits as skills. In the other direction, BigQuery can read Unity Catalog managed tables without a copy, the authors said.

The next push is metadata, not storage. The authors said they helped land catalog labels in Iceberg, key-value pairs that travel with the table. A table tagged domain=finance and status=certified keeps those tags when federated, as does a column tagged pii=ssn. That persistence matters for masking and for agents hunting context, they said.

That framing is narrower than federation already in the docs. Per Databricks docs, Lakehouse Federation splits into query federation and catalog federation, with query federation covering MySQL, PostgreSQL, Teradata and Oracle. Per Google's lakehouse docs, another path syncs SAP BDC shares via Delta Sharing for BigQuery queries. This deal extends the catalog side, not the query side.

The authors did not say who enforces a label when two catalogs disagree, or what writes, latency and cost look like across the boundary. They pitched shared governance that travels with data and does not need redefinition in each system. Who wins when the same column is certified in one catalog and restricted in the other?

Mentioned in this story

Markets

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsDatabricksUnity CatalogGoogle CloudBigQueryIcebergGenieSAP BDCDelta Sharing

StartupHub.ai StaffDaniel SingerWritten by StartupHub.ai Staff, Editorial teamReviewed by Daniel Singer, EditorAbout

StartupHub.ai Staff, Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer, Editor

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

More from Daniel Singer

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.