Databricks Tries AI to Tame SQL Migrations

Databricks is rolling out an AI-driven tool designed to simplify the arduous process of migrating data warehouses. The new agentic code converter, powered by Genie Code, aims to translate proprietary SQL dialects into open ANSI SQL, a move that could significantly ease the transition for organizations burdened by legacy systems. This initiative tackles a common pain point: the complexity and manual effort involved in moving data and code from older platforms to modern lakehouses.

The agentic converter, currently in beta, supports a range of popular proprietary SQL dialects including T-SQL, Snowflake, Redshift, Oracle, BigQuery, and Teradata. It functions by launching swarms of parallel agents that iteratively convert code, validating both syntax and semantic intent to preserve original business logic. StartupHub.ai data shows Databricks holds a strong position with a score of 82/100, though Palantir Technologies rivals it at 85/100, indicating a competitive market for enterprise data solutions.

Automated Migration Planning

Databricks introduces a new 'migration project' feature within its workspace. This serves as a central hub for managing source files, tracking conversion progress, and visualizing data lineage. Teams can configure the project by setting source and target dialects and a destination folder for converted files. Each file's complexity is analyzed and scored, allowing teams to prioritize simpler conversions first.

Lineage mapping is also a key component, illustrating relationships between tables, views, and stored procedures. This provides a clear picture of dependencies, enabling teams to determine which objects can be migrated independently and which need to move together. This granular insight is critical for minimizing migration risks.

Agentic Code Conversion in Action

When users initiate the conversion process, Genie Code's agents get to work. Each script is analyzed, and subagents are deployed to handle files in parallel. These agents work iteratively to fix errors, ensuring the converted code retains its original business logic and parses correctly.

While the tool boasts high success rates, some files may require manual review or the definition of custom conversion rules. Databricks allows users to create custom 'skills' within Genie Code to codify specific fixes or adhere to internal standards, such as naming conventions or ETL patterns. This hybrid approach balances automation with necessary customization.

The platform supports essential enterprise SQL features like multi-statement transactions, temporary tables, and stored procedures, reducing the need to re-engineer logic. Databricks positions this agentic converter as the next generation of data warehouse migration tooling, building on the success of its earlier Lakebridge tool. The company plans to expand support for more legacy ETL sources and data migration capabilities in future updates.