Technology
Preferred on Google
Google News

Deutsche Börse uses GenAI for data migration

Deutsche Börse uses a custom Databricks App and generative AI to automate the migration of thousands of analytics notebooks, cutting redevelopment time by over 90%.

7 min read
Deutsche Börse uses generative AI for Databricks migration.
Deutsche Börse leverages Databricks and generative AI for efficient notebook migration.

Deutsche Börse Group is leveraging generative AI to tackle the monumental task of migrating thousands of analytics notebooks. Facing a 2027 deadline to move from Cloudera's soon-to-be-decommissioned Zeppelin notebooks to Databricks, the financial services giant developed a custom Databricks App to automate the process.

Visual TL;DR. Cloudera Deadline leads to Custom Databricks App. Thousands of Notebooks leads to Custom Databricks App. Custom Databricks App uses GenAI for Logic. Custom Databricks App includes Automate Structure. GenAI for Logic leads to 90% Time Cut. Automate Structure leads to 90% Time Cut. 90% Time Cut leads to Faster Migration.

  1. Cloudera Deadline: 2027 deadline to move from soon-to-be-decommissioned Zeppelin notebooks
  2. Thousands of Notebooks: over 2,000 users and a vast number of notebooks with complex logic
  3. Custom Databricks App: developed a custom Databricks App to automate the migration process
  4. GenAI for Logic: generative AI reconstructs complex notebook logic, not just structure
  5. Automate Structure: app handles deterministic aspects: paragraph to cell, syntax translation
  6. 90% Time Cut: cutting redevelopment time by over 90% from manual rewrite
  7. Faster Migration: enables migration from hours to minutes for thousands of notebooks
Visual TL;DR
Visual TL;DR — startuphub.ai Cloudera Deadline leads to Custom Databricks App. Thousands of Notebooks leads to Custom Databricks App. Custom Databricks App uses GenAI for Logic. GenAI for Logic leads to 90% Time Cut uses Cloudera Deadline Thousands of Notebooks Custom Databricks App GenAI for Logic 90% Time Cut From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai Cloudera Deadline leads to Custom Databricks App. Thousands of Notebooks leads to Custom Databricks App. Custom Databricks App uses GenAI for Logic. GenAI for Logic leads to 90% Time Cut uses Cloudera Deadline Thousands ofNotebooks Custom DatabricksApp GenAI for Logic 90% Time Cut From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai Cloudera Deadline leads to Custom Databricks App. Thousands of Notebooks leads to Custom Databricks App. Custom Databricks App uses GenAI for Logic. GenAI for Logic leads to 90% Time Cut uses Cloudera Deadline 2027 deadline to move fromsoon-to-be-decommissioned Zeppelinnotebooks Thousands of Notebooks over 2,000 users and a vast number ofnotebooks with complex logic Custom Databricks App developed a custom Databricks App toautomate the migration process GenAI for Logic generative AI reconstructs complexnotebook logic, not just structure 90% Time Cut cutting redevelopment time by over 90%from manual rewrite From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai Cloudera Deadline leads to Custom Databricks App. Thousands of Notebooks leads to Custom Databricks App. Custom Databricks App uses GenAI for Logic. GenAI for Logic leads to 90% Time Cut uses Cloudera Deadline 2027 deadline tomove fromsoon-to-be-decommiss Thousands ofNotebooks over 2,000 usersand a vast numberof notebooks with… Custom DatabricksApp developed a customDatabricks App toautomate the… GenAI for Logic generative AIreconstructscomplex notebook… 90% Time Cut cuttingredevelopment timeby over 90% from… From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai Cloudera Deadline leads to Custom Databricks App. Thousands of Notebooks leads to Custom Databricks App. Custom Databricks App uses GenAI for Logic. Custom Databricks App includes Automate Structure. GenAI for Logic leads to 90% Time Cut. Automate Structure leads to 90% Time Cut. 90% Time Cut leads to Faster Migration uses includes Cloudera Deadline 2027 deadline to move fromsoon-to-be-decommissioned Zeppelinnotebooks Thousands of Notebooks over 2,000 users and a vast number ofnotebooks with complex logic Custom Databricks App developed a custom Databricks App toautomate the migration process GenAI for Logic generative AI reconstructs complexnotebook logic, not just structure Automate Structure app handles deterministic aspects:paragraph to cell, syntax translation 90% Time Cut cutting redevelopment time by over 90%from manual rewrite Faster Migration enables migration from hours to minutesfor thousands of notebooks From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai Cloudera Deadline leads to Custom Databricks App. Thousands of Notebooks leads to Custom Databricks App. Custom Databricks App uses GenAI for Logic. Custom Databricks App includes Automate Structure. GenAI for Logic leads to 90% Time Cut. Automate Structure leads to 90% Time Cut. 90% Time Cut leads to Faster Migration uses includes Cloudera Deadline 2027 deadline tomove fromsoon-to-be-decommiss Thousands ofNotebooks over 2,000 usersand a vast numberof notebooks with… Custom DatabricksApp developed a customDatabricks App toautomate the… GenAI for Logic generative AIreconstructscomplex notebook… AutomateStructure app handlesdeterministicaspects: paragraph… 90% Time Cut cuttingredevelopment timeby over 90% from… Faster Migration enables migrationfrom hours tominutes for… From startuphub.ai · The publishers behind this format

The challenge involved over 2,000 users and a vast number of notebooks, many containing complex logic and institutional knowledge. A manual rewrite would have taken years, prompting the development of an AI-assisted solution. The core innovation, as detailed on the Databricks blog, lies in separating structural conversion from logic reconstruction.

Related startups

Automating the Structure, AI for Logic

The Databricks App handles the deterministic aspects: transforming Zeppelin's paragraph format into Databricks cells, translating interpreter syntax, and reformatting metadata. This structural conversion preserves the original content precisely.

The true power comes in the next step: logic reconstruction. For each converted notebook, the app generates a context-aware prompt tailored to Deutsche Börse's specific Zeppelin environment, including custom interpreters and data source references. This prompt is fed into Databricks Genie, an AI assistant that asks clarifying questions and rebuilds the notebook's logic.

This hybrid approach, automating the predictable and delegating the complex to AI, is key to the success of this Databricks generative AI migration.

From Hours to Minutes

The result is a dramatic reduction in migration time. Notebook redevelopment that once took hours now takes a mere 15-20 minutes per notebook. This significantly accelerates a critical cloud transformation initiative.

Crucially, the tool democratizes the migration process, requiring less deep technical expertise from business users. The Databricks Streamlines Lakehouse Migrations initiative is exemplified by this project, showcasing how platform capabilities can be combined with AI for efficiency.

Lessons Learned

Deutsche Börse highlighted several key takeaways: avoiding over-engineering, recognizing the limitations of rule-based systems for heterogeneous content, and the critical importance of context in AI prompts. Early collaboration with the platform team was also vital.

This project demonstrates that AI-assisted migration is not a future concept but a present reality, transforming daunting cloud migration challenges into manageable, scalable workflows.

© 2026 StartupHub.ai. All rights reserved. Do not enter, scrape, copy, reproduce, or republish this article in whole or in part. Use as input to AI training, fine-tuning, retrieval-augmented generation, or any machine-learning system is prohibited without written license. Substantially-similar derivative works will be pursued to the fullest extent of applicable copyright, database, and computer-misuse laws. See our terms.
#Databricks#Generative AI#Deutsche Börse#Cloud Migration#Notebook Migration#AI Tools