Artificial Intelligence

Databricks Hits 200ms Feature Freshness

Databricks Feature Store now delivers ML features with 200ms latency using Spark RTM, enabling real-time AI applications like fraud detection.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

4 min read

Diagram showing data flow from Kafka to Databricks Feature Store with sub-second latency.
Visual TL;DR
Real-time AI needDriver
fraud detection, personalized experiences demand instant feature availability
From the article 9 mentionsImagine a user attempting a purchase; the system needs to assess potential fraud based on recent activity.
Complex custom pipelinesDriver
From the articleHistorically, achieving this level of real-time data integration required complex, custom streaming pipelines.
Databricks Feature StoreCore
From the article 4 mentionsDatabricks announced its Feature Store can now serve features with sub-second freshness, achieving a p99 latency of just 200 milliseconds from data ingestion in Kafka to availability in the online store.
Spark RTMCore
Spark Real-Time Mode drives the speed, enabling sub-second feature freshness
From the article 5 mentionsThe engine behind this speed is Spark Real-Time Mode (RTM).
Eliminates burdenEffect
From the articleDatabricks aims to eliminate that burden, allowing data scientists to define features once and have them power both offline batch processing and these high-frequency online serving needs.
Lakebase optimizes writesCore
Lakebase optimizes online writes for efficient, low-latency data updates
From the articleDatabricks Feature Store utilizes Lakebase, a storage layer designed to minimize overhead for streaming writes.
200ms feature freshnessOutcome
p99 latency of 200 milliseconds from Kafka ingestion to online store
From the article 2 mentionsThe ability to serve features with sub-second freshness is not just a technical feat; it's a business imperative for many sectors.
Real-time AI applicationsEffect
enables instant fraud detection, dynamic personalization, and other critical use cases
From the article 9 mentionsDatabricks’ push into this low-latency space addresses a critical bottleneck that has hindered the widespread adoption of real-time AI applications.
Contents(3)

The race for real-time intelligence in machine learning just got a major boost. Databricks announced its Feature Store can now serve features with sub-second freshness, achieving a p99 latency of just 200 milliseconds from data ingestion in Kafka to availability in the online store. This collapses a typical lag of minutes or even hours down to milliseconds, a critical leap for applications like fraud detection and personalized user experiences.

For a fraud detection system, milliseconds matter. Imagine a user attempting a purchase; the system needs to assess potential fraud based on recent activity. Combining long-term transaction averages with total spending from the last 10 minutes can highlight suspicious behavior. Historically, achieving this level of real-time data integration required complex, custom streaming pipelines. Databricks aims to eliminate that burden, allowing data scientists to define features once and have them power both offline batch processing and these high-frequency online serving needs.

Spark Real-Time Mode Drives the Speed

The engine behind this speed is Spark Real-Time Mode (RTM). Unlike traditional microbatch processing, which groups data into small batches, RTM processes data row by row as it arrives. This continuous flow is essential for calculating rolling window aggregations, like sums or averages over a specific, event-tied time frame, with millisecond precision. Each incoming event immediately updates the aggregate value, ensuring the feature served to a model is always current.

This contrasts with tumbling or sliding windows, which are aligned to fixed clock intervals and only emit updates at boundaries. Rolling windows, by definition, move with each event's timestamp, making them ideal for scenarios where 'now' is constantly changing. By processing these aggregations concurrently across stages and managing state locally using embedded RocksDB instances, RTM significantly reduces the latency floor that plagued older Spark Structured Streaming approaches. Even with fault tolerance mechanisms like periodic checkpointing, RTM amortizes the cost over longer intervals, minimizing pipeline stalls.

Lakebase Optimizes Online Writes

Getting fresh data into the online store quickly is as important as computing it. Databricks Feature Store utilizes Lakebase, a storage layer designed to minimize overhead for streaming writes. Streaming data often involves a high volume of small, frequent updates. Lakebase’s architecture, separating compute and storage, is optimized to handle these upserts efficiently, ensuring that newly computed feature values are rapidly available for model inference. This architecture supports autoscaling for inference workloads, handling tens of thousands of reads per second with minimal latency.

The implications for businesses are significant. Real-time personalization engines can react instantly to user intent, boosting engagement. Financial institutions can detect fraudulent transactions before they complete, saving both customers and the business considerable loss. This capability moves beyond theoretical AI to practical, high-stakes applications where every millisecond counts.

Industry Context and Competitive Landscape

This development places Databricks squarely in competition with other platforms aiming to bridge the gap between batch analytics and real-time AI. Companies like Snowflake have also been investing heavily in real-time capabilities for their data clouds. However, Databricks’ deep integration with Spark and its focus on end-to-end ML workflows, from feature engineering to model serving, provides a strong narrative. StartupHub.ai data indicates Databricks holds a strong position with a score of 82/100, compared to competitors like Snowflake (73/100) and Palantir Technologies (73/100). Databricks has raised substantial capital, with verified financials showing $5 billion in strategic financing in 2026, valuing the company at $190 billion. This continuous investment in core infrastructure like feature serving underscores its commitment to leading the enterprise AI market.

The ability to serve features with sub-second freshness is not just a technical feat; it's a business imperative for many sectors. As AI models become more integrated into operational decision-making, the quality and timeliness of their input data directly determine their effectiveness. Databricks’ push into this low-latency space addresses a critical bottleneck that has hindered the widespread adoption of real-time AI applications.

Mentioned in this story

Markets

SnowflakeNYSE:SNOW

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsDatabricksDatabricks Feature StoreSparkSpark Real-Time ModeLakebaseKafkaRocksDBStartupHub.ai

StartupHub.ai StaffDaniel SingerWritten by StartupHub.ai Staff, Editorial teamReviewed by Daniel Singer, EditorAbout

StartupHub.ai Staff, Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer, Editor

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

More from Daniel Singer

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.