#Model Serving

4 articles with this tag

Netflix's LLM Engine Revealed
Technology

Netflix's LLM Engine Revealed

Netflix reveals its custom LLM serving infrastructure built on vLLM and NVIDIA Triton, enabling flexibility and performance within its production environment.

13 days ago
Databricks Scales Real-Time Fraud Detection
Technology

Databricks Scales Real-Time Fraud Detection

Databricks details how its Lakehouse architecture, combining Model Serving and Lakebase autoscaling, achieves sub-50ms transaction fraud scoring.

14 days ago
Databricks Taps NVIDIA Vera for AI Agents
Technology

Databricks Taps NVIDIA Vera for AI Agents

Databricks and NVIDIA are integrating NVIDIA Vera CPUs and GPUs into the Databricks platform to accelerate the development of AI agents and other complex AI workloads.

about 1 month ago
Databricks Speeds ERGO Hestia Pricing
Technology

Databricks Speeds ERGO Hestia Pricing

ERGO Hestia enhances real-time pricing by integrating data and AI models on Databricks Lakehouse, boosting speed and governance.

about 2 months ago