#Autoscaling
2 articles with this tag
Technology
Databricks Tackles LLM Inference Costs
Databricks details its 'model units' abstraction and cost-aware autoscaling for reliable, high-throughput LLM inference, cutting GPU costs by over 80%.
about 2 hours ago
Technology
Databricks Lakehouse Adds Autoscaling
Databricks Lakehouse autoscaling eliminates provisioning headaches, dynamically adjusting compute for performance and cost savings, and can scale to zero.
3 months ago