#Inference Engineering

AI Inference: 10x Faster Models & Self-Optimization

Philip Kiely and Ali Taha of Baseten discuss AI inference, LLM optimization, speculative decoding, and the engineering behind cutting-edge AI models.