#Harshul Jain
2 articles with this tag

Technology
Self-Hosted LLMs Must Learn to Say No
Audible and SAP engineers tell AI Engineer that self-hosted LLMs need ingress admission control to survive 40-call agent bursts.
1 day ago

Artificial Intelligence
Harshul Jain Audible Talks LLM Inference at Scale
Harshul Jain of Audible and Tanmay Sah were billed for an AI Engineer deep dive on LLM Inference at Scale, but source transcript yields no technical claims.
2 months ago

