#LLM Gateway

4 articles with this tag

LLM Gateway Tradeoffs Twilio Learned in Prod
Artificial Intelligence

LLM Gateway Tradeoffs Twilio Learned in Prod

Twilio principal Kanish Manuja says LLM gateways must trade availability, latency, guardrails and cost with per-request fallback and strict timeouts.

about 2 months ago
AI Evals for Cross-Functional Teams at DoorDash
Artificial Intelligence

AI Evals for Cross-Functional Teams at DoorDash

DoorDash turned AI evals into a cross-functional workflow with self-serve judges and vibe-coded annotation UIs built on API-first primitives.

about 2 months ago
Otari Gateway Tames OpenCode Costs
Technology

Otari Gateway Tames OpenCode Costs

Otari Gateway integrates with OpenCode to provide real-time cost tracking and budget controls for AI coding sessions, requiring no code changes.

4 months ago
Otari: Own Your AI Stack
Technology

Otari: Own Your AI Stack

Otari launches an open-source LLM gateway and hosted platform to provide essential tools and capabilities for both frontier and open-weight AI models.

5 months ago