Litellm
Litellm

Litellm

Open-source library to simplify LLM API calls and manage LLM providers.

About

litellm is an open-source Python library designed to simplify the process of interacting with various Large Language Models (LLMs) and their APIs. It provides a unified interface to access models from providers like OpenAI, Azure, Cohere, Anthropic, and more, abstracting away the complexities of different API structures and authentication methods. This allows developers to easily switch between LLM providers, manage costs, and implement features like fallbacks and caching. Teams look it up for LLM Orchestration, API Platform, Developer Tools.

Frequently asked

What does Litellm do?

Litellm is a LLM Orchestration company that offers Platform. Teams look it up for API Platform, Developer Tools, Foundation Model. It was founded in 2026. Compare it on funding, headcount, reviews and nearby alternatives rather than the marketing line alone.

When was Litellm founded?

Litellm was founded in 2026.

What industry does Litellm operate in?

Litellm operates in LLM Orchestration, API Platform, Developer Tools, Foundation Model, Large Language Model.

Scores
Measured, not editorial
Agent Readiness
43/100

How well an AI agent can read and use this site: structured data, clean markup, and whether key facts are reachable without running JavaScript. We scan the live site.

Site Speed
89/100

Google PageSpeed mobile performance for the company’s own site. Measured by Google, not by us.

Comments
(5)
0 positive1 mixed5 negative
Reddit
r/LocalLLaMAu/__lawlessMay 27, 2026Negative

I am considering switching from litellm (sdk) to Mozilla’s any-llm. They also have a proxy to go with it called otari. On the face of it the repos looks a lot more well kept and stable (had a lot of issues with litellm before).

View on Reddit
Reddit
r/LocalLLaMAu/Ambitious-Future-800Apr 12, 2026Negative

Been running LiteLLM in prod for a few months. After the March 24 incident (the PyPI backdoor that stole cloud keys + K8s secrets), our platform team is now asking us to justify keeping it.

View on Reddit
Reddit
r/LocalLLaMAu/CRYPTOJPGSMar 30, 2026Mixed

Hey folks, Aspiring founder of a few AI powered app here,just at the pre mvp stage, and Ihave been checking LiteLLM lately as a layer for managing multiple model providers. For those who haveve used it , I would love to hear your honest vie…

View on Reddit
Reddit
r/LLM_Gatewaysu/Ambitious-Guy-13Mar 25, 2026Negative

LiteLLM, while useful for prototyping and small-scale projects, increasingly shows its cracks under real production load and enterprise requirements. If you are evaluating LiteLLM alternatives in 2026, this blog breaks down what to look for…

View on Reddit
Reddit
r/SillyTavernAIu/Own_Caterpillar2033Mar 24, 2026Negative

LiteLLM HAS BEEN COMPROMISED, DO NOT UPDATE. We just discovered that LiteLLM pypi release 1.82.8. It has been compromised, it contains litellm_init.pth with base64 encoded instructions to send all the credentials it can find to remote serve…

View on Reddit

Some comments are pulled from public discussions around the web (look for the source icon). Quotes are excerpts; click through to read the full thread.