LitellmLitellm
Litellm

Litellm

Stealth modeStealth Mode

Open-source library to simplify LLM API calls and manage LLM providers.

2023Active

About

litellm is an open-source Python library designed to simplify the process of interacting with various Large Language Models (LLMs) and their APIs. It provides a unified interface to access models from providers like OpenAI, Azure, Cohere, Anthropic, and more, abstracting away the complexities of different API structures and authentication methods. This allows developers to easily switch between LLM providers, manage costs, and implement features like fallbacks and caching.

Technology stack

detected 2026-06-17
Est. monthly stack spend~$70/mo
Emailnone
Comments
(6)
0 positive1 mixed5 negative
Reddit
r/LocalLLaMAu/__lawlessMay 27, 2026Negative

I am considering switching from litellm (sdk) to Mozilla’s any-llm. They also have a proxy to go with it called otari. On the face of it the repos looks a lot more well kept and stable (had a lot of issues with litellm before).

View on Reddit
Reddit
r/LocalLLaMAu/Ambitious-Future-800Apr 12, 2026Negative

Been running LiteLLM in prod for a few months. After the March 24 incident (the PyPI backdoor that stole cloud keys + K8s secrets), our platform team is now asking us to justify keeping it.

View on Reddit
Reddit
r/LocalLLaMAu/CRYPTOJPGSMar 30, 2026Mixed

Hey folks, Aspiring founder of a few AI powered app here,just at the pre mvp stage, and Ihave been checking LiteLLM lately as a layer for managing multiple model providers. For those who haveve used it , I would love to hear your honest vie…

View on Reddit
Reddit
r/Pythonu/InternationalAsk1490Mar 25, 2026Negative

After the supply chain attack, here are some litellm alternatives. litellm versions 1.82.7 and 1.82.8 on PyPI were compromised with credential-stealing malware.

View on Reddit
Reddit
r/LLM_Gatewaysu/Ambitious-Guy-13Mar 25, 2026Negative

LiteLLM, while useful for prototyping and small-scale projects, increasingly shows its cracks under real production load and enterprise requirements. If you are evaluating LiteLLM alternatives in 2026, this blog breaks down what to look for…

View on Reddit
Reddit
r/SillyTavernAIu/Own_Caterpillar2033Mar 24, 2026Negative

LiteLLM HAS BEEN COMPROMISED, DO NOT UPDATE. We just discovered that LiteLLM pypi release 1.82.8. It has been compromised, it contains litellm_init.pth with base64 encoded instructions to send all the credentials it can find to remote serve…

View on Reddit

Some comments are pulled from public discussions around the web (look for the source icon). Quotes are excerpts; click through to read the full thread.

Frequently asked

What does Litellm do?

litellm is an open-source Python library designed to simplify the process of interacting with various Large Language Models (LLMs) and their APIs. It provides a unified interface to access models from providers like OpenAI, Azure, Cohere, Anthropic, and more, abstracting away the complexities of different API structures and authentication methods. This allows developers to easily switch between LLM providers, manage costs, and implement features like fallbacks and caching.

How much funding has Litellm raised?

Litellm has raised a total of $5M in funding. The most recent round on record is Seed.

Where is Litellm headquartered?

Litellm is headquartered in San Francisco, United States.

When was Litellm founded?

Litellm was founded in 2023.

What industry does Litellm operate in?

Litellm operates in LLM Orchestration, API Platform, Developer Tools, Foundation Model, Large Language Model, Generative AI.