Open source focus
Open Source Alternatives to Airbench
60 open source AI Testing options similar to Airbench, ranked by named competitors first, sector overlap, and our 0-100 AI-readiness score. Each profile notes license and self-hosting where we have it.
Vijil55Agentic AISan Francisco, United States$17.0MOpen source
Langfuse54MLOpsBerlin, Germany$2.5MOpen source
CRAB26Agentic AIOpen source · Self-hostable
Arize AI65AI ObservabilityBerkeley, United StatesOpen source
Giskard60Artificial IntelligenceParis, France$2.5MOpen source
Langfuse GmbH58MLOpsBerlin, Germany$2.5MOpen source
Traceloop55LLMOpsTel Aviv, Israel$6.1MOpen source
- AGAgentDesk / BrowserTools54Recruitment Tech$17.0M
Open source
Qualifire32Generative AIOpen source
Cipherwake30CybersecurityOpen source
Halluminate28Agentic AIOpen source
- Svitch26AI GovernanceSan Francisco, United States
Open source
Modelglass12AI InfrastructureSydney, AustraliaOpen source
Axonmedical4HealthTechOpen source
LlamabenchFoundation ModelOpen source
MarchwardAgentic AISan Francisco, United StatesOpen source
OpenAI83Artificial IntelligenceSan Francisco, United States$493.9BOpen source
Together AI76AI InfrastructureSan Francisco, United States$906.0MOpen source · Self-hostable
OpenRouter70InfrastructureSan Francisco, United States$153.5MOpen source
Pinecone69AI InfrastructureSan Francisco, United States$138.0MOpen source
Daytona66AI InfrastructureNew York, United States$46.0MOpen source
Sourcegraph (Cody)66AI Coding AssistantSan Francisco, United States$301.0MOpen source
cubic65Supply ChainTel Aviv, IsraelOpen source
Dust65Agentic AIParis, France$15.0MOpen source
CopilotKit64Agentic AISan Francisco, United States$42.0MOpen source
Qodo64AI Coding AssistantTel Aviv, Israel$1.5MOpen source
Trigger Device Inc63AI AgentsLondon, United Kingdom$16.5MOpen source · Self-hostable
Weights & Biases (W&B)63MLOpsSan Francisco, United States$521.0MOpen source
Lakera AI AG63AI SecurityBerlin, Germany$12.0MOpen source
RadixArk62Artificial IntelligencePalo Alto, USA$20.0MOpen source
LiteLLM62Foundation ModelSan Francisco, United StatesOpen source · Self-hostable
Fiddler Labs, Inc.62MLOpsMountain View, United States$39.0MOpen source
Entire62Artificial Intelligence$60.0MOpen source · Self-hostable
LangChain61Agentic AISan Francisco, United States$260.0MOpen source
Applitools61EnterpriseSan Mateo, United States$41.5MOpen source
fal AI61Generative AISan Francisco, United States$20.0MOpen source
Replicate60AI InfrastructureSan Francisco, United StatesOpen source
Weaviate60Vector DatabaseAmsterdam, NetherlandsOpen source
Warp59AI Tools & AppsSan Francisco, United States$60.0MOpen source
Composio59Agentic AISan Francisco, United States$50.0MOpen source
Modular58AI InfrastructureSan Francisco, United States$380.0MOpen source
AgentMail58Agentic AISan Francisco, United States$7.5MOpen source
Agency58Agentic AISan Francisco, United States$20.0MOpen source
Fal58Agentic AISan Francisco, United States$182.3MOpen source
Auto-GPT56Agentic AI$12.0MOpen source · Self-hostable
CodeRabbit56AI Coding AssistantTel Aviv, Israel$120.0MOpen source
- CLClerk56Developer ToolsSan Francisco, United States$69.0M
Open source
Checksum55Test AutomationSan Francisco, United StatesOpen source
Arcten55Agentic AISan Francisco, United StatesOpen source
Paperspace55AI InfrastructureNew York, United States$166.5MOpen source
LightningAI55AI InfrastructureSan Francisco, United StatesOpen source
Graphite55AI Coding AssistantSan Francisco, United StatesOpen source
Toolbase54Developer ToolsSan Francisco, United StatesOpen source
Feast AI54MLOpsSan Francisco, United StatesOpen source · Self-hostable
Mem054Agentic AISan Francisco, United States$24.0MOpen source · Self-hostable
- HYHyphen AI54AI InfrastructureSeattle, United States$36.5M
Open source
Knostic54Cybersecurity$14.3MOpen source
MosaicML (now Databricks)54Foundation ModelSan Francisco, United States$21.7MOpen source
KiloClaw54Artificial IntelligenceOpen source · Self-hostable
Bito54AI Coding AssistantSan Francisco, United States$5.7MOpen source
| Company | Sector | License | HQ | Funding | Score |
|---|---|---|---|---|---|
| Vijil | Agentic AI | Open source | San Francisco, United States | $17.0M | 55 |
| Langfuse | MLOps | Open source | Berlin, Germany | $2.5M | 54 |
| CRAB | Agentic AI | Open source · Self-hostable | — | — | 26 |
| Arize AI | AI Observability | Open source | Berkeley, United States | — | 65 |
| Giskard | Artificial Intelligence | Open source | Paris, France | $2.5M | 60 |
| Langfuse GmbH | MLOps | Open source | Berlin, Germany | $2.5M | 58 |
| Traceloop | LLMOps | Open source | Tel Aviv, Israel | $6.1M | 55 |
| AGAgentDesk / BrowserTools | Recruitment Tech | Open source | — | $17.0M | 54 |
| Qualifire | Generative AI | Open source | — | — | 32 |
| Cipherwake | Cybersecurity | Open source | — | — | 30 |
| Halluminate | Agentic AI | Open source | — | — | 28 |
| AI Governance | Open source | San Francisco, United States | — | 26 | |
| Modelglass | AI Infrastructure | Open source | Sydney, Australia | — | 12 |
| Axonmedical | HealthTech | Open source | — | — | 4 |
| Llamabench | Foundation Model | Open source | — | — | — |
| Marchward | Agentic AI | Open source | San Francisco, United States | — | — |
| OpenAI | Artificial Intelligence | Open source | San Francisco, United States | $493.9B | 83 |
| Together AI | AI Infrastructure | Open source · Self-hostable | San Francisco, United States | $906.0M | 76 |
| OpenRouter | Infrastructure | Open source | San Francisco, United States | $153.5M | 70 |
| Pinecone | AI Infrastructure | Open source | San Francisco, United States | $138.0M | 69 |
| Daytona | AI Infrastructure | Open source | New York, United States | $46.0M | 66 |
| Sourcegraph (Cody) | AI Coding Assistant | Open source | San Francisco, United States | $301.0M | 66 |
| cubic | Supply Chain | Open source | Tel Aviv, Israel | — | 65 |
| Dust | Agentic AI | Open source | Paris, France | $15.0M | 65 |
| CopilotKit | Agentic AI | Open source | San Francisco, United States | $42.0M | 64 |
| Qodo | AI Coding Assistant | Open source | Tel Aviv, Israel | $1.5M | 64 |
| Trigger Device Inc | AI Agents | Open source · Self-hostable | London, United Kingdom | $16.5M | 63 |
| Weights & Biases (W&B) | MLOps | Open source | San Francisco, United States | $521.0M | 63 |
| Lakera AI AG | AI Security | Open source | Berlin, Germany | $12.0M | 63 |
| RadixArk | Artificial Intelligence | Open source | Palo Alto, USA | $20.0M | 62 |
| LiteLLM | Foundation Model | Open source · Self-hostable | San Francisco, United States | — | 62 |
| Fiddler Labs, Inc. | MLOps | Open source | Mountain View, United States | $39.0M | 62 |
| Entire | Artificial Intelligence | Open source · Self-hostable | — | $60.0M | 62 |
| LangChain | Agentic AI | Open source | San Francisco, United States | $260.0M | 61 |
| Applitools | Enterprise | Open source | San Mateo, United States | $41.5M | 61 |
| fal AI | Generative AI | Open source | San Francisco, United States | $20.0M | 61 |
| Replicate | AI Infrastructure | Open source | San Francisco, United States | — | 60 |
| Weaviate | Vector Database | Open source | Amsterdam, Netherlands | — | 60 |
| Warp | AI Tools & Apps | Open source | San Francisco, United States | $60.0M | 59 |
| Composio | Agentic AI | Open source | San Francisco, United States | $50.0M | 59 |
| Modular | AI Infrastructure | Open source | San Francisco, United States | $380.0M | 58 |
| AgentMail | Agentic AI | Open source | San Francisco, United States | $7.5M | 58 |
| Agency | Agentic AI | Open source | San Francisco, United States | $20.0M | 58 |
| Fal | Agentic AI | Open source | San Francisco, United States | $182.3M | 58 |
| Auto-GPT | Agentic AI | Open source · Self-hostable | — | $12.0M | 56 |
| CodeRabbit | AI Coding Assistant | Open source | Tel Aviv, Israel | $120.0M | 56 |
| CLClerk | Developer Tools | Open source | San Francisco, United States | $69.0M | 56 |
| Checksum | Test Automation | Open source | San Francisco, United States | — | 55 |
| Arcten | Agentic AI | Open source | San Francisco, United States | — | 55 |
| Paperspace | AI Infrastructure | Open source | New York, United States | $166.5M | 55 |
| LightningAI | AI Infrastructure | Open source | San Francisco, United States | — | 55 |
| Graphite | AI Coding Assistant | Open source | San Francisco, United States | — | 55 |
| Toolbase | Developer Tools | Open source | San Francisco, United States | — | 54 |
| Feast AI | MLOps | Open source · Self-hostable | San Francisco, United States | — | 54 |
| Mem0 | Agentic AI | Open source · Self-hostable | San Francisco, United States | $24.0M | 54 |
| HYHyphen AI | AI Infrastructure | Open source | Seattle, United States | $36.5M | 54 |
| Knostic | Cybersecurity | Open source | — | $14.3M | 54 |
| MosaicML (now Databricks) | Foundation Model | Open source | San Francisco, United States | $21.7M | 54 |
| KiloClaw | Artificial Intelligence | Open source · Self-hostable | — | — | 54 |
| Bito | AI Coding Assistant | Open source | San Francisco, United States | $5.7M | 54 |