Open Source Alternatives to Scrapy
57 open source Web Scraping options similar to Scrapy, ranked by named competitors first, sector overlap, and our 0-100 AI-readiness score. Every company listed publishes its source: each one carries an open source sector tag and a public GitHub repository.
PuppeteerNot ratedA Node.js library by Google for controlling Chrome or Chromium through a high-level API.
Open source · Self-hostable
SeleniumNot ratedAn open-source framework for automating web browsers for testing and administration tasks.
Open source · Self-hostable
BrowserUseNot ratedProvides tools and services for automated browser testing and scraping.
Open source · Self-hostable
AirweaveNot ratedOpen-source tool to transform application data into accessible knowledge for AI agents.
Open source · Self-hostable
MetabaseNot ratedOpen-source business intelligence and embedded analytics platform.
Open source · Self-hostable
Steel.devNot ratedCloud-based browser API for AI agents, simplifying web automation with anti-bot protection and session persistence.
Open source · Self-hostable
DVCNot ratedOpen-source platform for ML experiment tracking and data versioning.
Open source · Self-hostable
Feast AINot ratedAn open-source feature store for managing and serving data for AI/ML models in production.
Open source · Self-hostable
MagnitudeNot ratedOpen-source, vision-first browser agent for natural language control and web task automation.
Open source · Self-hostable
PolarsNot ratedAn open-source, high-performance DataFrame library for Rust and Python, designed for efficient data manipulation and analysis.
Open source · Self-hostable
- Spice AINot rated
Ground AI in enterprise data with zero ETL. Spice is an open-source SQL query & hybrid search engine built for data-intensive apps & AI agents.
Open source · Self-hostable
ResponsiveNot ratedPlatform for developers building stateful reactive applications on the modern cloud with object store native databases.
Open source · Self-hostable
Faiss by MetaNot ratedOpen-source library by Meta AI for efficient similarity search and clustering of dense vectors.
Open source · Self-hostable
SwaggerNot ratedA suite of open-source and professional tools for API design, development, documentation, and testing.
Open source · Self-hostable
MLflowNot ratedOpen-source platform for managing the ML lifecycle, from experimentation to deployment.
Open source · Self-hostable
InconvoNot ratedInconvo is an open-source platform for building data agents on production data with safe queries, permissions, and structured outputs.
Open source · Self-hostable
Apache AirflowNot ratedOpen-source platform for programmatically authoring, scheduling, and monitoring data pipelines.
Open source · Self-hostable
API PlatformNot ratedOpen-source framework for building and documenting APIs with a focus on developer experience.
Open source · Self-hostable
Together AINot ratedTogether AI offers an AI-native cloud platform providing high-performance inference APIs, GPU clusters, and fine-tuning capabilities for open-source AI models.
Open source · Self-hostable
MastraNot ratedAn open-source TypeScript/JavaScript framework for building AI agents, from the creators of Gatsby.
Open source · Self-hostable
QdrantNot ratedHigh-performance, open-source vector search engine built in Rust for production-grade AI and machine learning workloads.
Open source · Self-hostable
- SupabaseNot rated
Open source Firebase alternative with a PostgreSQL backend and real-time capabilities.
Open source · Self-hostable
PositNot ratedOpen-source data science platform for enterprise teams, enabling collaboration and reproducible results.
Open source · Self-hostable
ScyllaDBNot ratedScyllaDB is a high-performance, low-latency NoSQL database for data-intensive applications, designed to scale with modern infrastructure.
Open source · Self-hostable
YugabyteDBNot ratedDistributed SQL database for cloud-native applications, offering high availability and horizontal scalability.
Open source · Self-hostable
FireboltNot ratedCloud data warehouse for building next-gen analytics experiences with sub-second performance, designed for engineers and AI agents.
Open source
H2O.aiNot ratedAn open-source AI and machine learning platform for enterprises.
Open source · Self-hostable
Logz.ioNot ratedLogz.io provides an observability platform for cloud-native businesses, combining open-source tools for monitoring and security.
Open source · Self-hostable
HyperbolicNot ratedOpen-access AI cloud platform providing affordable, on-demand GPUs for training and serving AI models.
Open source
RedpandaNot ratedA streaming data platform designed for real-time applications and data pipelines.
Open source · Self-hostable
Trigger Device IncNot ratedAn open-source platform for building and deploying AI agents and workflows.
Open source · Self-hostable
BunNot ratedA fast, all-in-one JavaScript toolkit including a runtime, bundler, test runner, and package manager.
Open source · Self-hostable
AppwriteNot ratedOpen-source backend-as-a-service platform for building scalable applications.
Open source · Self-hostable
Vanna AINot ratedAn open-source AI-powered SQL agent for natural language database interaction and data insights.
Open source · Self-hostable
MetalBearNot ratedOpen-core company building tools for modern backend engineers to ship faster and better.
Open source · Self-hostable
Mem0Not ratedPersistent memory layer for AI agents and applications.
Open source · Self-hostable
pgEdge, Inc.Not ratedpgEdge offers distributed PostgreSQL that is optimised for the network edge in order to reduce data latency.
Open source · Self-hostable
Auto-GPTNot ratedOpen-source autonomous AI agent platform that automates complex digital workflows.
Open source · Self-hostable
Comfy OrgNot ratedComfy is an AI creation engine for visual professionals, offering granular control over AI models, parameters, and outputs through a node-based workflow on an infinite canvas.
Open source
WireMockNot ratedIndustry-standard API simulation and mocking platform for reliable software development and testing.
Open source · Self-hostable
LiteLLMNot ratedAn open-source Python library providing a unified interface for interacting with various LLM providers.
Open source · Self-hostable
OllamaNot ratedRun large language models locally on your machine.
Open source · Self-hostable
DBeaverNot ratedA universal database management tool for developers and database administrators, supporting a wide range of databases.
Open source · Self-hostable
InfisicalNot ratedOpen-source platform for managing secrets and sensitive data for developers.
Open source · Self-hostable
Visual LayerNot ratedAI-powered database for visual data, enabling intelligent search and analysis of images and videos.
Open source · Self-hostable
VocodeNot ratedOpen-source library for building hyper-realistic voice agents and conversational AI applications.
Open source · Self-hostable
All-Hands AINot ratedAn open-source platform for building and running AI coding agents that automate software development tasks.
Open source · Self-hostable
RelAINot ratedAn open-source platform for building, simulating, evaluating, and optimizing reliable AI agents.
Open source · Self-hostable
RasaNot ratedOpen-source conversational AI platform for building custom chatbots and virtual assistants.
Open source · Self-hostable
KestraNot ratedAn open-source orchestration platform for unifying data pipelines, AI workflows, and business processes.
Open source · Self-hostable
NovuNot ratedOpen-source notification infrastructure for developers, empowering the community.
Open source · Self-hostable
ORYNot ratedOpen-source identity and authorization services for applications, offering composable and scalable IAM solutions.
Open source · Self-hostable
KiloClawNot ratedA managed, private, and production-grade environment for OpenClaw, offering access to over 500 AI models and essential tools.
Open source · Self-hostable
PromptQLNot ratedAn AI-native workspace designed to turn team interactions into actionable, proprietary data for agentic workflows.
Open source · Self-hostable
Bubble LabNot ratedOpen-source, Typescript-native agentic workflow builder for natural language to code generation.
Open source · Self-hostable
GitHitsNot ratedThe Google of code search for open-source.
Open source · Self-hostable
Future AGINot ratedAn open-source, end-to-end AI agent engineering platform for simulating, evaluating, and optimizing LLM applications.
Open source · Self-hostable

