Scrapy
Agent49Agent Readiness: 49/100. Top 25%. Measured by StartupHub.ai. Median 41.Trust68Data Trust: 68/100. Above median. Measured by StartupHub.ai. Median 61.An open-source framework for fast and powerful web scraping and crawling, maintained by Zyte.
We may earn a commission from links on this Scrapy profile. That does not change the facts we publish.
About
Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It is currently maintained by Zyte (formerly Scrapinghub), a web-scraping development and services company.
Listed competitors
An open-source framework for automating web browsers for testing and administration tasks.
“This is a place for testers who are using Selenium and Java in their day to day work, to ask questions related to the same. Please be…” Reddit
A Node.js library by Google for controlling Chrome or Chromium through a high-level API.
Also in this space
A platform for web scraping, data extraction, and browser automation tools.
Shares Web Scraping, Data Extraction
“I found Apify’s flexibility, Bright Data’s power, and Octoparse being easy to use… they’re all basically packaging the same underlying…” r/automation
Provides a full-stack web scraping API and data extraction services for businesses.
Shares Web Scraping, Data Extraction
API for scraping websites, handling JavaScript rendering and headless browsers.
Shares Web Scraping, API Platform
Provides tools and services for automated browser testing and scraping.
Shares Web Scraping, Developer Tools
End-to-end data extraction for effortless web data extraction at scale with no code.
Shares Web Scraping, Data Extraction
An open-source, high-performance DataFrame library for Rust and Python, designed for efficient data manipulation and analysis.
Shares Open Source, Data Platform
“I've always struggled with when to use Spark versus tools like Polars or…” r/MicrosoftFabric
Key facts
- Website
- scrapy.org
- Headquarters
- Dublin, Ireland
- Founded
- 2008
- Business model
- Open Source
Tech stack
Detected on scrapy.org, last scanned 21 Sept 2026. Run your own scan
- Frontend
- Next.js, Tailwind CSS
- Analytics
- Google Analytics 4, Segment, Microsoft Clarity, Meta Pixel
- CMS / Builders
- Read the Docs
- CDN
- Vercel
- Affiliate program
- Refersion
Scrapy scores 76. Does yours?
That is its Ahrefs DR: the backlink strength of a domain, on the Ahrefs 0 to 100 scale. Paste your website and you get yours in about a minute.
Frequently asked
Is Scrapy trustworthy and reputable?
StartupHub's Data Trust & Reputation score for Scrapy is 68 out of 100, a generally safe rating, based on site security posture, privacy practices, malware and phishing checks, and public reputation signals.
Does Scrapy have an affiliate program?
Yes, Scrapy has an affiliate program. The program runs on Refersion. Register here: scrapy.org
Public record
SEC filings, insider activity, nonprofit links and pay benchmarks for Scrapy
