#Web Scraping

Cloudflare Adds Website Crawling API

Cloudflare launches a new /crawl endpoint for its Browser Rendering service, enabling automated website crawling via a single API call for developers.

Google sues SerpAPI, signaling war on the AI data supply chain

AI Bot Traffic: How Crawlers Are Reshaping Web Traffic in 2025 - Cloudflare Data Reveals 80% Dominance

Firecrawl Secures $14.5M Series A for AI Web Crawler

\n Firecrawl , an AI web crawler startup, secured $14.5 million in a Series A funding round. Nexus Venture Partners led the investment.

Firecrawl Secures $14.5M Series A for AI Web Crawler

AI web crawler startup Firecrawl secured $14.5 million in a Series A funding round. Nexus Venture Partners led the investment, with participation from Shopify CEO Tobias Lütke and Y Combinator. The funding will fuel growth for its popular web crawler, which serves 350,000 developers.

EXCLUSIVE: Cloudflare Pay Per Crawl Marketplace to Top $500 Million Revenue in First Year

Cloudflare Will Gate Websites From LLMs and Charge Them for Access

"People trust the AI more over the last six months, which means they're not reading original content."

Federal Court Upholds Bright Data's Antitrust Claims Against X

Bright Data Web Scraping Prevailing Against X's Efforts to Sue