#Web Scraping
11 articles with this tag
AI Agents' Web Search Claims: A Deceptive Loop?
Rafael Levi of Bright Data reveals how AI agents' claims of web searches can be deceptive, and how Bright Data's MCP solves website blocking and data retrieval issues.
Bright Data's AI Agent Builds Web Scraping Pipelines
Rafael Levi from Bright Data showcases how AI agents can autonomously build and maintain web scraping pipelines, reducing manual effort and costs.
Cloudflare Adds Website Crawling API
Cloudflare launches a new /crawl endpoint for its Browser Rendering service, enabling automated website crawling via a single API call for developers.
Google sues SerpAPI, signaling war on the AI data supply chain
AI Bot Traffic: How Crawlers Are Reshaping Web Traffic in 2025 - Cloudflare Data Reveals 80% Dominance
Firecrawl Secures $14.5M Series A for AI Web Crawler
Firecrawl, an AI web crawler startup, secured $14.5 million in a Series A funding round. Nexus Venture Partners led the investment.
Firecrawl Secures $14.5M Series A for AI Web Crawler
AI web crawler startup Firecrawl secured $14.5 million in a Series A funding round. Nexus Venture Partners led the investment, with participation from Shopify CEO Tobias Lütke and Y Combinator. The funding will fuel growth for its popular web crawler, which serves 350,000 developers.
EXCLUSIVE: Cloudflare Pay Per Crawl Marketplace to Top $500 Million Revenue in First Year
Cloudflare Will Gate Websites From LLMs and Charge Them for Access
"People trust the AI more over the last six months, which means they're not reading original content."
Federal Court Upholds Bright Data's Antitrust Claims Against X
