Crawlbase

proxycrawl.com

A web data platform providing APIs to crawl and scrape websites, bypass anti-bot protections, render JavaScript, and extract structured data.

The Crawlbase API uses api key authentication; has freemium pricing; offers a free tier (Up to 10,000 requests free, no credit card); rate limits: 20 concurrent requests per token (~20 req/sec), up to 51,000,000 requests/month per token, 90 second single-request timeout. Verified 2026-07-08 with per-field source links.

Developer Tools Verified 2026-07-08 high confidence

Base URL

https://api.crawlbase.com/

crawlbase.com ↗

Auth

api_key

crawlbase.com ↗

Free tier

Up to 10,000 requests free, no credit card

crawlbase.com ↗

Pricing model

freemium

crawlbase.com ↗

Pricing

Crawling API and Enterprise Crawler billed per request (usage-based); Smart AI Proxy flat monthly plans (Free $0, Starter $149/mo, Advanced $229/mo, Premium $449/mo); Cloud Storage plans (Free $0, Developer $29/mo, Business $249/mo)

crawlbase.com ↗

Rate limits

20 concurrent requests per token (~20 req/sec), up to 51,000,000 requests/month per token, 90 second single-request timeout

crawlbase.com ↗

OpenAPI spec

not documented null

no source

MCP server

Crawlbase Web MCP Server enables AI agents and MCP-compatible LLMs to receive live web data; documented at crawlbase.com/docs/ai-mcp

crawlbase.com ↗