Free crawling, search and reader APIs
Usable crawl, search, reader and unblocker APIs.
| # | offer | badges | |
|---|---|---|---|
| 1 | Context.dev 1,000 credits a month, no credit card, 10 requests a minute | ★ qualifiesemailno cardDrequest-rate | |
| 2 | Firecrawl 500 searches or 1,000 pages scraped a month on the Free plan, 2 concurrent requests, no card | ★ qualifiesemailno cardDrequest-rate | |
| 3 | Jina Reader r.jina.ai is free at 20 requests a minute with no key; a free API key raises it to 500 RPM and carries 10M tokens | ★ qualifiesanonymousno cardMper-ip-shaping | |
| 4 | OpenAlex USD 1 of API usage a day with a free key; keyless requests at 10 a second | ★ qualifiesemailcardDrequest-rate | |
| 5 | Internet Archive Wayback Machine keyless listing, closest and replay of existing captures; Save Page Now needs keys | ★ qualifiesanonymousno cardMper-object-cap | |
| 6 | Apify USD 5 of platform usage a month on the Free plan, 5 concurrent runs | caveatemailno cardDper-object-cap | |
| 7 | Arquivo.pt keyless CDX and replay of the Portuguese web archive | caveatanonymousno cardRrequest-rate | |
| 8 | Bright Data 5,000 records a month on the Free Tier, no credit card | caveatemailno cardDrequest-rate | |
| 9 | Browserless 1,000 units a month, no card, 2 concurrent browsers, 2 minutes maximum session | caveatemailno cardDretention-clamped | |
| 10 | Cloudflare Workers AI 10,000 Neurons a day per account on Workers Free | caveatemailno cardRrequest-rate | |
| 11 | Cloudflare Browser Rendering Workers Free: 600 browser-seconds a day, or 10 browser-minutes; 3 concurrent browsers | caveatemailno cardRrequest-rate | |
| 12 | Cloudflare URL Scanner free with a Cloudflare account; scans of the exact URL in the last 30 days | caveatemailno cardDretention-clamped | |
| 13 | Common Crawl keyless index and WARC access | caveatanonymousno cardMrequest-rate | |
| 14 | Crawl4AI 1,000 credits a month on the hosted cloud; the pricing page also declares 2,500 | caveatemailno cardRper-object-cap | |
| 15 | Crawlbase up to 5,000 successful requests free, no credit card | caveatemailno cardDper-object-cap | |
| 16 | Diffbot 10,000 credits a month on the Free plan, 5 requests a minute, no credit card | caveatemailno cardDrequest-rate | |
| 17 | Exa USD 10 in credits on signup, reset to USD 10 on the first of each month, no payment method; a one-time USD 10 bonus after onboarding | caveatemailcardDrequest-rate | |
| 18 | Firecrawl keyless route a keyless route to the Research Index only | caveatanonymousno cardRrequest-rate | |
| 19 | Keenable 100,000 requests a month | caveatemailno cardDrequest-rate | |
| 20 | Parallel 5,000 requests a month, card on file | caveatcardcardRrequest-rate | |
| 21 | Scrape.do 1,000 successful calls a month | caveatemailno cardRrequest-rate | |
| 22 | ScraperAPI 1,000 API credits on signup, 5 concurrent connections | caveatemailno cardDper-object-cap | |
| 23 | Scrapfly 1,000 API credits on signup, no credit card, 5 concurrent | caveatemailno cardDper-object-cap | |
| 24 | ScrapingAnt 10,000 credits a month, no credit card, refreshed monthly | caveatemailno cardDper-object-cap | |
| 25 | SerpApi 250 searches a month on the Free plan, 50 an hour | caveatemailno cardDrequest-rate | |
| 26 | Serper 2,500 queries on signup, one-time, no credit card | caveatemailno cardRrequest-rate | |
| 27 | Tavily 1,000 API credits a month, no credit card, reset on the first of the month | caveatemailno cardDrequest-rate | |
| 28 | Tavily keyless route a shared public route with no key | caveatanonymousno cardRrequest-rate | |
| 29 | TinyFish Search free at 30 requests a minute and 500 an hour; Fetch free at 150 URLs a minute and 1,000 URLs a day | caveatemailno cardDrequest-rate | |
| 30 | urlscan.io 1,000 unlisted and 5,000 public scans a day, 1,000 searches a day, 10,000 result requests a day | caveatanonymousno cardRrequest-rate | |
| 31 | You.com 100 Web Search API queries a day through the hosted MCP route, with no API key, no account and no credit card | caveatanonymousno cardDrequest-rate | |
| 32 | ZenRows 5,000 credits a month, no card, 5 concurrent requests, monthly refresh with no rollover | caveatemailno cardDper-object-cap |
The query
SELECT rid, vorder FROM record WHERE topic='crawler-scraper' AND grp='usable' AND duplicate_of IS NULL ORDER BY vorder ASC NULLS LAST
Run it yourself: /api/v1/need/crawling, the MCP tool need, or fr need crawling.