Verstappen wins chaotic Japanese GP
The web,
as an API.
- Billed only on success
- Browser-grade fetching
SmartScraper — a URL and a plain-English prompt in, schema-validated JSON out.
One SDK, every stack — drop it in and go
Built for developers who need reliable scraped data
AI Agent Extraction
Describe what you want in plain English. Our agents understand the page semantically and return exactly the structured data you asked for.
user_prompt: "Extract top 5 stories with title, url, points" ✓ 5 items · 312ms [{ title, url, points }, …]
SmartBrowse
Record clicks and navigation once in a visual studio, then replay the recipe as an API on real Chrome. No code, no selectors.
rec ▸ click "Next page"rec ▸ extract 24 rows✓ saved recipe✓ replay ×1000
Intelligent Chunking
Long pages are split, processed in parallel, and deduped on merge — so even huge documents extract fast and completely.
Content Reduction
A local NLP layer strips navbars, ads, and noise before extraction — cutting cost and latency by 50–80% with no accuracy loss.
Schema Enforcement
Validate, repair, guarantee. JSON Schema in, conforming data out — with one automatic repair pass when a field misses.
validate schema✓ 5/5 fields matched✓ no repair needed
Auto-recovery
Failed fetches retry automatically with backoff — and you are never charged for a failed request.
Any Input Source
URLs, raw HTML, Markdown, or PDFs — one API for all of them.
One request. Six stages. Clean JSON.
What you can build
E-commerce monitoring
Track prices, stock, and reviews across thousands of product pages with consistent JSON schemas.
Lead generation
Extract names, emails, titles, and company info from directories and profiles at scale.
News & content intel
Pull articles, authors, dates, and entities from any publisher into clean, queryable data.
AI agent tooling
Plug structured web data into LangChain, n8n, or your own agents — no scrapers to maintain.
Stop fighting selectors and broken scrapers
| capability | SmartScraper | DIY scraper | Headless browser |
|---|---|---|---|
| any site, no selectors | SmartScraper: yes — no selectors needed | DIY scraper: no — hand-write selectors | Headless browser: partial — you write the parser |
| structured output | SmartScraper: yes — schema-valid JSON | DIY scraper: no — validate it yourself | Headless browser: partial — raw HTML, no schema |
| auto-recovery | SmartScraper: yes — retries & repairs | DIY scraper: no — build your own retries | Headless browser: partial — reloads, never re-parses |
| long pages | SmartScraper: yes — auto-chunked to fit | DIY scraper: no — split it yourself | Headless browser: partial — whole DOM, you chunk |
| noise removal | SmartScraper: yes — nav & ads stripped | DIY scraper: no — pay tokens for noise | Headless browser: partial — full DOM, nothing trimmed |
| input formats | SmartScraper: yes — PDF, HTML & Markdown | DIY scraper: no — wire each format | Headless browser: partial — HTML only, no PDF |
| maintenance | SmartScraper: yes — survives redesigns | DIY scraper: no — breaks on redesign | Headless browser: partial — markup shift breaks it |
| infrastructure | SmartScraper: yes — one API call | DIY scraper: no — run your own fleet | Headless browser: partial — you host the browser |
One endpoint. Any language.
# fetch the top 5 HN stories
curl -X POST https://api.webscrape.ai/v1/smartscraper \
-H "Content-Type: application/json" \
-H "X-API-Key: $API_KEY" \
-d '{
"website_url": "https://news.ycombinator.com",
"user_prompt": "Extract the top 5 stories with title, url, and points"
}'- ▸fetch12ms
- ▸clean3ms
- ▸reduce23ms
- ▸extract480ms
- ▸validate2ms
// 200 OK · extracted in ~520ms
{
"status": "completed",
"data": {
"result": {
"stories": [
{
"title": "Show HN: I built a real-time code editor",
"url": "https://example.com/editor",
"points": 342
},
{
"title": "Why Rust is the future of systems programming",
"url": "https://example.com/rust",
"points": 281
},
// … 3 more stories
]
}
},
"credits_used": 5,
"credits_remaining": 495,
"request_id": "req_aB3xY9Kp"
}Simple, transparent pricing
Founding launch — 30% off for life on any subscription with code FOUNDING
Free
Free forever — credits refill every month, not a one-time trial.
- 500 starting credits
- 300 free credits every month
- 1 concurrent request
- 10 requests / minute
- 7-day data retention
- Limited SmartBrowse
Hobby
For side projects and prototypes.
- 5,000 credits / month
- 10 concurrent requests
- 100 requests / minute
- Standard fetch tier
- 30-day data retention
- 20% off extra credit
Startup
Cost EfficientFor growing teams in production.
- 30,000 credits / month
- 50 concurrent requests
- 500 requests / minute
- Priority routing
- 30-day data retention
- Priority support
- 40% off extra credit
Enterprise
Tailored solutions for large organizations.
- Unlimited credits
- Custom rate limits
- Dedicated infrastructure
- Dedicated routing
- 99.9% SLA guarantee
- Dedicated account manager
- On-premise deployment
Base rate: 1 credit / Scrape · 5 / SmartScraper AI extraction · 2 / SmartBrowse run replay
AI agent? Read the plain-text version at /pricing.md.
Frequently asked questions
What's new
The latest platform updates, newest first.
- ▸Public launch — API + dashboard livev1.0
- ▸Official SDKs — Go, Python, Node, Rust & Java5 languages
- ▸Extraction engine rebuilt in Gop50 −40%
- ▸Private beta — early access opensinvite-only
- ▸Isolated microVM browsers + managed networkingincluded
Ready to extract structured data?
Get an API key in seconds — 500 free credits, no card required. Or try it first in the playground.