# webscrape.ai

> Fetch pages and return structured JSON, HTML, markdown, or replayed browser output.

## Docs

- [Introduction](https://webscrape.ai/docs/api-reference/introduction.md): webscrape.ai API reference (v1).
- [Scrape](https://webscrape.ai/docs/api-reference/scrape.md): Fetch a URL with the standard fetcher or optional stealth. Returns HTML by default. Pass `clean: true` for cleaned markdown, or `extract_links: true` to receive a deduplicated list of outbound links. PDFs are auto-converted to markdown.
- [Fetch a URL as HTML, markdown, or links](https://webscrape.ai/docs/api-reference/scrape/fetch-a-url-as-html-markdown-or-links.md): Fetch a URL with the standard fetcher or optional stealth. Returns HTML by default. Pass `clean: true` for cleaned markdown, or `extract_links: true` to receive a deduplicated list of outbound links. PDFs are auto-converted to markdown.
- [Structured extraction with JSON-schema validation](https://webscrape.ai/docs/api-reference/scrape/structured-extraction-with-json-schema-validation.md): Give a URL and a `user_prompt` (and optionally an `output_schema`), get JSON back. Handles long content, noisy pages, and complex schemas.
- [Current SmartBrowse plan caps and 30-day usage](https://webscrape.ai/docs/api-reference/smartbrowse/current-smartbrowse-plan-caps-and-30-day-usage.md): Returns the caller's rolling-30-day run count, plan caps (runs/month, pages/run, cost/page), schedule allowance, and a summary of their last run (if any).
- [Dispatch run](https://webscrape.ai/docs/api-reference/smartbrowse/dispatch.md): Returns immediately with a `run_id`. Poll `GET /v1/smartbrowse/runs/{id}` for progress and final result.
- [Dispatch a SmartBrowse run](https://webscrape.ai/docs/api-reference/smartbrowse/dispatch-a-smartbrowse-run.md): Returns immediately with a `run_id`. Poll `GET /v1/smartbrowse/runs/{id}` for progress and final result.
- [Get run](https://webscrape.ai/docs/api-reference/smartbrowse/get-run.md)
- [Poll a SmartBrowse run](https://webscrape.ai/docs/api-reference/smartbrowse/poll-a-smartbrowse-run.md)
- [SmartScraper](https://webscrape.ai/docs/api-reference/smartscraper.md): Give a URL and a `user_prompt` (and optionally an `output_schema`), get JSON back. Handles long content, noisy pages, and complex schemas.
- [Build with AI](https://webscrape.ai/docs/build-with-ai.md): Use webscrape.ai inside an AI agent, or point an AI assistant at this docs site.
- [Authentication](https://webscrape.ai/docs/concepts/authentication.md): API key format, generation, rotation, and common auth errors.
- [Credits & pricing](https://webscrape.ai/docs/concepts/credits.md): Per-endpoint costs, stealth surcharges, and how billing works.
- [Errors](https://webscrape.ai/docs/concepts/errors.md): HTTP status codes, the error envelope shape, stable error codes, and how to handle them.
- [Pick the right product](https://webscrape.ai/docs/concepts/products.md): Scrape vs SmartScraper vs SmartBrowse, and when to use each.
- [Rate limits](https://webscrape.ai/docs/concepts/rate-limits.md): What's throttled, how to detect it, and how to back off.
- [Stealth mode](https://webscrape.ai/docs/concepts/stealth-mode.md): When to set stealth: true, how it works, and what it costs.
- [Webhooks](https://webscrape.ai/docs/concepts/webhooks.md): Push delivery for SmartBrowse run lifecycle events.
- [Scrape](https://webscrape.ai/docs/features/scrape.md): Format choice, link extraction, tag filtering, stealth tradeoffs, and troubleshooting for raw fetches.
- [SmartBrowse](https://webscrape.ai/docs/features/smartbrowse.md): Recipe authoring, drift score interpretation, schedules, webhooks, and when to use SmartBrowse over Scrape or SmartScraper.
- [SmartScraper](https://webscrape.ai/docs/features/smartscraper.md): Schema-driven extraction with practical patterns, schema-design tips, and troubleshooting.
- [Introduction](https://webscrape.ai/docs/index.md): Fetch pages and return structured JSON, HTML, markdown, or replayed browser output.
- [Quickstart](https://webscrape.ai/docs/quickstart.md): Sign up, generate a key, and pull structured JSON from any URL in under a minute.

## OpenAPI Specs

- [openapi](https://webscrape.ai/docs/openapi.yaml)