// scrapers

Turn any site into structured JSON

One API call takes a URL and a description of the fields you want, and hands back schema-validated JSON. No proxies to rent, no selectors to maintain. Below are worked examples by site — each one is a real, runnable request you can copy.

Try it in the playground

One call, start to finish

Every example below follows the same shape. Here it is end to end against books.toscrape.com, a public sandbox built for scraping practice:

curl https://api.webscrape.ai/v1/smartscraper \
  -H "X-API-Key: wsg_live_your_key_here" \
  -H "Content-Type: application/json" \
  -d '{
    "website_url": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html",
    "user_prompt": "Extract the book title, price, star rating, and stock availability."
  }'

You get back JSON shaped to match the fields you asked for — nothing to parse:

{
  "status": "completed",
  "data": {
    "result": {
      "title": "string",
      "price": "number",
      "rating": "number",
      "in_stock": "boolean"
    }
  },
  "credits_used": 5,
  "credits_remaining": 495,
  "request_id": "req_a1b2c3d4"
}

Example response shape; data.result matches the fields in your prompt. Failed fetches return a non-completed status and cost nothing.