MCP Quickstart

Connect webscraperapi to Claude Code, Claude Desktop, Cursor, and other MCP clients in minutes.

MCP Quickstart

Connect webscraperapi as an MCP server so your AI agent can call scraping tools directly — no API integration code needed.

Sign up

Create an account at webscraperapi.ai. On your first MCP tool call, OAuth will open in your browser to authorize access.

Add the server

claude mcp add --transport http webscraperapi https://api.webscraperapi.ai/mcp

Add this to your Claude Desktop config file:

{
  "mcpServers": {
    "webscraperapi": {
      "type": "http",
      "url": "https://api.webscraperapi.ai/mcp"
    }
  }
}

Add this to your Cursor MCP config:

{
  "mcpServers": {
    "webscraperapi": {
      "url": "https://api.webscraperapi.ai/mcp"
    }
  }
}

Verify it works

Ask your agent to use webscraperapi:

use webscraperapi to fetch https://news.ycombinator.com and summarize the page

You should see a tool call like webscraperapi - scrape (MCP) in the output.

Available tools

ToolWhat it does
scrapeFetch any URL as markdown, HTML, or structured data
google_searchSearch Google and get structured results
google_shopping_searchGet product listings and prices from Google Shopping
google_adsSee paid ads for a search query
detect_technologiesIdentify the tech stack on any website
serp_domain_frequenciesFind which domains dominate search results
verify_email_addressCheck if an email address is deliverable

MCP is optional. You can also use webscraperapi through direct HTTP API calls with an API key.

Troubleshooting