Web Crawler MCP by InsightfulPipe

Web intelligence for AI agents: fetch, render, extract, research. x402 micropayments, no API keys.

DeepScout

Scrape any e-shop and match products across shops without EAN. API & MCP for AI agents.

web

Foura Mcp

Reliable web access for AI agents: smart HTTP, rotating proxies, and full-browser rendering.

Scrapewise

Scrape, clean and match product and price data from any website

Claude Desktopguide →Vscodeguide →Cursorguide →Windsurfguide →

Web Crawler MCP by InsightfulPipe

remote

Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.

web

Getting Started

npx @getmcp/cli add com.insightfulpipe/crawler

Requires Node.js 18+. Community-contributed server. Review source before installing.

Configuration

Config file: ~/Library/Application Support/Claude/claude_desktop_config.json

JSON

{
  "mcpServers": {
    "com.insightfulpipe/crawler": {
      "url": "https://crawler.insightfulmcp.com/",
      "transport": "streamable-http"
    }
  }
}

Claude Desktop MCP documentation

Related Servers

Clawfetch Mcp

Web intelligence for AI agents: fetch, render, extract, research. x402 micropayments, no API keys.

DeepScout

Scrape any e-shop and match products across shops without EAN. API & MCP for AI agents.

web

Foura Mcp

Reliable web access for AI agents: smart HTTP, rotating proxies, and full-browser rendering.

Scrapewise

Scrape, clean and match product and price data from any website