CloudScraper MCP Server

A Model Context Protocol server that enables AI agents to bypass Cloudflare protection and scrape web content

---

Quick Start

Clone the repository and install dependencies:

git clone https://github.com/yourusername/cloudscraper-mcp-server.git
cd cloudscraper-mcp-server
uv sync

Add to Claude Code:

claude mcp add cloudscraper-mcp \
  --type stdio \
  --command "uv" \
  --args "run" "server.py" \
  --directory "/path/to/cloudscraper-mcp-server"

Add to VSCode / any MCP-compatible IDE:

{
  "mcpServers": {
    "cloudscraper-mcp": {
      "type": "stdio",
      "command": "uv",
      "args": ["run", "server.py"],
      "cwd": "/path/to/cloudscraper-mcp-server"
    }
  }
}

---

Features

• Cloudflare Bypass — Automatically handles Cloudflare protection so AI agents can reach pages that block standard requests
• Content Cleaning — Converts HTML to clean, LLM-friendly Markdown
• Smart Chunking — Automatically splits large responses into 10k-token chunks with continuation tokens
• Binary Handling — Base64-encodes non-text content so agents can handle images and downloads
• File Export — Save scraped content directly to disk via scrape_url_to_file
• Docker Support — Containerized deployment via DOCKER.md

Three tools are available: scrape_url (returns content as a string), scrape_url_raw (returns content plus response metadata), and scrape_url_to_file (saves content to disk).

---

Configuration

Transport Protocols

Transport	Best For	Configuration
stdio	Claude Code, VSCode, Direct AI integration	Default mode, no environment variables needed
http	n8n, Web apps, API integrations, Remote access	Requires MCP_TRANSPORT=http

Run with HTTP transport:

MCP_TRANSPORT=http MCP_HOST=0.0.0.0 MCP_PORT=8000 uv run server.py

Environment Variables

Variable	Default	Options	Description
MCP_TRANSPORT	stdio	stdio, http	Transport protocol selection
MCP_HOST	0.0.0.0	Any valid IP	Host binding for HTTP mode
MCP_PORT	8000	Any valid port	Port for HTTP mode