How do I install Commoncrawl?

Copy the http config for Cursor, Claude Desktop, Claude Code, or VS Code on this page. It uses the publisher's install, not a PlugMCP proxy.

Does Commoncrawl need an API key?

The publisher lists these environment variables: PIPEWORX_API_KEY.

What transport does Commoncrawl use?

Commoncrawl is reached over HTTP.

When was Commoncrawl last checked?

Last checked 2026-11-10. Common Crawl's public web archive — find every time a URL was crawled since 2008 and read the…

Commoncrawl MCP server

Power your agent

Add this server

The publisher's own URL. Not a PlugMCP endpoint.

Add to Cursor Add in Claude Add to VS Code Run on PlugMCP

Host a copy with our keys and logs.

Server URL

https://gateway.pipeworx.io/commoncrawl/mcp

Credentials from the publisher

PIPEWORX_API_KEY — Optional Pipeworx API key. Without it calls are anonymous and capped daily; a free key raises the cap.

The Claude button above opens Claude with the name and URL filled in. You still confirm it there.

shClaude Code

1claude mcp add --transport http io.github.pipeworx-io-commoncrawl https://gateway.pipeworx.io/commoncrawl/mcp

Run in a terminal.

jsonClaude Desktop

1{2  "mcpServers": {3    "io.github.pipeworx-io-commoncrawl": {4      "command": "npx",5      "args": [6        "-y",7        "mcp-remote",8        "https://gateway.pipeworx.io/commoncrawl/mcp"9      ]10    }11  }12}

claude_desktop_config.json

Remote · HTTPPublisher installStep-by-step: add this in Claude

Remote URL or a command on your machine? How the two installs differ

Run on PlugMCP

Host a copy with our keys and logs.

A new server you create. It is not this listing's official endpoint. Use the publisher install when you want their URL and their credentials.

Launch

Server facts

Remote

Transport: http
Version: 0.2.1

Tools

No tool list yet. Remote servers get one after the first health check.

FAQ

Commoncrawl

Add this server

Host a copy with our keys and logs.

Server facts

Tools

Questions

How do I install Commoncrawl?

Does Commoncrawl need an API key?

What transport does Commoncrawl use?

When was Commoncrawl last checked?

Documentation