Web Content & URL Tools MCP Server
A remote Model Context Protocol server that gives AI agents 26 tools for reading and checking the web — no browser, no setup, pay only for successful calls.
Read any page as clean Markdown, pull its metadata or structure, detect its tech stack, and check redirects, TLS certificates, security headers, robots.txt, sitemaps, feeds, domains (WHOIS/DNS), SEO, broken links, email authentication (SPF, DMARC, DKIM) and single sign-on (SAML, OpenID Connect). It also includes everyday developer utilities (cron, regex, color, Unicode, time zones) and Hyperliquid perpetuals market data.
- Apify Store: https://apify.com/avalonai/web-content-url-tools-mcp
- Developer docs: https://avaloncompany.ai/developers/
- Transport: Streamable HTTP (remote, hosted on Apify Standby)
Connect
Option 1 — Standby URL + Apify API token
Use your Apify API token as a Bearer token. Works in Claude Desktop, Claude Code, Cursor, VS Code, Windsurf and any MCP client that supports remote servers with headers.
{
"mcpServers": {
"web-content-url-tools": {
"url": "https://avalonai--web-content-url-tools-mcp.apify.actor/mcp",
"headers": { "Authorization": "Bearer <YOUR_APIFY_TOKEN>" }
}
}
}
Option 2 — OAuth via mcp.apify.com (no token to copy)
Clients that support MCP OAuth can connect through Apify's hosted MCP gateway and sign in with their Apify account in the browser:
https://mcp.apify.com?tools=avalonai/web-content-url-tools-mcp
Claude Code example:
claude mcp add --transport http web-content-url-tools "https://mcp.apify.com?tools=avalonai/web-content-url-tools-mcp"
Tools
Web pages and URLs
Email and identity diagnostics
Developer utilities
Hyperliquid perpetuals market data
Hyperliquid data comes from Hyperliquid's public market data. This server is not affiliated with Hyperliquid, and nothing it returns is financial advice.
Pricing
Pay per successful tool call through your Apify account: $0.001 for check and utility tools, $0.003 for page tools. Failed calls (invalid URL, blocked site, timeout) are free and return a clear error reason.
Good to know
- Pages are read from the HTML the server sends; sites that render everything in the browser return
little text and say so in a
warningfield. - Some sites block automated access; those calls return
target_blockedand are not charged. - Only public
http/httpsaddresses are fetched; private and internal addresses are refused.
This repository
This is the source of the Apify Actor that hosts the MCP server. It is a thin connector: each tool forwards the request to the Web Content API and returns the JSON result.
.actor/ Apify Actor definition (Standby mode, MCP path /mcp, pay-per-event pricing)
src/main.py MCP server (FastMCP, Streamable HTTP) and tool definitions
Dockerfile Container image
You do not need to run it yourself — connect to the hosted endpoint above.
License
MIT © Avalon Company