dev.workers.pathwren.www/ai-crawler-indexweb-automation

AI Crawler Index

Synced · awaiting check

{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

Install

claude mcp add --transport http ai-crawler-index https://www.pathwren.workers.dev/c/mcp-registry-official/mcp

Our take

AI Crawler Index is a web-operations tool for identifying AI crawlers by user agent or IP, checking claimed ranges, and helping generate robots.txt rules. It is for site operators, infrastructure teams, or compliance-minded publishers rather than general developers. The function is concrete and plausible, but it is a narrow operational utility and the available metadata does not show broader maturity.

reviewed by hand · 2026-09-01

Something wrong or dead here? Report it

Verification record

last verified
8 days ago
in registry since
2026-09-01

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 7 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed117k starschecked 7 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 38 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed79k starschecked 38 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 40 days ago

Playwright Tools for MCP

hand-reviewed37k stars5.9m dl/wkchecked 40 days ago

invisible-playwright-mcpweb-automation

invisible_playwright_mcp

Verified · 22 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked 22 days ago

aihawkweb-automation

AIHawk

Verified · 33 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed30k starschecked 33 days ago