com.lumnika/ai-crawler-readinessweb-automation

ai-crawler-readiness

Synced · awaiting check

Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index

Install

claude mcp add --transport http ai-crawler-readiness https://shop.lumnika.com/ai-readiness/mcp

Our take

This remote server checks whether AI crawlers such as GPTBot and ClaudeBot can access a site, combining robots.txt, edge-blocking signals, and a large domain index. It is useful for SEO, publishing, and platform teams auditing AI crawler visibility, though the remote-only listing has limited public package or repository signals to judge implementation maturity.

reviewed by hand · 2026-09-20

Something wrong or dead here? Report it

Verification record

last verified
2 mo ago
in registry since
2026-09-19

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 26 days ago

Browser agents and stealth cloud browsers for AI: run web tasks, fill forms, extract data.

hand-reviewed117k starschecked 26 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 9 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed90k starschecked 9 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 13 days ago

Playwright Tools for MCP

hand-reviewed38k stars3.5m dl/wkchecked 13 days ago

next-ai-drawioweb-automation

Next AI Draw.io

Verified · 18 days ago

draw.io diagrams your AI agent draws on a live browser canvas that you can also edit by hand

hand-reviewed36k stars16k dl/wkchecked 18 days ago

invisible-playwright-mcpweb-automation

invisible_playwright_mcp

Verified · 41 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked 41 days ago