io.github.sadri-dridi/agent-crawl-readinessweb-automation

Agent Crawl Readiness

Verified · today

Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.

Install

claude mcp add --transport http agent-crawl-readiness https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-crawl-readiness/mcp

Our take

Not yet reviewed. This entry is synced and verified automatically but hasn't had an editorial pass yet. The data above is real; the judgment is yours for now.

Something wrong or dead here? Report it

Verification record

last verified
today
github stars
0
last commit
today
archived
no
in registry since
2026-09-23

github.com/sadri-dridi/named-mcp-utilities

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 23 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed112k starschecked 23 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 16 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed79k starschecked 16 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 18 days ago

Playwright Tools for MCP

hand-reviewed37k stars5.9m dl/wkchecked 18 days ago

invisible-playwright-mcpweb-automation

invisible_playwright_mcp

Verified · today

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked today

aihawkweb-automation

AIHawk

Verified · 11 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed30k starschecked 11 days ago