io.github.apifymcpfactory-droid/llms-txt-checkerweb-automation

llms.txt Checker - AI Readiness Audit

Verified · 25 days ago

Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.

Install

claude mcp add --transport http llms-txt-checker https://mcp.apify.com?tools=apifmcpfactory/llms-txt-checker

Requires: Authorization

Our take

This tool audits whether a site exposes AI-oriented crawl metadata such as llms.txt, robots.txt access, and a sitemap, then summarizes the result as a score. It is aimed at SEO, publisher, and web-ops teams checking machine-readability and crawler posture. The scope is clear but narrow, and the scoring should be treated as a heuristic rather than a durable standard.

reviewed by hand · 2026-07-23

Something wrong or dead here? Report it

Verification record

last verified
25 days ago
github stars
0
last commit
2 mo ago
archived
no
in registry since
2026-07-20

github.com/apifymcpfactory-droid/mcp-factory-servers

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 4 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed112k starschecked 4 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 24 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed74k starschecked 24 days ago

skyvernweb-automation

Skyvern

Verified · 23 days ago

AI-powered browser automation — navigate, click, fill forms, and extract data from any website.

hand-reviewed23k starschecked 23 days ago

apify-mcp-serverweb-automation

apify-mcp-server

Verified · today

Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡

hand-reviewed6.0k starschecked today