io.github.amati032-dev/crawlbitweb-automation

crawlbit

Verified · today

Four free tools to check if AI engines can find, read and recognise a site. No API key.

Install

claude mcp add crawlbit -- npx -y [email protected]

Requires: CRAWLBIT_BASE_URL

Our take

Provides a small set of site-checking tools aimed at seeing whether AI crawlers or agents can discover and interpret a website without requiring an API key. It is most useful for SEO, publishing, or developer workflows that care about AI visibility more than general-purpose crawling. The scope is narrow and the project shows little external adoption from the metadata here, so it reads as a lightweight utility rather than a broadly proven platform.

reviewed by hand · 2026-08-15

Something wrong or dead here? Report it

Verification record

last verified
today
github stars
0
last commit
today
archived
no
license
MIT
npm
crawlbit-mcp
latest version
1.0.1
in registry since
2026-08-14

github.com/amati032-dev/crawlbit-mcp

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 9 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed108k starschecked 9 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 3 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed74k starschecked 3 days ago

skyvernweb-automation

Skyvern

Verified · 2 days ago

AI-powered browser automation — navigate, click, fill forms, and extract data from any website.

hand-reviewed23k starschecked 2 days ago

apify-mcp-serverweb-automation

apify-mcp-server

Verified · 6 days ago

Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡

hand-reviewed3.0k starschecked 6 days ago