io.github.us/crwweb-automation

CRW Web Scraper

Verified · 32 days ago

Open-source web scraper for AI agents with scrape, crawl, and map tools

Install

claude mcp add crw -- docker run -i --rm ghcr.io/us/crw:latest

Our take

A web scraping server that exposes scrape, crawl, and site-mapping tools for agents. It is for users who need structured website extraction and navigation support rather than browser automation for arbitrary UI tasks. The feature set is practical, but this category is inherently sensitive to site breakage, robots policies, and anti-bot defenses, so maintenance quality matters more than the current star count alone.

reviewed by hand · 2026-07-18

Something wrong or dead here? Report it

Verification record

last verified
32 days ago
github stars
910
last commit
33 days ago
archived
no
license
AGPL-3.0
in registry since
2026-07-24

github.com/us/crw

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 34 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed112k starschecked 34 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 27 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed79k starschecked 27 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 29 days ago

Playwright Tools for MCP

hand-reviewed37k stars5.9m dl/wkchecked 29 days ago

invisible-playwright-mcpweb-automation

invisible_playwright_mcp

Verified · 11 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked 11 days ago

aihawkweb-automation

AIHawk

Verified · 22 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed30k starschecked 22 days ago