io.github.us/crwweb-automation

CRW Web Scraper

Verified · 13 days ago

Open-source web scraper for AI agents with scrape, crawl, and map tools

Install

claude mcp add crw -- docker run -i --rm ghcr.io/us/crw:latest

Our take

A web scraping server that exposes scrape, crawl, and site-mapping tools for agents. It is for users who need structured website extraction and navigation support rather than browser automation for arbitrary UI tasks. The feature set is practical, but this category is inherently sensitive to site breakage, robots policies, and anti-bot defenses, so maintenance quality matters more than the current star count alone.

reviewed by hand · 2026-07-18

Something wrong or dead here? Report it

Verification record

last verified
13 days ago
github stars
531
last commit
14 days ago
archived
no
license
AGPL-3.0
in registry since
2026-07-24

github.com/us/crw

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 14 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed108k starschecked 14 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 8 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed74k starschecked 8 days ago

skyvernweb-automation

Skyvern

Verified · 7 days ago

AI-powered browser automation — navigate, click, fill forms, and extract data from any website.

hand-reviewed23k starschecked 7 days ago

apify-mcp-serverweb-automation

apify-mcp-server

Verified · 11 days ago

Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡

hand-reviewed3.0k starschecked 11 days ago