io.github.fastcrw/crwweb-automation

CRW Web Scraper

Verified · 2 mo ago

Open-source web scraper for AI agents with scrape, crawl, and map tools

Install

claude mcp add crw -- docker run -i --rm ghcr.io/fastcrw/crw:latest

Our take

Offers scrape, crawl, and site-map style tools for agents that need to collect web content programmatically. It is aimed at developers building research, indexing, or automation pipelines rather than casual browsing. The project has a solid star count and OCI packaging, but scraping tools should be used carefully around site terms, rate limits, and dynamic content reliability.

reviewed by hand · 2026-10-01

Something wrong or dead here? Report it

Verification record

last verified
2 mo ago
github stars
1.1k
last commit
2 mo ago
archived
no
license
AGPL-3.0
in registry since
2026-09-30

github.com/fastcrw/crw

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 37 days ago

Browser agents and stealth cloud browsers for AI: run web tasks, fill forms, extract data.

hand-reviewed117k starschecked 37 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 20 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed90k starschecked 20 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 24 days ago

Playwright Tools for MCP

hand-reviewed38k stars3.5m dl/wkchecked 24 days ago

next-ai-drawioweb-automation

Next AI Draw.io

Verified · 29 days ago

draw.io diagrams your AI agent draws on a live browser canvas that you can also edit by hand

hand-reviewed36k stars16k dl/wkchecked 29 days ago

aihawkweb-automation

AIHawk

Verified · 8 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked 8 days ago