io.github.DevsHero/ShadowCrawlweb-automation

ShadowCrawl

Verified · 27 days ago

Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.

Our take

A single Rust binary combining web search, extraction, crawling, deep research, and stateful browser automation, with progressive fallbacks from native fetch through Chromium rendering to human-in-the-loop for CAPTCHAs. Its distinctive move is packaging Playwright-scale browser control into one steps-array omni-tool, cutting the turn count for multi-step flows. Note the registry still carries the old ShadowCrawl name — the project rebranded to CortexScout under the cortex-works org — and the 'Playwright killer' framing outruns what a small, young project has proven. For self-hosters who want token-efficient scraping and automation in one binary.

reviewed by hand · 2026-07-05

Something wrong or dead here? Report it

Verification record

last verified
27 days ago
github stars
71
last commit
4 mo ago
archived
no
license
MIT
in registry since
2026-02-18

github.com/DevsHero/ShadowCrawl

browser-useweb-automation

browser-use

Verified · 34 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed112k starschecked 34 days ago

Scrapling MCP Server

Verified · 27 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed79k starschecked 27 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 29 days ago

Playwright Tools for MCP

hand-reviewed37k stars5.9m dl/wkchecked 29 days ago

invisible-playwright-mcpweb-automation

invisible_playwright_mcp

Verified · 11 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked 11 days ago

AIHawk

Verified · 22 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed30k starschecked 22 days ago