io.github.DevsHero/shadow-crawlweb-automation

ShadowCrawl

Verified · 8 days ago

Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.

Install

claude mcp add --transport http shadow-crawl https://shadowcrawl--devshero.run.tools

Our take

Self-hosted Rust binary for web search, extraction, and stateful browser automation with explicit anti-bot bypass (CDP rendering, proxy rotation, human-in-the-loop CAPTCHA solving). Technically substantial and honestly documented, but its headline capability — defeating Cloudflare/DataDome and scraping auth-walled sites — violates most target sites' ToS, so treat it as a liability decision, not just a tool choice. Note the project has been rebranded to CortexScout (repo renamed cortex-scout) and last push was ~a month ago. For self-hosters doing research scraping who accept the legal exposure.

reviewed by hand · 2026-07-05

Something wrong or dead here? Report it

Verification record

last verified
8 days ago
github stars
69
last commit
2 mo ago
archived
no
license
MIT
in registry since
2026-02-14

github.com/DevsHero/ShadowCrawl

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 14 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed108k starschecked 14 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 8 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed74k starschecked 8 days ago

skyvernweb-automation

Skyvern

Verified · 7 days ago

AI-powered browser automation — navigate, click, fill forms, and extract data from any website.

hand-reviewed23k starschecked 7 days ago

apify-mcp-serverweb-automation

apify-mcp-server

Verified · 11 days ago

Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡

hand-reviewed3.0k starschecked 11 days ago