io.github.xberg-io/crawlbergweb-automation

Crawlberg

Verified · 15 days ago

Scrape, crawl, and map websites to Markdown or JSON via local CLI.

Install

claude mcp add crawlberg -- docker run -i --rm ghcr.io/xberg-io/crawlberg:1.2.1

Our take

Crawlberg is a local CLI-based website crawler that turns pages into Markdown or JSON for downstream AI use. It is for developers and data-ingestion workflows that need structured web capture without relying on a hosted scraping platform. The scope is practical and understandable, and local execution is a plus for control, though long-term quality will depend on how well it keeps up with modern site anti-bot and rendering behavior.

reviewed by hand · 2026-07-16

Something wrong or dead here? Report it

Verification record

last verified
15 days ago
github stars
151
last commit
16 days ago
archived
no
license
MIT
in registry since
2026-07-26

github.com/xberg-io/crawlberg

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 15 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed108k starschecked 15 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 9 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed74k starschecked 9 days ago

skyvernweb-automation

Skyvern

Verified · 8 days ago

AI-powered browser automation — navigate, click, fill forms, and extract data from any website.

hand-reviewed23k starschecked 8 days ago

apify-mcp-serverweb-automation

apify-mcp-server

Verified · 12 days ago

Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡

hand-reviewed3.0k starschecked 12 days ago