io.github.xberg-io/crawlbergweb-automation

Crawlberg

Verified · 44 days ago

Scrape, crawl, and map websites to Markdown or JSON via local CLI.

Install

claude mcp add crawlberg -- docker run -i --rm ghcr.io/xberg-io/crawlberg:1.12.3

Our take

Crawlberg is a local CLI-based website crawler that turns pages into Markdown or JSON for downstream AI use. It is for developers and data-ingestion workflows that need structured web capture without relying on a hosted scraping platform. The scope is practical and understandable, and local execution is a plus for control, though long-term quality will depend on how well it keeps up with modern site anti-bot and rendering behavior.

reviewed by hand · 2026-07-16

Something wrong or dead here? Report it

Verification record

last verified
44 days ago
github stars
182
last commit
44 days ago
archived
no
license
MIT
in registry since
2026-07-26

github.com/xberg-io/crawlberg

browser-useweb-automation

browser-use

Verified · 42 days ago

Browser agents and stealth cloud browsers for AI: run web tasks, fill forms, extract data.

hand-reviewed117k starschecked 42 days ago

Scrapling MCP Server

Verified · 25 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed90k starschecked 25 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 29 days ago

Playwright Tools for MCP

hand-reviewed38k stars3.5m dl/wkchecked 29 days ago

next-ai-drawioweb-automation

Next AI Draw.io

Verified · 34 days ago

draw.io diagrams your AI agent draws on a live browser canvas that you can also edit by hand

hand-reviewed36k stars16k dl/wkchecked 34 days ago

AIHawk

Verified · 13 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked 13 days ago