io.github.foomworks/agent-webweb-automation

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)

Verified · 32 days ago

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

Install

claude mcp add --transport http agent-web https://agent-web.foomworks.workers.dev/mcp

Our take

A web-reading utility that converts pages into cleaner markdown while explicitly respecting robots.txt. It is for agents or automations that need lightweight, polite page ingestion without standing up a full browser stack. The use case is straightforward and credible, but with no visible adoption yet it looks more like a focused utility than a broadly battle-tested web tool.

reviewed by hand · 2026-07-24

Something wrong or dead here? Report it

Verification record

last verified
32 days ago
github stars
0
last commit
3 mo ago
archived
no
license
MIT
in registry since
2026-06-23

github.com/foomworks/agent-web

More in web-automation

browse all →
browser-useweb-automation

browser-use

Verified · 33 days ago

Control a real Chrome browser to complete any task: fill forms, extract data, book flights.

hand-reviewed112k starschecked 33 days ago

Scraplingweb-automation

Scrapling MCP Server

Verified · 26 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed79k starschecked 26 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 28 days ago

Playwright Tools for MCP

hand-reviewed37k stars5.9m dl/wkchecked 28 days ago

invisible-playwright-mcpweb-automation

invisible_playwright_mcp

Verified · 10 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked 10 days ago

aihawkweb-automation

AIHawk

Verified · 21 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed30k starschecked 21 days ago