com.thenextgennexus/web-scraping-mcp-serverweb-automation

web-scraping-mcp-server

Synced · awaiting check

Website crawling, Google search and Wikipedia lookup as agent tools.

Install

claude mcp add --transport http web-scraping-mcp-server https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp

Requires: Authorization

Our take

This server handles generic URL crawling and HTML extraction as a fallback when no dedicated integration exists. It is for users who need broad web ingestion from assistant tools and can tolerate the variability that comes with scraping. The capability is useful, but this category carries normal fragility and compliance risk because site structures and access policies change frequently.

reviewed by hand · 2026-08-11

Something wrong or dead here? Report it

Verification record

last verified
33 days ago
in registry since
2026-04-26
browser-useweb-automation

browser-use

Verified · 42 days ago

Browser agents and stealth cloud browsers for AI: run web tasks, fill forms, extract data.

hand-reviewed117k starschecked 42 days ago

Scrapling MCP Server

Verified · 25 days ago

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

hand-reviewed90k starschecked 25 days ago

playwright-mcpweb-automation

playwright-mcp

Verified · 29 days ago

Playwright Tools for MCP

hand-reviewed38k stars3.5m dl/wkchecked 29 days ago

next-ai-drawioweb-automation

Next AI Draw.io

Verified · 34 days ago

draw.io diagrams your AI agent draws on a live browser canvas that you can also edit by hand

hand-reviewed36k stars16k dl/wkchecked 34 days ago

AIHawk

Verified · 13 days ago

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

hand-reviewed32k starschecked 13 days ago