io.github.ryuamarines/robots-txt-checkerfinance

robots-txt-checker

Synced · awaiting check

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

Install

claude mcp add --transport http robots-txt-checker https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp

Our take

This server checks whether a URL path is allowed under a site's robots.txt rules. It serves crawler, SEO, and compliance-adjacent automation use cases, but the testnet USDC payment requirement is unusual for such a small utility and may limit practical adoption.

reviewed by hand · 2026-09-05

Something wrong or dead here? Report it

Verification record

last verified: 7 days ago
in registry since: 2026-09-02

More in finance

ccxt-mcpfinance

CCXT

Verified · 41 days ago

Official CCXT MCP server - Market data and trading across 100+ exchanges and prediction markets

hand-reviewed44k stars194 dl/wkchecked 41 days ago

basebalancefinance

basebalance.cloud — x402 RPC & MCP gateway

Verified · 42 days ago

USDC-gated Base JSON-RPC: free 10 req/min, $0.50 per 10k. Failover, cache, /mcp, ledger.

hand-reviewed6.1k starschecked 42 days ago

tradingview-mcpfinance

TradingMCP

Verified · 9 days ago

Market analysis for AI assistants: screeners, multi-timeframe analysis, backtests, in-chat charts.

hand-reviewed5.0k starschecked 9 days ago

mcp

Verified · today

MCP server integrating with Stripe - tools for customers, products, payments, and more.

hand-reviewed2.0k starschecked today

solana-mcp-vybefinance

Solana MCP by Vybe

Verified · 11 days ago

Solana MCP developer toolkit: wallets, trades, markets, PnL, transfers, onchain, swaps & API tools.

hand-reviewed1.7k starschecked 11 days ago

tradememory-protocolfinance

tradememory-protocol

Verified · 25 days ago

Tamper-evident decision audit trail and outcome-weighted memory for AI trading agents.

hand-reviewed1.4k starschecked 25 days ago