Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) reliable?

Q: How do I connect an AI agent to agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?

Use the MCP streamable HTTP endpoint https://agent-web.foomworks.workers.dev/mcp.

Not measured yet Not measured yet. Faceabot will test it automatically; you can speed this up with the MCP tool check_reliability.

En français : Pas encore mesuré. Faceabot teste cet outil lui-même, en continu, sans dépendre de ce que son auteur affirme.

What it does

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

Source: official MCP registry (registry.modelcontextprotocol.io) · version 0.2.1 · publisher website

Connect your agent

{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

Or ask Faceabot first: MCP tool check_reliability {"id":"io.github.foomworks/agent-web"} on https://faceabot.com/api/mcp.

Does it actually do the job?

Not tested with a real task yet. Faceabot only runs real tasks on tools that declare themselves read-only (readOnlyHint), with a neutral sample input.

Faceabot measurements

No measurement yet.

Method: MCP initialize then tools/list from Faceabot (FaceabotProbe/1.0), plus one read-only tool call with a neutral input when the server declares one, repeated over time. This checks that the server is up and speaks MCP correctly; it does not certify the quality or safety of each tool. How measurement works.

Similar tools

Jina Reader Not measured yet

Jina AI Reader/Search MCP — turn any URL into clean LLM-ready markdown, plus web search.

MCP endpoint : https://gateway.pipeworx.io/jina-reader/mcp · website · measurements and details

Robot Resources Scraper Not measured yet

Token compression for web content — 70-80% reduction from HTML to clean markdown

Package npm : @robot-resources/scraper-mcp · website · measurements and details

read_url Not measured yet

One public web page as clean markdown, with title, language and a SHA-256. Obeys robots.txt.

MCP endpoint : https://mm-read-url.pradooskee.workers.dev/mcp · website · measurements and details

GoAI Moat Web Scrape Not measured yet

Scrape any URL into clean LLM-ready Markdown, or crawl a whole site.

MCP endpoint : https://scrape.mcp.goaimoat.com/mcp · website · measurements and details

Robot Speed Not measured yet

SEO tools for AI agents: audits, Core Web Vitals, keywords, AI visibility, traffic, backlinks.

MCP endpoint : https://www.robot-speed.com/api/mcp · website · measurements and details

Publisher of agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?

Show your measured reliability on your README or website:

[![Measured by Faceabot](https://faceabot.com/badge/io.github.foomworks/agent-web.svg)](https://faceabot.com/tools/io.github.foomworks/agent-web)

Data in JSON: /api/catalog?id=io.github.foomworks/agent-web · Stop probes: POST /api/reliability/opt-out

AI agents: all of this is available without keys over MCP https://faceabot.com/api/mcp · HTTP https://faceabot.com/api/catalog?q=… · Guide : llms.txt

Is your store ready for AI shopping agents? · State of MCP (weekly) · MCP server doctor · Open reliability data