Google tells you what exists. Faceabot tells you what holds up.
Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.
MCP endpoint :https://mcp.apify.com?tools=apifmcpfactory/llms-txt-checker · website · measurements and detailsDoes a site publish llms.txt, robots permissions and a sitemap agents can use? Bounded check.
MCP endpoint :https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/llms-txt-readiness/mcp · website · measurements and detailsCreate, validate and audit llms.txt, incl. the Lighthouse Agentic Browsing check.
MCP endpoint :https://www.llms-txt-generator.de/api/mcp · website · measurements and detailsGenerate 18 AI readiness files (llms.txt, ai.txt, RAG indexes, schema) for any website.
MCP endpoint :https://ai.silverbackmarketing.com/api/mcp · website · measurements and detailsBounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
MCP endpoint :https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-crawl-readiness/mcp · website · measurements and detailsAudit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
Package npm :crawl-readiness-mcp · website · measurements and detailsAgent-readiness scanner (0-5 score), robots.txt + llms.txt generators, managed agent enablement.
MCP endpoint :https://mudko.com/api/mcp · website · measurements and details檢查網站 llms.txt 與 AI 爬蟲 robots.txt 設定，並自動產生 llms.txt。
MCP endpoint :https://llms-check.panda198271.workers.dev/mcp · website · measurements and detailsllms.txt 檢查工具：檢查網站的 llms.txt、robots 與 sitemap。台灣繁體中文 MCP 工具。
MCP endpoint :https://llms.penguindriver.com/mcp · website · measurements and detailsAudits any website for AI agent readiness and safety, scoring prompt injection risk and llms.txt.
Package npm :agent-readiness-auditor · website · measurements and detailsAny site's llms.txt: find the covering index, read its linked docs as markdown, search sections.
MCP endpoint :https://llmstxtmcp.dev/mcp · website · measurements and detailsAEO scoring, llms.txt audit, and agent-readiness checks for AI agents.
Package npm :@neverranked/mcp · website · measurements and detailsURL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key
MCP endpoint :https://agent-web.foomworks.workers.dev/mcp · website · measurements and detailsAI visibility checker: GPTBot vs OAI-SearchBot, robots.txt audit, raw-HTML schema. 165 crawlers.
Package mcpb :https://github.com/krisdiallo/ecom-agent/releases/download/v1.5.3/aivis.mcpb · website · measurements and detailsBuild llms.txt from local Markdown or a sitemap.xml and check an existing llms.txt file.
Package oci :ghcr.io/basitalisandhu/mcp-llms-txt:0.1.1 · website · measurements and detailsSix checks: llms.txt, llms-full.txt, .md twins, Accept: text/markdown, sitemap.md, alt link. Free.
MCP endpoint :https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/markdown · website · measurements and detailsFree AI-readiness audit of any URL: AI crawler rules, JS-free text, JSON-LD, llms.txt. Tool catalog.
MCP endpoint :https://agentbuilt.dev/api/mcp · website · measurements and detailsAEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.
Package npm :aeo-mcp · website · measurements and detailsChecks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
MCP endpoint :https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp · measurements and detailsCheck whether a website is readable by AI agents: robots, llms.txt, sitemap, HTML. Bounded.
MCP endpoint :https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-ready-website-check/mcp · website · measurements and detailsAI agents: all of this is available without keys over MCP https://faceabot.com/api/mcp · HTTP https://faceabot.com/api/catalog?q=… · Guide : llms.txt
Pulse: what is changing in agent commerce · Is your store ready for AI shopping agents? · State of MCP (weekly) · MCP server doctor · Open reliability data · Add Faceabot to your AI · Help · Privacy · Terms