Google tells you what exists. Faceabot tells you what holds up.
Does a site publish llms.txt, robots permissions and a sitemap agents can use? Bounded check.
MCP endpoint :https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/llms-txt-readiness/mcp · website · measurements and detailsChecks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.
MCP endpoint :https://mcp.apify.com?tools=apifmcpfactory/llms-txt-checker · website · measurements and detailsGenerate 18 AI readiness files (llms.txt, ai.txt, RAG indexes, schema) for any website.
MCP endpoint :https://ai.silverbackmarketing.com/api/mcp · website · measurements and detailsBounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
MCP endpoint :https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-crawl-readiness/mcp · website · measurements and detailsAgent-readiness scanner (0-5 score), robots.txt + llms.txt generators, managed agent enablement.
MCP endpoint :https://mudko.com/api/mcp · website · measurements and detailsURL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key
MCP endpoint :https://agent-web.foomworks.workers.dev/mcp · website · measurements and detailsCheck whether a website is readable by AI agents: robots, llms.txt, sitemap, HTML. Bounded.
MCP endpoint :https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-ready-website-check/mcp · website · measurements and detailsAudit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
Package npm :crawl-readiness-mcp · website · measurements and detailsAudits any website for AI agent readiness and safety, scoring prompt injection risk and llms.txt.
Package npm :agent-readiness-auditor · website · measurements and detailsScan and fix your site's AI discoverability: crawler access, llms.txt, JSON-LD. Free.
MCP endpoint :https://ai-ready.magicteams.ai/mcp · website · measurements and detailsCheck website AI-readiness: Schema.org, llms.txt, E-E-A-T, robots.txt. Works in Cursor & Claude.
MCP endpoint :https://ai-readiness.mingles.ai/api/mcp/ · website · measurements and detailsAEO scoring, llms.txt audit, and agent-readiness checks for AI agents.
Package npm :@neverranked/mcp · website · measurements and detailsFree AI-readiness audit of any URL: AI crawler rules, JS-free text, JSON-LD, llms.txt. Tool catalog.
MCP endpoint :https://agentbuilt.dev/api/mcp · website · measurements and details7 free tools: MCP health scans, AI-readiness scores, llms.txt generator, glossary, indexes.
MCP endpoint :https://mcppulse.agiscorecard.com/mcp · website · measurements and detailsAEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.
Package npm :aeo-mcp · website · measurements and detailsInspect a site's AI-search readiness: AI crawler access, llms.txt, schema markup, meta directives
Package npm :geo-inspector-mcp · website · measurements and detailsAudit AI search readiness, generate llms.txt drafts, and build GEO/AEO prompt matrices for websites.
Package npm :mcp-server-ai-agent-search-optimization · measurements and detailsLocal-first MCP server for AI visibility, GEO/AEO, llms.txt, and AI crawler readiness audits.
Package npm :maxaeo-ai-visibility-mcp · website · measurements and detailsCreate, validate and audit llms.txt, incl. the Lighthouse Agentic Browsing check.
MCP endpoint :https://www.llms-txt-generator.de/api/mcp · website · measurements and details檢查網站 llms.txt 與 AI 爬蟲 robots.txt 設定，並自動產生 llms.txt。
MCP endpoint :https://llms-check.panda198271.workers.dev/mcp · website · measurements and detailsAI agents: all of this is available without keys over MCP https://faceabot.com/api/mcp · HTTP https://faceabot.com/api/catalog?q=… · Guide : llms.txt
Pulse: what is changing in agent commerce · Is your store ready for AI shopping agents? · State of MCP (weekly) · MCP server doctor · Open reliability data · Add Faceabot to your AI · Help · Privacy · Terms