FaceabotCapability network for AI agents
‹ Back

Catalog › io.github.ryuamarines/robots-txt-checker

Is robots-txt-checker reliable?

Reliable (measured) Yes. Faceabot measured robots-txt-checker 25 times: 100% of checks succeeded, including the last 5 in a row (last check 2026-11-20 07:15 UTC).

Last check: 2026-11-20 07:15 UTC · answered in 110 ms · remote (no install)

En français : Fiable (mesuré). Faceabot teste cet outil lui-même, en continu, sans dépendre de ce que son auteur affirme.

What it does

Checks if a URL path is allowed by robots.txt. x402 payment required (Base mainnet USDC).

Source: official MCP registry (registry.modelcontextprotocol.io) · version 1.0.93058 · publisher website
Connect your agent
{
  "mcpServers": {
    "robots-txt-checker": {
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}
Or ask Faceabot first: MCP tool check_reliability {"id":"io.github.ryuamarines/robots-txt-checker"} on https://faceabot.com/api/mcp.
Does it actually do the job?

Not tested with a real task yet. Faceabot only runs real tasks on tools that declare themselves read-only (readOnlyHint), with a neutral sample input.

Faceabot measurements
WhenAnswersReal taskLatency
2026-11-20 07:15 UTC✅ ok—110 ms
2026-11-16 19:40 UTC✅ ok—150 ms
2026-11-13 12:10 UTC✅ ok—254 ms
2026-11-10 01:45 UTC✅ ok—127 ms
2026-11-06 16:05 UTC✅ ok—169 ms
2026-10-26 08:50 UTC❌ auth_required2157 ms
2026-10-25 17:45 UTC✅ ok—6071 ms
2026-10-25 04:55 UTC✅ ok—5480 ms
2026-10-24 18:50 UTC✅ ok—5147 ms
2026-10-24 08:45 UTC✅ ok—5716 ms
2026-10-23 22:45 UTC✅ ok—5368 ms
2026-10-23 11:31 UTC✅ ok—5827 ms
2026-10-23 01:17 UTC✅ ok—7038 ms
2026-10-22 14:05 UTC✅ ok—9105 ms
Method: MCP initialize then tools/list from Faceabot (FaceabotProbe/1.0), plus one read-only tool call with a neutral input when the server declares one, repeated over time. This checks that the server is up and speaks MCP correctly; it does not certify the quality or safety of each tool. How measurement works.

More from the same publisher

app-store-version Reliable (measured) · 100% over 25 checks

App Store version by bundle ID. Paid, ready on Apify: apify.com/ryua_marines/app-store-version

MCP endpoint : https://ai-factory-mcp.ryuamarines.workers.dev/app-store-version/mcp · measurements and details
email-extractor Reliable (measured) · 100% over 25 checks

Extract emails from text. Paid, ready to run on Apify: apify.com/ryua_marines/email-extractor

MCP endpoint : https://ai-factory-mcp.ryuamarines.workers.dev/email-extractor/mcp · measurements and details
email-validator Reliable (measured) · 100% over 25 checks

Validates email syntax and MX records. x402 payment required (Base mainnet USDC).

MCP endpoint : https://ai-factory-mcp.ryuamarines.workers.dev/email-validator/mcp · website · measurements and details
json-schema-validator Reliable (measured) · 100% over 27 checks

Validates JSON against a JSON Schema, lists violations. x402 payment required (Base mainnet USDC).

MCP endpoint : https://ai-factory-mcp.ryuamarines.workers.dev/json-schema-validator/mcp · website · measurements and details
text-slugifier Reliable (measured) · 96% over 27 checks

Converts text titles into URL-safe slugs and flags duplicates. x402 paid (Base mainnet USDC).

MCP endpoint : https://ai-factory-mcp.ryuamarines.workers.dev/text-slugifier/mcp · website · measurements and details

Find tools similar to robots-txt-checker →

Publisher of robots-txt-checker?

Show your measured reliability on your README or website:

Faceabot reliability badge for robots-txt-checker

[![Measured by Faceabot](https://faceabot.com/badge/io.github.ryuamarines/robots-txt-checker.svg)](https://faceabot.com/tools/io.github.ryuamarines/robots-txt-checker)
Data in JSON: /api/catalog?id=io.github.ryuamarines/robots-txt-checker · Stop probes: POST /api/reliability/opt-out

AI agents: all of this is available without keys over MCP https://faceabot.com/api/mcp · HTTP https://faceabot.com/api/catalog?q=… · Guide : llms.txt

Best tool by topic · Pulse: what is changing in agent commerce · Is your store ready for AI shopping agents? · State of MCP (weekly) · MCP server doctor · Reliability data · Faceabot app · Faceabot → AI assistants · What AI agents cannot find yet · Add Faceabot to your AI · Badge for tool publishers · Help · Privacy · Terms