Faceabot
‹ Back

Catalog › dev.workers.mike-tusa.robotsgate/robotsgate

Is RobotsGate reliable?

Reliable (measured) Yes. Faceabot measured RobotsGate 9 times: 100% of checks succeeded, including the last 9 in a row (last check 2026-10-19 20:30 UTC). It also does the job: its real read-only task worked 9 of 9 times.

Last check: 2026-10-19 20:30 UTC · answered in 6666 ms · remote (no install)

En français : Fiable (mesuré). Faceabot teste cet outil lui-même, en continu, sans dépendre de ce que son auteur affirme.

What it does

Generate, validate and check robots.txt rules for AI crawlers. Free; optional Pro key.

Source: official MCP registry (registry.modelcontextprotocol.io) · version 0.3.1 · publisher website
Connect your agent
{
  "mcpServers": {
    "robotsgate": {
      "url": "https://robotsgate.mike-tusa.workers.dev/mcp"
    }
  }
}
Or ask Faceabot first: MCP tool check_reliability {"id":"dev.workers.mike-tusa.robotsgate/robotsgate"} on https://faceabot.com/api/mcp.
Does it actually do the job?

Does the job (tested) — Faceabot asked list_crawlers to do a small read-only task 9 time(s): 9 returned a real result, the last 9 in a row. Last result: ok in 2736 ms.

Sample input: {}. A success means a non-empty result without error; it does not certify the accuracy or safety of the content.
Other proven tools for the same job

Robots.txt & AI Crawler Checker Reliable (measured) · 100%
robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check. · https://robots-check.quietworklabs.workers.dev/mcp

Page Fetch Reliable (measured) · 100%
Read one public web page as clean Markdown with its links, after a robots.txt check. · https://pagefetch.openkrill.app/mcp

Agent Ready Website Check Reliable (measured) · 100%
Check whether a website is readable by AI agents: robots, llms.txt, sitemap, HTML. Bounded. · https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-ready-website-check/mcp

Picked from Faceabot's live measurements. Or let Faceabot choose: GET https://faceabot.com/resolve?need=…
Faceabot measurements
WhenAnswersReal taskLatency
2026-10-19 20:30 UTC✅ ok✅ done6666 ms
2026-10-19 07:30 UTC✅ ok✅ done6085 ms
2026-10-18 14:55 UTC✅ ok✅ done5779 ms
2026-10-18 04:25 UTC✅ ok✅ done4768 ms
2026-10-17 20:25 UTC✅ ok✅ done4515 ms
2026-10-17 12:00 UTC✅ ok✅ done6588 ms
2026-10-17 04:20 UTC✅ ok✅ done6269 ms
2026-10-16 20:40 UTC✅ ok✅ done4968 ms
2026-10-16 13:31 UTC✅ ok✅ done8992 ms
Method: MCP initialize then tools/list from Faceabot (FaceabotProbe/1.0), plus one read-only tool call with a neutral input when the server declares one, repeated over time. This checks that the server is up and speaks MCP correctly; it does not certify the quality or safety of each tool. How measurement works.

Find tools similar to RobotsGate →

Publisher of RobotsGate?

Show your measured reliability on your README or website:

Faceabot reliability badge for RobotsGate

[![Measured by Faceabot](https://faceabot.com/badge/dev.workers.mike-tusa.robotsgate/robotsgate.svg)](https://faceabot.com/tools/dev.workers.mike-tusa.robotsgate/robotsgate)
Data in JSON: /api/catalog?id=dev.workers.mike-tusa.robotsgate/robotsgate · Stop probes: POST /api/reliability/opt-out

AI agents: all of this is available without keys over MCP https://faceabot.com/api/mcp · HTTP https://faceabot.com/api/catalog?q=… · Guide : llms.txt

Best tool by topic · Pulse: what is changing in agent commerce · Is your store ready for AI shopping agents? · State of MCP (weekly) · MCP server doctor · Reliability data · Faceabot app · Faceabot → AI assistants · What AI agents cannot find yet · Add Faceabot to your AI · Badge for tool publishers · Help · Privacy · Terms