The real catalog of tools for AI agents

Evaluate a+b style arithmetic. Expression discarded.

LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.

Regression checks for Japanese order automations: six free cases, strict JSON scoring and CI gates.

Cloudflare Workers MCP server: ai-eval

Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.

Rights-aware censorship, China-economic status, and tamper-evident AI evaluation tools.

Chipp: conversations, messages, usage and engagement analytics, end users and their memories, and.

Web search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts.

Evaluate one public URL for WebMCP readiness: intent, tools observed, recommended, do-not-expose.

Run a golden set and gate LLM model swaps on accuracy, with latency and cost per request.

Stockfish chess eval: best move, score, principal variation, multipv. $0.005/call via x402.

Zero-dependency AST safe mathematical and boolean expression evaluator and validator

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

Remote MCP for Gemini upgrade evals, prompt regressions, output diffs, and eval receipts.

Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.

Wraps the slop-eval CLI as a single generic MCP tool for genericness scoring of AI UI output.

Chipp: a deployed project's database (read), logs, errors, analytics, CI status, custom actions.

A standardized testing harness for MCP servers and agent workflows

Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.