Tools / AI crawlers & agents

Is your site ready for AI agents?

Agents look for machine-friendly ways in before they scrape HTML. See which of the new standards your site already supports.

Free, no signup.

Example result: vercel.com · checked 2026-09-30

Agent entry points on vercel.com

Markdown for agents✓ served for Accept: text/markdown
MCP server card— not found
API catalog (RFC 9727)✓ found at /.well-known/api-catalog
OpenAPI spec— not found
A2A agent card— not found
Content Signals in robots.txt✓ declared

Why it matters

Agents act for users

ChatGPT agent mode and similar tools browse, compare and buy for people. They prefer sites they can read and call directly.

Markdown saves tokens

Cloudflare and Vercel serve markdown to agents that ask for it. It’s the cheapest agent upgrade to ship.

Early is cheap

Fewer than 15 sites had an MCP server card or API catalog in Cloudflare’s 2026 scan. Anything you add puts you ahead.

What it checks

01

Markdown for agents

Whether you answer Accept: text/markdown, or publish /index.md.

02

MCP server card

An MCP manifest under /.well-known, so agents can find your tools.

03

API catalog

RFC 9727 /.well-known/api-catalog, plus /openapi.json.

04

A2A agent card

/.well-known/agent-card.json for agent-to-agent protocols.

05

Commerce and signed agents

UCP for agent checkout, and Web Bot Auth keys for verifying signed agents.

06

Content Signals

The search=, ai-input= and ai-train= preferences in robots.txt.

How it works

1

Enter a URL

A domain or page address. No install, nothing to add to your site.

2

We fetch it live

Our servers request the page read-only, the way a crawler would.

3

Read and fix

Get the results in seconds, with what each one means.

Questions

Check everything at once

The site audit checks your whole site and scores SEO, AI Search and Agent Readiness in about 30 seconds.

Audit my site