Ready for AI agents

Play this lesson

An AI that clicks for you

An answer engine reads pages and writes an answer. An AI agent goes further: it opens websites, clicks links, fills in forms and compares options to finish a job for a person, like "find three space shooters that work offline and put the best one in my basket". Claude can do this in the Chrome browser, and other AI companies make agents too.

Agents want plain text instead of fancy layouts, files at standard addresses, and clear rules about what they may do. A site that offers those is agent-ready.

Is It Agent Ready?

isitagentready.com is a free scanner made by Cloudflare, launched in April 2026. Type in a website address and it fetches the home page plus a set of well-known addresses, standard places like /robots.txt or /.well-known/... where agents expect to find files.

Its own guide counts 22 checks in five categories: Discoverability, Content Accessibility, Bot Access Control, API / Auth / MCP, and Commerce. Each check shows pass or fail with evidence, plus fix instructions you can paste into a coding agent. Cloudflare modelled it on Google's Lighthouse, which scores pages for speed and best practices.

Six levels, 0 to 5

The scan gives one overall level. Each level needs everything below it:

Commerce checks are reported but don't count toward the level yet.

Quick check

The Hyper Shards site has a robots.txt and a sitemap, but robots.txt has no AI bot rules or Content Signals. Which level does it get?

  1. Level 1, Basic Web Presence
  2. Level 2, Bot-Aware
  3. Level 0, Not Ready
  4. Level 5, Agent-Native
Show the answer

Level 1, Basic Web Presence

Two of the three basics (robots.txt, sitemap, Link headers) reach level 1. Level 2 also needs AI bot rules and Content Signals in robots.txt.

Discoverability: can agents find things?

The first category has four checks. Here is what each one looks for, and how our studio site handles it.

Content and bot rules

The next two categories cover how agents read our pages and what they may do with them. A token is a small chunk of text an AI reads, and every token costs time and money.

Read the signal

robots.txt
User-agent: *Content-Signal: search=yes, ai-input=yes, ai-train=noAllow: / Sitemap: https://ourstudio.com/sitemap.xml

What does line 2 ask AI companies to do with our pages?

  1. Use them for search and to answer people's questions, but not to train AI models
  2. Never show them in any search engine or assistant
  3. Pay the studio before reading any page
  4. Train models on them, but never link back to us
Show the answer

Use them for search and to answer people's questions, but not to train AI models

search=yes allows search, ai-input=yes allows using pages in AI answers, and ai-train=no asks companies not to train on them. Like the rest of robots.txt, it states our wishes. It is not a lock against badly behaved bots.

API, Auth and MCP: can agents use our tools?

Nine checks are for sites that offer tools or accounts, not just pages. Many use MCP (Model Context Protocol), an open standard for connecting AI apps to tools. Most checks look for a JSON file at a well-known address.

Our static game site has no API or player accounts for agents yet, so these can wait. A first step toward level 4 could be an Agent Skills index.

Read the scan

scan-hyper-shards.txt
Level 1: Basic Web Presence robots.txt              passSitemap                 passLink headers            failAI bot rules            failContent Signals         failMarkdown negotiation    failMCP Server Card         fail

This is a scan of the Hyper Shards site. Which fix takes it to level 2, Bot-Aware?

  1. Add AI bot rules and a Content-Signal line to robots.txt
  2. Build an MCP server with a server card
  3. Turn on Markdown negotiation, and nothing else
  4. Add Link headers, and nothing else
Show the answer

Add AI bot rules and a Content-Signal line to robots.txt

Level 2 needs level 1 plus both AI bot rules and Content Signals, and both live in robots.txt, so it's a small text edit. Markdown negotiation is the level 3 step, and an MCP Server Card belongs to level 4.

Commerce, and who stays in charge

The last category looks for new ways agents can pay: x402 (built on the web's 402 "Payment Required" status code), MPP (Machine Payment Protocol), UCP (Universal Commerce Protocol) and ACP (Agentic Commerce Protocol). These checks don't count toward the level yet, and the standards are young.

Hyper Shards takes payments through Stripe, on an account a parent owns. Letting agents buy for people is a business decision for a parent, not a quick setting. A score is a guide, not a grade: fix the easy, useful checks first.

Bolt says: The scanner's own advice: start with robots.txt, AI bot rules and a sitemap. Then take on the stage boss!

Fact-checked 9 October 2026