AI Search Optimization: SEO for AI Overviews & Answer EnginesAgentic search and what's next · Lesson 17 of 17

Agents, agentic browsing and the agent-ready web

Article · 15 min · 8 min lecture

Video lecture

Agents, agentic browsing and the agent-ready web

12 chapters · about 8 min · full transcript

Coming soon

Chapter 1 of 12

Agents and the agent-ready web

  • From answers to actions
  • What exists vs what's outlook
  • Practical readiness steps

The narrated lecture is in production

Every chapter is scripted and ready. Browse the chapters and read the full transcript now — the video will appear here when it’s published.

Chapters

From answers to actions

The first wave of AI search answers questions. The next wave acts: AI agents browse sites, compare options, fill forms and — increasingly — complete purchases on a user's behalf. This is already visible in 2026: AI browsers and assistant "agent" modes, Google's Google-Agent user-triggered fetcher (added to its crawler documentation in March 2026 for agents running on Google infrastructure), OpenAI's Instant Checkout in ChatGPT built on the Agentic Commerce Protocol co-developed with Stripe, and the WebMCP proposal. This lesson separates what exists from what is outlook, and gives you practical steps that pay off either way.

What exists today (verify details before relying on them)

DevelopmentStatus (at time of writing)Why it matters
User-triggered agent fetchers (e.g. Google-Agent, ChatGPT-User, Claude-User, Perplexity-User)Live; policies on robots.txt differ by providerAgents visit your pages to evaluate and act for a specific user
Agentic Commerce Protocol (OpenAI + Stripe) and product feedsLive for eligible merchants in supported countriesDiscovery and checkout can happen inside the assistant
WebMCPW3C draft (February 2026); Chrome early preview and origin trial; co-developed by Google and MicrosoftLets sites expose named actions (JS functions, forms) to in-browser agents instead of agents guessing from the DOM
Signed agent requests (e.g. HTTP Message Signatures / "Web Bot Auth" proposals)Emerging; adopted by some providers and CDNsLets you verify an agent cryptographically rather than by user agent string

What the agent-ready web needs from you

Agents are demanding users: they can't guess, they don't enjoy your animations, and they fail on ambiguous forms. Most "agent readiness" is excellent accessibility and clean engineering:

  1. Semantic, accessible HTML. Real button, a, label, form elements; accessible names; logical headings. Agents that use the accessibility tree benefit from the same work that helps screen-reader users (and meets WCAG obligations).
  2. Stable, predictable flows. Clear product options, visible prices including taxes and shipping, explicit stock status, no dark patterns. An agent that can't confirm the total price won't recommend buying.
  3. Machine-readable facts. Accurate JSON-LD and feeds (Lesson 2.3), consistent across surfaces.
  4. Bot management that recognises agents. Decide which user-triggered agents you allow on which paths; don't let a CAPTCHA wall silently block legitimate assistant visits to public product pages — but keep strong protection on login, checkout and account actions.
  5. Clear policies. Returns, delivery times and eligibility stated in text, because agents quote them back to users.

Hands-on: an agent-readiness spot check

Pick 3 key journeys (e.g. "find a product in size M and see delivered price to Dubai").
For each journey:
[ ] Every step reachable with keyboard only (Tab/Enter) — proxy for agent operability
[ ] Every control has an accessible name (Chrome DevTools > Accessibility pane)
[ ] Price, tax, shipping and stock visible as text before checkout
[ ] No step requires hover-only menus or drag gestures
[ ] Error messages are text next to the field, not colour alone
[ ] Logs show user-triggered agent hits on these URLs return 200 (Lesson 4.3)

Run Lighthouse's accessibility audit on each step as a quick baseline, then fix the failures that also block agents.

A simple WebMCP-style mental model (outlook)

WebMCP proposes that a page can register tools an in-browser agent can call — for example searchProducts({query, size}) or getDeliveredPrice({sku, country}) — with described inputs and outputs, instead of the agent clicking around. The API is still evolving in the W3C process, so don't ship production code from blog posts. What you can do now is identify your site's three to five most important actions and make sure each already exists as a clean, well-labelled form or function with server-side validation. When the standard settles, exposing them will be straightforward.

Worked example: a Lahore homeware brand prepares

A Lahore homeware exporter (illustrative) selling to the UK and UAE runs the spot check. Findings: the size selector is a custom div without accessible names; delivered price to Dubai appears only in the basket; returns policy is an image. Fixes: native form controls with labels, a delivered-price estimator on product pages, and a text returns policy. The same changes improve conversion and accessibility today, and make the site easier for assistants and agents to use tomorrow.

Outlook, clearly labelled

These are reasoned expectations, not predictions stated as fact: more discovery and comparison will happen inside assistants; checkout inside assistants will expand country by country; verification of agents will move from user-agent strings to signatures; and sites with clean data, accessible flows and clear policies will be easier for agents to recommend. Revisit this lesson's table every quarter.

Common mistakes

  • Treating "agent SEO" as a new trick rather than accessibility, data quality and clear policies.
  • Blocking all automated traffic with CAPTCHAs on public pages, then wondering why assistants can't answer questions about your products.
  • Shipping experimental APIs to production without following the standard's status.

Key takeaways

  • AI agents increasingly act — browsing, comparing, filling forms and buying — not just answering.
  • Live today: user-triggered agent fetchers (including Google-Agent) and checkout inside ChatGPT via the Agentic Commerce Protocol for eligible merchants.
  • WebMCP is a W3C draft (Feb 2026) with a Chrome preview; follow the standard's status before shipping.
  • Agent readiness is mostly accessibility, consistent machine-readable data, clear text policies and agent-aware bot management.
  • Keep outlook separate from fact and review the status of these developments quarterly.

Check your understanding

Quick questions to lock in the lesson. They don’t count towards your certificate.

  1. Which work most improves a site's readiness for AI agents today?
  2. What is WebMCP, as of 2026?
  3. Your site shows a CAPTCHA to every automated visitor, including on public product pages. What's the risk?

Put it into practice

Run the agent-readiness spot check on your most important journey using only the keyboard, and fix the first blocker you find.

Enrol for free to save your progress

Reading is always free. Enrol to keep your place, take the final assessment and earn a verifiable certificate.