The Agentic Web Readiness Index 2027: Is Your Website Ready for AI Agents?
Measure whether your website is ready for AI agents with DN’s 100-point index covering discovery, structured data, actions, permissions, payments and trust.
The Agentic Web Readiness Index 2027
Most websites are readable by browsers but unreliable for agents. DN introduces a 100-point system for measuring whether a site can be discovered, understood, trusted and used safely by autonomous software.
What Matters
Agent readiness is not the same as SEO. Search engines mainly need to crawl, interpret and rank information. An AI agent may also need to compare an offer, understand terms, authenticate, request permission, execute an action, pay and recover from failure. A website becomes agent-ready only when machine understanding is paired with bounded, auditable action.
The Web Has a Machine-Action Gap
The human web communicates through pages, menus, buttons and visual context. Agents need explicit entities, stable identifiers, declared capabilities, predictable inputs, permission boundaries and machine-readable outcomes. A beautifully designed website can be nearly unusable to an agent. An unremarkable site with structured content and a dependable API may be far more valuable in the agentic economy.
The Seven-Layer DN Agentic Web Model
| Layer | Weight | What DN measures | Failure signal |
|---|---|---|---|
| 1. Discovery | 10 | Crawlability, sitemap, canonical URLs, stable navigation and declared machine resources | Important content is hidden, duplicated or inconsistently addressed |
| 2. Semantic clarity | 20 | Accurate JSON-LD, explicit entities, prices, availability, dates, authorship and policies | The agent must infer commercial facts from layout or prose |
| 3. Action interfaces | 20 | Documented APIs, structured forms, action entry points, MCP tools or equivalent interfaces | Only brittle visual clicking can complete a task |
| 4. Permission and identity | 15 | Authentication, scopes, consent, least privilege, delegated authority and revocation | Access is all-or-nothing or authority cannot be proven |
| 5. Transaction readiness | 15 | Machine-readable totals, payment options, confirmation, receipts, refunds and idempotency | Costs change silently or repeated requests duplicate a purchase |
| 6. Reliability and recovery | 10 | Error schemas, status visibility, retry rules, cancellation, rollback and support escalation | The agent cannot distinguish pending, failed and completed actions |
| 7. Trust and governance | 10 | Provenance, security contacts, audit logs, accessibility, policies and human appeal | Actions cannot be explained, challenged or contained |
DN Agentic Web Readiness Audit
Check only controls that are implemented and tested. The result is a diagnostic, not a certification.
Agent-Opaque
Your website may be visible online, but no verified readiness controls have been selected.
Priority fixes- Complete the assessment to generate priorities.
How the Score Works
Scores are additive because every layer creates independent value, but the headline score is not enough. DN applies three critical gates: an organization cannot claim transactional readiness without a structured action interface, scoped authority and transaction confirmation. A 75-point information site may be highly agent-readable. It is not automatically safe for autonomous purchasing.
What Existing Standards Solve, and What They Do Not
| Mechanism | Useful contribution | Not sufficient for |
|---|---|---|
| robots.txt | Standardized crawler access rules under the Robots Exclusion Protocol | Delegated authority, transaction permission or contractual consent |
| Schema.org / JSON-LD | Explicit entities, attributes, relationships and potential actions | Proving an endpoint is secure, current or authorized for autonomous execution |
| llms.txt | A proposed convention for presenting concise, model-friendly site resources | A universal authorization or security standard; adoption and interpretation vary |
| OpenAPI and APIs | Structured inputs, outputs, authentication and predictable programmatic access | Safe delegation unless scope, confirmation and recovery are designed explicitly |
| MCP | A standardized method for AI applications to connect with tools, resources and workflows | Trusting every exposed tool or eliminating the need for least privilege and validation |
| WCAG | Accessible, operable and understandable experiences that often improve machine clarity | Machine payment, identity, task state or agent-specific governance |
DN treats llms.txt as an emerging convention, not a guaranteed ranking factor or authorization mechanism. Publishing one does not make a website agent-ready.
The New Funnel: From Search Visibility to Agent Selection
Be discovered
Stable URLs, crawl rules, sitemaps and references allow an agent or retrieval system to locate the relevant resource.
Be understood
Structured entities, precise language, visible evidence and consistent identifiers reduce inference risk.
Be shortlisted
Price, availability, jurisdiction, reliability, policy and proof must be comparable with alternatives.
Be authorized
The agent proves who delegated the task and receives only the authority required to complete it.
Be transacted with
The site exposes a bounded action with known total cost, confirmation, receipt and repeat protection.
Be accountable
Every material action can be inspected, cancelled, disputed or escalated to a human.
DN Alpha Thesis: The Next SEO Metric Is Executability
Human traffic rewards attention. Agent traffic will increasingly reward decision confidence per unit of machine effort. The commercial winners may not be the sites producing the most content. They may be the sites that make accurate comparison and safe execution cheapest for an agent. DN calls this Machine Decision Yield: verified decision value divided by the tokens, latency, uncertainty and action risk required to obtain it.
Practical Roadmap by Organization
What Would Prove This Thesis Wrong?
The index would matter less if general browser agents become so reliable that structured interfaces deliver no measurable improvement in completion, cost or safety. It would also weaken if a single closed platform intermediates nearly all agent transactions, making open-web readiness commercially irrelevant. DN will test the thesis by tracking whether higher scores correlate with lower task failure, faster completion, fewer human rescues and higher verified conversion.
Methodology and Limitations
Version: DN-AWRI v1.0. The index evaluates public and organization-reported controls across seven weighted layers. The self-audit above is educational. A verified DN benchmark would require technical inspection, structured-data validation, interface tests, repeated task execution, permission review and failure-recovery testing.
Evidence boundary: The article combines established web standards with DN's forward-looking measurement model. No existing standard cited here certifies complete agent readiness. Scores should be reported with the date, tested pages, task set, user role, geography and authentication state.
Change log: v1.0 establishes the seven layers, 100-point weighting, three critical gates and five maturity bands. Future versions may adjust weights after observed task data becomes available.
Primary Sources
Frequently Asked Questions
What is an agent-ready website?
An agent-ready website can be discovered and interpreted by machines and provides safe, structured ways to perform relevant actions with explicit permission, confirmation and recovery.
Is agentic web optimization the same as SEO?
No. SEO focuses primarily on search discovery and ranking. Agentic readiness also covers comparison, execution interfaces, delegated authority, payments, reliability and accountability.
Does structured data improve AI visibility?
Structured data gives machines explicit clues about entities and page meaning. It can reduce ambiguity, but no markup guarantees inclusion, ranking, citation or selection by an AI system.
Does a website need an llms.txt file?
Not necessarily. It is an emerging convention and may make selected resources easier to find, but it is not a universal requirement, ranking guarantee or permission system.
Does allowing an AI crawler authorize an AI agent to transact?
No. Crawl access governs retrieval. A transaction requires separate identity, authority, consent, scope and confirmation controls.
Does every business need an MCP server?
No. A documented API or well-structured form may be sufficient. MCP becomes useful when an organization wants compatible AI applications to discover and invoke defined tools or resources.
What is the most important first step?
Make decisive information explicit and consistent: identity, offering, price, availability, terms, dates and contact or escalation routes. Safe action interfaces should follow a dependable information layer.
Can an information-only publisher score highly?
Yes. A publisher can be highly agent-readable and trustworthy without offering transactions. DN reports maturity type and critical gates alongside the numerical score.
How often should readiness be tested?
Quarterly for stable sites and after any major redesign, API change, authentication change, checkout update or security incident.
Can the DN score certify that a website is secure?
No. The self-audit is a diagnostic. Security certification requires deeper technical testing, threat modeling and evidence beyond public website signals.
Build for the Customers That Will Never See Your Homepage
The agentic web will reward sites that are clear enough to understand, structured enough to compare and controlled enough to trust.
Explore DN Agentic Finance Research
