AI Agent Readiness Guides
Step-by-step guides to help your website work better with AI agents — from robots.txt rules to MCP server cards.
How to Add llms.txt to Your Website
Learn how to create and deploy an llms.txt file so AI assistants like Claude, ChatGPT, and Perplexity can understand your site's content. Includes format examples and common pitfalls.
How to Configure robots.txt for AI Bots (GPTBot, ClaudeBot, Bingbot)
A complete guide to allowing or blocking AI crawlers — GPTBot, ClaudeBot, PerplexityBot, CCBot — in your robots.txt file. Includes copy-paste rules and gotchas.
What is an MCP Server Card (mcp.json) and How to Add One
Learn how Model Context Protocol (MCP) server cards work, what to put in your mcp.json file, and how AI agents discover your tools and services automatically.
How to Make Your Website AI Agent-Ready in 2026
A complete checklist for making your website readable and usable by AI agents — covering robots.txt, llms.txt, MCP, OAuth discovery, structured data, and more.
OAuth Discovery Endpoint: What It Is and How to Add It
Learn how to add an OAuth 2.0 authorization server metadata document at /.well-known/oauth-authorization-server so AI agents can authenticate with your API automatically.
Check your own site
Free scan across 18 checks — get a score and embeddable badge.