
Key takeaways
- llms.txt is a proposed Markdown file at your site root that summarises key pages for large language models.
- Google's May 2026 guide says llms.txt is not needed for AI Overviews or AI Mode.
- Chrome Lighthouse 13.3 (May 2026) added an "Agentic Browsing" category that includes an llms.txt check.
- Some AI developers publish and reference llms.txt files for documentation and agents.
- It takes minutes to create, carries little risk, and should never replace real SEO.
llms.txt became one of the most searched technical SEO topics of the past year. Some people call it "robots.txt for AI". Others call it pointless. As usual, the truth is in the middle. In this guide I explain what llms.txt is, what Google officially said about it in 2026, who actually uses it, and whether your website should have one.
What is llms.txt?
llms.txt is a proposed standard, described at llmstxt.org and introduced in late 2024, for a plain Markdown file placed at the root of your website (for example yourdomain.com/llms.txt). It gives large language models and AI agents a short, curated summary of your site: who you are, what you offer and links to your most important pages, written in a format that is easy for machines to read.
Unlike robots.txt, it does not allow or block anything. It is a guide, not a rule. A companion file, llms-full.txt, sometimes contains the full text of key pages in one document.
What does an llms.txt file look like?
Here is a simplified version of the file we publish on this website:
# Sadaf SEO Agency
> Lahore-based SEO and AI search agency offering technical SEO,
> GEO/AEO, local SEO, GA4 server-side tracking, e-commerce SEO,
> Google Ads, Meta Ads and web development.
## Services
- [Technical SEO](https://sadafseoagency.netlify.app/services/technical-seo/): audits, Core Web Vitals, schema
- [GEO & AEO](https://sadafseoagency.netlify.app/services/geo-aeo-optimization/): AI search visibility
## Contact
- [Contact](https://sadafseoagency.netlify.app/contact/): WhatsApp +92 302 8303210
You can view our full version at /llms.txt.
What Google said about llms.txt in 2026
Google has been consistent: llms.txt is not part of how its search features work. In its May 15, 2026 guide to optimizing for generative AI features, Google lists llms.txt among things that are not needed for AI Overviews, AI Mode or other generative AI Search features, alongside separate Markdown pages, content chunking and special structured data. Google's search team members had previously compared it to the old keywords meta tag.
So why do people still create llms.txt files?
Because Google is not the only AI system on the web:
- Chrome Lighthouse 13.3 (early May 2026) introduced an Agentic Browsing category with audits including llms.txt handling, so developers now see it in performance reports.
- Several AI developers, including Anthropic and OpenAI, publish llms.txt files for their own documentation, and AI coding tools and agents increasingly look for them.
- Industry research has found tens of thousands of llms.txt files already indexed across the web.
None of this proves that an llms.txt file improves visibility in ChatGPT or Perplexity answers. But it costs almost nothing, can help AI agents that do read it, and forces you to write a clear summary of your business, which is a useful exercise for GEO anyway.
Should your website have one?
Our recommendation:
- Yes, if you have a services business, documentation, a SaaS product or an e-commerce store and want AI agents to find your key pages quickly. It takes 15–30 minutes.
- Do not expect ranking improvements on Google from it.
- Never use it to show AI different information from what people see. Keep it consistent with your website.
- Prioritise the things that do matter first: technical SEO, expert content, a complete Google Business Profile and genuine brand mentions.
How to create an llms.txt file in 5 steps
Start with an H1 and summary
Add your brand name as a heading, followed by a one-to-three line summary in a blockquote.
List your key pages by section
Services, products, pricing, about, contact and your best guides, each with a one-line description.
Use absolute URLs
Link to the full https address of each page so agents can follow them.
Upload to your site root
Publish it at /llms.txt as plain text. On WordPress you can upload it via your file manager or an SEO plugin that supports it.
Keep it updated
Update the file when you add services or important content, just as you would your sitemap.
Need help with llms.txt, robots.txt rules for AI crawlers or a full GEO strategy? Get a free audit from Sadaf SEO Agency.

