🔍 SEO / GEO

llms.txt

LLM Sitemap · Machine-readable Site Description

Definition

llms.txt is an emerging standard for a root-level text file that gives language models and AI agents a structured description of a site so they can understand it without a full crawl.

What llms.txt is for

llms.txt is a text file at the root of a site (/llms.txt), written in Markdown. Its job is to give
language models and AI agents a structured answer to the question of what this site is and what is
worth reading. The idea emerged in 2024 in response to AI search engines that no longer read whole
pages — they need the packaging.

Important: llms.txt is a community proposal rather than a ratified standard. Even so, several
AI search and retrieval platforms already consume it.

The structure of the file

A typical llms.txt has a few sections:

# Site name

> A short description: what this is, who it is for, what the value is.

## Key sections
- [Product](/product): the main capabilities
- [Documentation](/docs): API, integrations, how-to
- [Case studies](/cases): real results with clients

## Do not cite
- /admin, /account, /cart (interface pages with no content value)

It is also worth stating the site language, the key topics and examples of the best pages for
citation.

Three layers of crawler guidance

File	Audience	What it says
robots.txt	Search crawlers	What not to fetch
sitemap.xml	Search indexers	What to index
llms.txt	AI models and agents	How to understand the site and what to cite

The three complement each other rather than compete.

Using it in e-commerce

For an online store, llms.txt is particularly useful when:

There is a substantial content section — a blog, case studies, a glossary — and agents need
directing to the best material
There is API documentation, so AI-assisted developers find what they need faster
The company is pursuing citability in AI answers on category questions

Tip: include not only section links but a short who we are in the first paragraph — it speeds
up context building for retrieval systems.

Honest expectations

llms.txt does not guarantee inclusion in model answers. It lowers the barrier to citation; it does
not substitute for good content, domain authority and structure. If the pages are weak or
unindexed, the file will not help.

Frequently asked questions

Is llms.txt mandatory?

No — it is an emerging convention rather than a ratified standard. Having one helps AI agents and assistants understand a site's structure and value faster and more accurately, which raises the odds of being cited.

How does it differ from robots.txt and sitemap.xml?

robots.txt tells crawlers what not to fetch; sitemap.xml tells indexers what to index; llms.txt explains to language models what the resource is and what is worth citing. Three layers: accessibility, indexability and citability.

What should llms.txt contain?

A short description of the site and its audience, a map of key sections with URLs, and links to the most important content and documentation. Optionally the preferred citation language, the key topics and examples of authoritative pages.

Does it affect Google rankings?

There is no direct relationship. The file targets AI search engines and agent systems rather than classical ranking algorithms. Growing citability in AI answers can affect brand traffic indirectly.