What is llms.txt? Definition, format and examples

Reviewed 2026-07-06. The honest version, sources included.

llms.txt is a plain-text, markdown file served at the root of a domain that gives AI models a curated map of a site: a title, a short summary, and lists of key links. Proposed in September 2024, its aim is to point models at your important content without making them crawl everything. Only the title heading is strictly required.

Generate or validate an llms.txt

The format, required versus conventional

The spec, published at llmstxt.org by Jeremy Howard of Answer.AI, is deliberately small. In its own words, the H1 is the only required section. Everything else is convention or optional:

  • An H1 with the site or project name. Required.
  • A blockquote summary right after the H1. A strong convention, expected but not strictly mandated.
  • Free-form detail paragraphs, with no headings, so they stay distinct from the sections below.
  • H2 sections, each a markdown list of [name](url): optional description links.
  • A reserved ## Optional section, a naming convention for links that can be skipped when a shorter context is needed.

The canonical example

This is the textbook structure, taken verbatim from llmstxt.org:

# Title

> Optional description goes here

Optional details go here

## Section name

- [Link title](https://link_url): Optional link details

## Optional

- [Link title](https://link_url)

Does anyone actually read it? The honest answer

This is where most guides oversell. Publishing an llms.txt on your own site is common and easy; AI systems consuming and prioritising other sites' llms.txt files is a different claim, and the evidence says it is mostly not happening as of mid-2026.

  • Google's John Mueller, quoted by two independent outlets, said no AI system currently uses llms.txt, comparing it to the long-ignored keywords meta tag.
  • A 137,000-domain server-log analysis found 97% of llms.txt files received zero requests; among the requests that did occur, the top category was SEO audit tools, not AI systems.
  • A 300,000-domain study found no measurable relationship between having an llms.txt and being cited by AI models.
  • The one place it plausibly is used is developer tooling, where coding assistants fetch a library's docs. That is why Anthropic, Stripe, Vercel and Cloudflare publish theirs on developer docs, not marketing pages.

The fair summary: llms.txt is real, growing, and cheap to publish, and it may help coding agents read your docs. But as of mid-2026, no major consumer AI system is confirmed to fetch or prioritise third-party llms.txt files during general search. Publish it if you like; do not expect it to move your AI visibility.

How widely is it adopted?

Adoption figures vary by roughly two times depending on the dataset, so the honest presentation is a range, not a single number: about 5.6% to 10% of sampled domains carry one as of mid-2026, growing five to nine times year over year off a small base.

llms.txt adoption estimates, mid-2026. Figures differ by dataset and cutoff.
Source As of Dataset Headline figure
Rankability Jun 2026 Tranco top 1,000 8.7% of the top 1,000
Casey Burridge Jun 2026 HTTP Archive, top 10,000 5.61% of the top 10,000
Originality.ai May 2026 Over 3M sites 36,120 sites, up 8.8x in a year
SE Ranking Nov 2025 About 300,000 domains 10.13% adoption

llms-full.txt is a separate convention

You will also see llms-full.txt, which inlines a site's full documentation rather than linking to it. It is not part of the original spec; it was popularised separately, notably by Mintlify. Adoption is inconsistent: Anthropic and Cloudflare ship one, while Stripe publishes llms.txt but not llms-full.txt. Treat it as a vendor convention layered on top of the proposal.

Real-world examples

Real files deviate from the strict spec in small ways, which is useful texture. llmstxt.org and Mintlify are textbook-compliant. Anthropic and Stripe skip the blockquote and open with a plain paragraph. Vercel places the blockquote before the H1, a real ordering deviation. Seeing these makes clear the format is used more loosely in practice than it reads on paper.

Common questions

What is llms.txt?

llms.txt is a plain-text, markdown file placed at the root of a domain that gives AI models a curated map of a site: a title, a short summary, and lists of key pages. It was proposed in September 2024 to help models find the important content on a site without crawling everything.

Is llms.txt an official standard?

No. It is a proposal by Jeremy Howard of Answer.AI, published in September 2024, not a standard ratified by a standards body. It has been adopted by a number of documentation sites but remains a young, semi-formal convention.

Do AI companies actually use llms.txt?

There is no confirmed evidence that major consumer AI systems fetch third-party llms.txt files during search, and Google's John Mueller has said no AI system currently uses it. Server-log studies find almost all llms.txt files receive zero AI requests. The clearest real use is coding assistants reading a library's own file.

How many websites have an llms.txt file?

Estimates range from about 5.6% to 10% of sampled domains as of mid-2026, depending on the dataset and cutoff. All sources agree on the direction: fast relative growth off a small base, concentrated in tech, SaaS and publishing.

What is the difference between llms.txt and robots.txt?

robots.txt controls which crawlers may access which paths. llms.txt does the opposite job: it is a curated index that points models at the content you want them to read. One is access control, the other is a content map.