‹ All writing

AI Search

What Is llms.txt? A Plain-English Guide for 2026

Share
What is llms.txt? A plain-English guide for 2026.

If you work in SEO, you have probably seen llms.txt come up a lot lately, usually with a lot of confidence and not much agreement. This covers what it is, what goes in it, whether it does anything, and how to write one that is worth publishing.

What is llms.txt?

llms.txt is a plain Markdown file you put at the root of your site, at yourdomain.com/llms.txt. The idea, proposed at llmstxt.org, is to give large language models a curated guide to your site: a short summary plus a hand-picked set of links to the pages that actually matter, in a format that is cheap for a model to read.

Think of it as a counterpart to robots.txt and sitemap.xml, but aimed at LLMs instead of search crawlers. robots.txt says what bots may access and sitemap.xml lists everything, while llms.txt is meant to be the opinionated short list of who you are and which pages are worth reading.

Some sites also publish a larger llms-full.txt, which inlines the actual content rather than just linking to it.

What goes in it

The format is deliberately simple. Reading the spec closely, only one thing is strictly required:

  • An H1 with the site or project name. This is the only required element.
  • A blockquote summary (recommended): one line capturing what the site is.
  • Sections under ## headers, each a list of [name](url) links, optionally with a short note after each link.
  • An Optional section (a literal ## Optional header) for links that can be skipped if a model is short on context.

A minimal, well-formed file looks like this:

# Acme Analytics

> Acme Analytics is a privacy-first web analytics tool for small teams.

## Docs

- [Getting started](https://acme.com/docs/start): install and first dashboard
- [API reference](https://acme.com/docs/api): endpoints and auth

## Optional

- [Changelog](https://acme.com/changelog)

So the whole file is a title, a summary, and a curated set of links with some context on each.

Does Google use llms.txt?

No, it does not. In June 2026, Google clarified its guidance: Google Search does not use llms.txt, and publishing one will neither help nor hurt your rankings. Their own words are that it is “fine if you want to maintain these files for other services or systems that use them,” but it is not a Search ranking signal.

So if anyone sells you llms.txt as a Google ranking hack, they are wrong.

Who actually reads it, then?

The audience is the set of AI tools and agents that have chosen to support the format: certain assistants, agentic browsers, and dev tools that pull a site’s llms.txt to orient themselves before reading further. It is opt-in on the consumer side, and adoption among the big platforms is still uneven.

Chrome’s Lighthouse now includes an agentic-browsing audit that checks for a valid llms.txt, so the file has started to appear in mainstream tooling even though Search itself ignores it.

Realistically, this is an emerging and optional standard with real but still-limited readership. Publishing one is a cheap bet on where AI-driven discovery is heading, with no guaranteed payoff yet.

Should you create one?

If it is cheap for you to do well, yes. A clean llms.txt gives the systems that do read it an accurate map of your site, and it costs you very little. Just go in knowing it’s for AI tools and agents, since your Google rankings won’t move either way.

Two things matter more than having one at all. First, make it a real one. A curated title, a real summary, and a few meaningful sections beat a file that just dumps every page on your site. Second, keep your signals consistent. Plenty of sites publish an llms.txt that invites AI tools in while their robots.txt quietly blocks the same crawlers.

I built two free tools for this: an llms.txt generator to write a clean, spec-correct file, and an AI crawler access checker to see which AI bots your robots.txt currently allows or blocks.

What most people get wrong

I crawled the top 10,000 sites to see what adoption looks like. Nearly half of the files that exist are missing the basic structure, a meaningful share are auto-generated dumps from an SEO plugin, and a real slice of sites publish an llms.txt while simultaneously blocking AI crawlers in robots.txt.

If you want the full picture, the data is here: The State of llms.txt.

Working on this same shift?

I write about SEO, GEO, and getting found by AI search.
If this resonated, I'd love to compare notes.