shipfound

Answer

Is writing an llms.txt file worth it for SEO?

Updated 2026-10-12

Not for rankings. An llms.txt file does not influence rankings or AI Overviews, and no AI systems currently consume it as a standard input. It costs little to write, so adding one does no harm. If you want to show up in Google and AI answers, spend the effort on clear pages that answer what your buyers ask.

What an llms.txt file is

It is a Markdown file at your site root that gives language models a short, curated guide to your most important pages. Jeremy Howard, a co-founder of fast.ai, published the proposal on September 3, 2024. A typical file has an H1 with the site name, a one-line blockquote, then sections of links with a short description each.

It is not robots.txt. Robots.txt tells crawlers which pages they may access, while llms.txt points models to your most important content. And it is meant for the moment a model answers a question, not as a training opt-out or a ranking factor.

Does any AI engine read it?

Not as a standard input. Symphonic Digital found it does not improve how a brand appears in ChatGPT. Where the file does get used is developer docs. Google maintains llms.txt files for the Gemini API docs, Chrome developer docs, Firebase and Flutter, and Cloudflare uses its file to link Markdown versions of its content on over 30 topics. Google also removed the files from several developer.google.com folders, Search Central among them, in December 2025.

Has anyone measured a gain?

Not credibly. Anna Holmquist notes that no credible stories have shown llms.txt improving content visibility. Patrick Stox adds that there is no agreed standard for it, the way there is for schema and robots.txt.

When to add one anyway

When it is cheap. Yoast now generates llms.txt for you, and Webflow lets you upload it at the root. It fits docs and APIs best, which is where Google and Cloudflare use it. Put nothing in it you would not publish on the page itself: Stox warns these files could be used to lift e-commerce pricing or get around paywalls.

If you build with Claude Code or Codex, Shipfound checks for an llms.txt in its audit and adds one with your other site fixes as a pull request. Then it measures what moves: whether GPTBot, PerplexityBot and ClaudeBot crawl your pages, and whether AI engines name your product.

Frequently asked questions

Will llms.txt help my Google rankings?

No. Symphonic Digital reports it does not move rankings, AI Overviews, traffic or other SEO KPIs.

What is the difference between llms.txt and llms-full.txt?

llms.txt is a map of links. llms-full.txt holds the content itself, often a whole docs set in one Markdown file.

What should I do instead?

Publish clear, structured, authoritative content, let the AI search bots in (how to get indexed by PerplexityBot and GPTBot), and check whether AI crawlers are hitting your site.

How do I know if ChatGPT names my product?

Ask it the questions your buyers ask, several times each, because answers change between runs. More in how to track if ChatGPT mentions your product.