Your WordPress plugin has sprouted a new “llms.txt” toggle. Or an audit report has flagged the file as missing, or an agency quote lists “llms.txt setup” as a line item.
So, does llms.txt help local businesses? No. There’s no evidence it helps you appear in Google, ChatGPT or Perplexity, and Google says in writing that the file “will neither harm nor help” your visibility in Google Search. If a plugin makes one for free, it’s harmless. It isn’t worth your money or your time.
If you’re asking “do I need an llms.txt file?”, this guide goes to the sources rather than the hype: what the file is, what Google and the AI companies say, and what the server-log studies found.
What llms.txt Actually Is (and What It Isn’t)
Call it “robots.txt for AI” and you’ve already misunderstood it.
llms.txt is a proposal by Jeremy Howard, first published on 3 September 2024 and updated to version 2 on 10 August 2026. Its site, llmstxt.org, describes it as “A proposal to standardise on using an /llms.txt file to provide information to help agents use a website.” The spec is “open for community input”, not an agreed standard.
The file is plain Markdown (text with a few symbols for headings and links) at yoursite.co.uk/llms.txt. Only a heading with your site’s name is required. A one-line summary and lists of links to key pages are optional.
Who is it for? llmstxt.org says the files “are used most heavily for software documentation, where coding agents follow them”. In other words, code-writing tools reading API manuals. It suggests businesses could use the format too, but that’s a suggestion, not evidence.
It isn’t robots.txt either. The two “have different purposes”. The spec has no rules for blocking AI training or demanding credit, so the “Training: Disallow” lines some guides show aren’t in it. Crawler access is set in robots.txt.
So does anything that matters to you read the file? Start with Google.
What Google Says: It Neither Harms Nor Helps
Google has put it in writing: Google Search, including AI Overviews and AI Mode, ignores llms.txt.
Its guide to generative AI features in Google Search (last updated 10 July 2026) says: “You don’t need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search (including its generative AI capabilities), as Google Search itself doesn’t use them.” Creating one anyway is fine: “Doing so will neither harm nor help your site’s visibility or rankings in Google Search, as Google Search ignores them.”
Googlebot fetching /llms.txt in your logs? Google says it “may discover, crawl, and index many kinds of files in addition to HTML on a website: this doesn’t mean that the file is treated in a special way.”
Google’s John Mueller was blunter on Bluesky on 17 June 2025: “FWIW no AI system currently uses llms.txt.” The chatbots, he said, “will fetch your pages - for training and grounding, but none of them fetch the llms.txt file.”
The guide lists “creating unnecessary AI text files (like llms.txt)” among “AEO/GEO hacks” you can ignore, and points you to crawlable, useful pages instead. That’s where the effort belongs.
What OpenAI, Anthropic and Perplexity Tell Site Owners
The most repeated argument for llms.txt is that the AI companies use it themselves. They do, but not in the way you’re being told.
Here’s what their crawler documentation tells site owners (checked 26 September 2026):
- OpenAI: “To help ensure your site appears in search results, we recommend allowing OAI-SearchBot in your site’s robots.txt file”.
- Anthropic: its bots honour “industry standard directives in robots.txt”, and opting out “requires modifying the robots.txt file”.
- Perplexity: “we recommend allowing PerplexityBot in your site’s robots.txt file”.
None of them asks you to add an llms.txt.
The claim comes from something else. All three publish an llms.txt for their own developer documentation, so coding tools can read their manuals. Publishing a file for your docs isn’t the same as your crawler reading everyone else’s. A restaurant printing its own menu doesn’t mean it reads yours.
If you want to show up in ChatGPT search or Perplexity, the documented step is letting their search crawlers in through robots.txt. Step 2 of our GEO audit checks exactly that.
What the Server Log Studies Found
“Bots are reading llms.txt,” you’ll hear. The logs disagree.
Ahrefs (published 15 June 2026, May 2026 data). Of 137,210 domains in Ahrefs Web Analytics, 28% published an llms.txt. Of the roughly 38,000 valid files, 97% got zero requests. OAI-SearchBot, PerplexityBot and Claude’s search crawler “made only a couple of hundred fetches across thousands of sites”. Ahrefs notes its customers skew SEO-aware, and that “fetched” doesn’t mean “read”.
SE Ranking (7 November 2025). Across nearly 300,000 domains, about 1 in 10 had the file. The analysis “showed no effect of LLMs.txt on how often a domain is cited by LLMs”. Correlation, not proof, but it found nothing.
Nathan Hall (Zenodo, 21 September 2026). When the file’s address was announced in robots.txt, crawlers such as ClaudeBot fetched it, just as they fetched the sitemap. His conclusion: “Tell a crawler where a file is and it fetches the file. That is discovery, not adoption.” Caveats: seven sites on one server, and Hall builds the plugin that announces the file (he declares this).
A bot collecting a file isn’t a bot using it to decide what to recommend. No study so far shows the second.
Coding agents do read it: Ahrefs found Anthropic’s Claude-Code out-fetched every AI search bot. Useful if you publish software docs. Irrelevant if you fit kitchens.
For a local business, the evidence says the file sits unread.
Why Your Plugin or Audit Tool Keeps Mentioning It
If the evidence is this thin, why does the file keep appearing on your dashboard?
Because tools make it easy. Yoast SEO, AIOSEO and Wix can all generate one automatically, and once a big plugin has a toggle, it looks official.
Chrome’s Lighthouse has an llms.txt check in its “agentic browsing” audits. If the file is missing, “the audit is marked as Not Applicable (N/A)”. Not a fail.
Some SEO audit tools do flag a missing file, and it’s reasonable to read a flag as a problem. Here it isn’t. Tools add the feature because users ask for it, and users adopt it because tools offer it.
A warning in a tool isn’t a ranking factor.
The Verdict for a Local Business: Harmless, Low Priority, Never Worth Paying For
The decision, in three lines:
- If your plugin or platform makes one for free, leave it on. Google says it won’t hurt.
- If you don’t have one, that’s not a failure.
- Don’t pay for one, and don’t wait on one.
A paid llms.txt line item is a red flag. Some UK GEO packages list “llms.txt setup” in a paid fix, when a plugin does it free and no study has found a benefit. Our guide to what AI search work should cost flags special AI files sold as a premium.
Keep any file accurate. Ahrefs warns that “a stale or compromised file misleads every agent that reads it”, so check it isn’t listing old services or a closed branch.
Put the effort here instead:
- Let the right crawlers in: Googlebot, OAI-SearchBot and PerplexityBot, via robots.txt, with no host or CDN blocks. The GEO audit shows how to check.
- Clear, crawlable service and location pages that answer the customer’s question in plain text.
- Consistent business facts, plus structured data where it describes what’s genuinely on the page.
Quoted for llms.txt work and want a second opinion? Tell us what you do and where. We’ll give you a straight answer on whether we can help. If we can’t, we’ll say so.
FAQ
Can llms.txt stop AI companies training on my content?
No. The llms.txt spec has no rules for training or permissions. Training crawlers such as GPTBot and ClaudeBot are controlled in robots.txt, according to OpenAI’s and Anthropic’s own documentation. Blocking a training crawler is separate from blocking a search crawler like OAI-SearchBot, so check which one you’re blocking before you change anything.
Will adding an llms.txt file hurt my SEO?
No. Google says an llms.txt file “will neither harm nor help” your visibility or rankings in Google Search, because Search ignores it. That covers AI Overviews and AI Mode too, since they’re part of Google Search. Adding one won’t cost you rankings, and it won’t win you any either.
My SEO tool says llms.txt is missing. Should I fix it?
There’s no need. Google says you don’t need AI text files to appear in its search, and Chrome’s Lighthouse marks a missing llms.txt as “Not Applicable”, not a fail. Treat the warning as information, and spend the time on crawler access and clear pages instead.
Should I delete the llms.txt my plugin created?
No need either way, because it’s harmless. What matters is that it’s accurate. Open yoursite.co.uk/llms.txt in your browser and check it isn’t listing services you no longer offer or pages that have gone. A stale file can mislead any AI tool that does read it.