llms.txt generator
robots.txt says where crawlers may go. llms.txt is a proposed companion that says what's worth reading. Fill in the form to get a file in the llmstxt.org format.
Name a section Optional for links a model can skip when it's short on context.
# Example Docs
> Example is an open-source toolkit for building fast static sites.
## Docs
- [Quick start](https://example.com/docs/start.md): Install and build your first site
- [Configuration](https://example.com/docs/config.md)
## Optional
- [Changelog](https://example.com/changelog.md)
Upload it as /llms.txt at your site root. It doesn't change what crawlers are allowed to fetch; that's still your robots.txt.
llms.txt questions
What is llms.txt?
A proposed convention (llmstxt.org, by Jeremy Howard, 2024) for a Markdown file at /llms.txt that gives language models a short, curated map of a site: a title, a one-line summary and links to the most useful pages.
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may fetch. llms.txt suggests what’s worth reading. It grants or blocks nothing, and blocking a bot in robots.txt still applies.
Do AI companies use llms.txt?
It’s a community proposal, not a standard. None of the AI crawler documentation we cite on this site commits to reading it, so treat it as a low-cost extra rather than an SEO lever.
What is the "Optional" section?
The proposal gives a section titled "Optional" a special meaning: links there can be skipped when a shorter context is needed.