robots.txt · llms.txtllms.txt generator
llms.txt is a short Markdown site map for AI models. We build the file to the specification and tell you honestly who reads it.
No major AI company has officially said it reads llms.txt. Google states plainly that such files are not needed. Make one if it is cheap for you.
Generator
to the llmstxt.org specificationPut the file in the site root. Optionally add <link rel="describedby" href="/llms.txt"> to <head>.
About llms.txt
llms.txt was proposed by Jeremy Howard in September 2024: a Markdown document in the site root with a name, a short description and lists of important links, so models find the essentials faster. Anthropic, Stripe, Cloudflare and Yandex Cloud already publish one. Yet no major AI company has officially said it uses such files.
For example, this site’s own llms.txt: built from the catalogue and updated with every release.
Format
MarkdownSections
LinksOptional
SecondaryLocation
Site rootWho reads it
UnconfirmedGoogle's view
Not neededFrequently asked questions
Updated
The bot list is checked against company documentation once a month. robots.txt is a request, not protection: only the server closes a site reliably.