robots.txt · llms.txtllms.txt generator

llms.txt is a short Markdown site map for AI models. We build the file to the specification and tell you honestly who reads it.

No major AI company has officially said it reads llms.txt. Google states plainly that such files are not needed. Make one if it is cheap for you.

The file is built in your browser — neither rules nor addresses go to a server
01Generator02About llms.txt03Questions04Related
01

Generator

to the llmstxt.org specification
##
##Optional the model may skip it
File · /llms.txt
# bringer.ru

> Browser tools for text, code and data: everything runs on your device, nothing goes to a server.

The tools are free and need no sign-up. Each page is one tool with a description and frequent questions.

## Tools

- [Clean up AI text](https://bringer.ru/en/tools/ai-text-cleaner): invisible characters, markup, homoglyphs
- [Token counter](https://bringer.ru/en/tools/token-counter): o200k, cl100k and open models
- [robots.txt generator](https://bringer.ru/en/tools/robots-txt): AI bots by class and Yandex

## Optional

- [Changelog](/en/changelog)
How a model will read it

bringer.ru

Browser tools for text, code and data: everything runs on your device, nothing goes to a server.

The tools are free and need no sign-up. Each page is one tool with a description and frequent questions.

Tools

Optional

Put the file in the site root. Optionally add <link rel="describedby" href="/llms.txt"> to <head>.

02

About llms.txt

llms.txt was proposed by Jeremy Howard in September 2024: a Markdown document in the site root with a name, a short description and lists of important links, so models find the essentials faster. Anthropic, Stripe, Cloudflare and Yandex Cloud already publish one. Yet no major AI company has officially said it uses such files.

For example, this site’s own llms.txt: built from the catalogue and updated with every release.

Format

Markdown
# Name
Only the first-level heading is required. Then a quote with a description, paragraphs and sections with link lists.

Sections

Links
- [Name](url): note
Each second-level section is a list of links with short notes.

Optional

Secondary
## Optional
Links from this section may be skipped by the model if it runs short of context.

Location

Site root
/llms.txt
The file goes in the site root or a section, for example /docs/llms.txt.

Who reads it

Unconfirmed
?
None of the major model developers has officially confirmed using llms.txt.

Google's view

Not needed
no AI text files
Google says you do not need special machine-readable files for AI features in Search.
03

Frequently asked questions

A Markdown file in the site root with a short description and a list of important pages. It was invented to make a site easier for language models to understand: instead of crawling every page they see the essentials at once. Jeremy Howard proposed the format in September 2024, and the specification is published at llmstxt.org.

Updated

The bot list is checked against company documentation once a month. robots.txt is a request, not protection: only the server closes a site reliably.

«» added to favorites