Glossary
llms.txt
What is llms.txt?
llms.txt is a proposed standard: a markdown file at the root of a website that gives AI agents a short overview of the site and links to clean text versions of its most useful pages.
Why it matters
Web pages are built for people, so agents waste effort and context stripping out menus and scripts. An llms.txt file gives them a guided path to what matters. It helps outside agents read a public site, but it doesn’t give your own agents the private context they need to work inside your company.
Example
A software company’s llms.txt links to markdown versions of its API reference, quickstart and pricing pages, so a coding agent can find the right call without crawling the whole site.