llms.txt Generator: summarise your site for AI.
Enter your domain and we will read your sitemap and build an llms.txt file in the llmstxt.org format from your 25 most important pages. Copy or download it, edit it and upload it to your site.
What is llms.txt?
llms.txt is a short Markdown guide placed at the root of your site. It was proposed by Jeremy Howard in 2024 at llmstxt.org. Its purpose is to tell AI models what your site is and where its most important pages are, without menus, ads and code getting in the way.
The structure is simple: the site name at the top, a one-sentence summary below it, then page links grouped under headings, each with a short description.
Does it actually work?
Honest answer: it is not settled yet. Google has said plainly that it does not use llms.txt. OpenAI, Anthropic and Perplexity have not officially confirmed that their crawlers read it either. Today it is used mostly by AI coding assistants that read documentation and by some developer tools.
It takes a few minutes to set up and does no harm, but it is not a ranking trick. To show up in AI search, first make sure crawlers can reach your site; the AI Crawler Checker does exactly that.
What does this tool do?
- Reads the sitemap listed in robots.txt, or sitemap.xml. If there is no sitemap, it uses the links on your home page.
- Collects the title and meta description of up to 25 pages, starting with those closest to the root.
- Skips noindex pages and puts privacy and cookie pages in the standard’s Optional section.
- Groups pages under headings such as blog, guides, products, company and support.
How to add the file to your site
- First download the result and read it. Delete pages that do not matter and fix weak descriptions by hand.
- Then upload the file to your site root so it lives at yoursite.com/llms.txt. On WordPress you can do this with your host’s file manager or FTP. If you use Yoast SEO or Rank Math, both also have their own llms.txt feature.
- Finally open the address in a browser; it should show as plain text.
Limitations
The tool reads up to 25 pages and does not run JavaScript, so sites that load content only with JavaScript may come back with missing titles. Some sites block requests from our server. Results are cached for one hour.
Page discovery and categorisation are adapted from Huzaifa Shoukat’s open-source llmoptimizer (MIT licence); the output follows the llmstxt.org format. Thanks for the work.
FAQ
Frequently asked questions
Short answers about llms.txt.
Does llms.txt replace robots.txt?
No. robots.txt decides which pages crawlers may access. llms.txt blocks and allows nothing; it is only a guide that summarises your content for AI models. You use both together.
Will llms.txt improve my Google rankings?
There is no evidence that it does. Google has said it does not use llms.txt. Add it to give AI tools a tidy summary, not in the hope of ranking higher.
What is llms-full.txt, and does this tool create it?
llms-full.txt is an extended version that puts the full text of your key content in one file. This tool only creates llms.txt; a full-text file is large and site-specific, so it is better prepared by hand.
Is it free, and do you store my site?
It is free with no sign-up. Results are cached for one hour and then deleted; nothing is stored permanently.