Create an llms.txt for your site
An llms.txt is a short text file in your website's root in which you describe what your site is and which pages matter. Where robots.txt says what a crawler may not do, llms.txt says what a language model should know — in plain language, without the navigation, cookie banners and scripts around it. Fill in your details below and you get a file you can publish straight away, plus the instructions for your type of server.
What people use this for
- Point ChatGPT and Claude at your services and documentation instead of your cookie policy
- Give in one sentence the context your individual pages don't convey
- Put your key resources at the top and the peripheral ones under 'Optional'
What others think of this tool
No reviews for this tool yet. Yours would be the first.
Do you work with Westcube?
Leave a review on Google tooFrequently asked questions
What exactly is llms.txt?
A markdown file at https://yourdomain.com/llms.txt holding a title, a short summary and a number of link sections. The idea comes from a 2024 proposal by Jeremy Howard: a language model trying to understand your site needs no menus, banners or scripts, but a clean list of what lives where. The file is as readable for people as it is for a model.
Do ChatGPT and Claude actually read this file?
Honest answer: none of the major providers has publicly confirmed that they fetch llms.txt by default. It is a proposal gaining traction, not a settled standard like robots.txt. It costs you ten minutes and one small file, and it forces you to write down clearly what your site actually offers. That last part is a gain you keep either way.
How is this different from robots.txt and sitemap.xml?
Robots.txt grants permission: which crawler may access which path. Sitemap.xml gives completeness: here are all my URLs with their modification dates. Llms.txt gives meaning: this is who we are and these are the pages to read to understand us. The three don't compete — they answer different questions and you want all three.
Where should the file live?
In your domain's root, reachable at https://yourdomain.com/llms.txt — just like robots.txt. Not in a subfolder and not behind a redirect. It must be served as plain text (Content-Type text/plain or text/markdown); if your server offers it as a download or wraps it in HTML, a crawler can do little with it. The instructions below cover this per server type.
What is llms-full.txt and do I need one?
Llms.txt is the table of contents: short description plus links. Llms-full.txt is the expanded version containing the text of those pages itself, so a model gets everything in one fetch without following links. Start with llms.txt. An llms-full.txt mainly pays off for documentation and knowledge sites with many related pages, and it needs maintenance: stale content hurts more than no content.