Question 1

What is llms.txt?

Accepted Answer

llms.txt is a markdown file at your site's root (https://yoursite.com/llms.txt) that gives AI crawlers a curated index of your documentation. It's the AI equivalent of sitemap.xml, but written for language models rather than search engines.

Question 2

Do I need llms.txt?

Accepted Answer

If you want Claude, ChatGPT, or Perplexity to accurately cite your docs when users ask about your product, yes. The file tells them which pages to read, in what order. Without it, they crawl your site like Google does and often miss or misquote your real documentation.

Question 3

How is this different from sitemap.xml?

Accepted Answer

Sitemap is exhaustive XML for search engines. llms.txt is curated markdown for AI agents: it surfaces only the doc-worthy pages, organized by category, with descriptions an LLM can use as context when deciding what to read.

Question 4

How do I install the generated file?

Accepted Answer

Save the output as llms.txt and upload it to your website root, served at https://yoursite.com/llms.txt with content-type text/plain or text/markdown. AI crawlers will discover it automatically.

llms.txt Generator

How it works

Want this baked into your docs site?