llms.txt Look Up
Related tools
What this is
llms.txt is an informal convention: a Markdown file at /llms.txt giving AI assistants and crawlers a curated summary of your site — a title, a short description, and links to the pages that matter most.
How to read your result
Absence is normal today. If present, it should start with a top-level "# Title" heading and list key links. This tool reports whether the file exists and follows the basic shape.
Common problems and how to fix them
File exists but lacks the expected structure
How it shows up: Tools that consume llms.txt may ignore a file without the conventional "# Title" opening.
How to fix it: Start the file with "# Your Site Name", optionally a one-line blockquote summary, then Markdown link lists to your most authoritative pages.
Unrealistic expectations of what llms.txt does
How it shows up: Publishing the file changes nothing observable; AI tools keep summarizing the site their own way.
How to fix it: Treat it as a low-cost hint, not a control mechanism: there is no standard obliging crawlers to honor it. Use robots.txt for access control; llms.txt only suggests what to read.
Frequently asked questions
- What is an llms.txt file?
- llms.txt is a plain-text Markdown file placed at a site's root (/llms.txt) that gives AI models and crawlers a curated guide to your most important pages and content. It is a proposed convention, not an official standard, and it does not block or authorize crawling by itself.
- How do I use this tool?
- Enter a domain or URL and the tool requests /llms.txt from that site's root, then reports whether the file exists and what it returned. The check runs server-side, so you see the same response an AI crawler would receive.
- Why does publishing an llms.txt file matter?
- It lets you point AI assistants and crawlers to clean, canonical documentation and key pages instead of leaving them to guess from your raw HTML. This can improve how accurately AI tools summarize and reference your site.
- How do I read the result and fix a missing file?
- A found result means /llms.txt is served, usually with HTTP 200 and text content; a not-found result means the file is absent or returns an error like 404. To add one, create a Markdown file named llms.txt listing your key links and place it at your domain root so it loads at https://yourdomain/llms.txt.
- Does an llms.txt file control whether AI bots crawl my site?
- No. llms.txt only offers guidance and has no enforcement power, so it does not grant or deny crawling; use robots.txt or server-side rules to actually allow or block AI bots.