llms.txt: The File AI Crawlers Read
llms.txt is a file that tells AI crawlers about your website. It's like robots.txt but specifically for AI models.
What is llms.txt?
llms.txt is a markdown file placed at your website root that provides AI models with:
- Brand description
- Product information
- Key pages
- Pricing details
- Contact information
Why llms.txt Matters
AI-Specific Instructions
Unlike robots.txt (which blocks/allows crawling), llms.txt provides context AI models need.
Structured Information
AI models can quickly extract key facts about your brand.
Better Citations
AI models with llms.txt access can generate more accurate citations.
llms.txt Template
# YourBrand
> Brief description of what your brand does
## Products
- [Product 1](https://yoursite.com/product1): Description
- [Product 2](https://yoursite.com/product2): Description
## Key Pages
- [About](https://yoursite.com/about): Company information
- [Pricing](https://yoursite.com/pricing): Plans and pricing
- [Features](https://yoursite.com/features): Product features
## Pricing
- Free tier: What's included
- Paid tier: Price and features
## Contact
Website: https://yoursite.com
Email: contact@yoursite.com
## Social
- Twitter: https://twitter.com/yourbrand
- LinkedIn: https://linkedin.com/company/yourbrandWhere to Place llms.txt
Place at: https://yoursite.com/llms.txt
What to Include
Essential
- Brand name and description
- Product descriptions
- Key page links
- Pricing information
- Contact details
Optional
- Social media links
- Team information
- Customer examples
- Feature lists
Best Practices
- Keep it concise — AI models prefer short, clear information
- Use markdown — Standard format AI models understand
- Update regularly — Keep information current
- Include key pages — Help AI find important content
- Add pricing — Help AI answer pricing questions
llms.txt vs robots.txt
| Aspect | llms.txt | robots.txt |
|---|---|---|
| Purpose | Provide context | Control access |
| Format | Markdown | Plain text |
| Content | Brand info | Crawl rules |
| AI benefit | Better citations | Access control |
Measuring Impact
Track:
- AI citation accuracy
- Brand mention consistency
- Pricing answer accuracy
Start Today
- Create llms.txt — Use the template above
- Add to website root — Place at /llms.txt
- Test access — Verify AI crawlers can read it
- Monitor results — Track AI visibility changes
llms.txt is a simple but effective way to help AI understand your brand.