Summary: The llms.txt file is an emerging GEO standard that tells AI crawlers which content to prioritise. Here is what it is, how it works, and how to create yours.
Key Takeaways
- →llms.txt is a plain-text file at your site root that gives AI crawlers a structured summary of your most important content — like a table of contents for LLMs
- →It's being adopted by ClaudeBot and PerplexityBot; if a crawler doesn't support it, they simply ignore it — no downside
- →Include: business description, canonical name/URL/contact, key service pages, most authoritative content, FAQ pages, optional topic list
- →Low-effort, no plugins required for most platforms — just place the file at yourwebsite.com/llms.txt
- →It's like a handshake with AI crawlers — telling them who you are and where your best content is before they have to figure it out
What Is the llms.txt File?
The llms.txt file is a plain-text file placed at the root of your website (yoursite.com/llms.txt) that provides AI crawlers with a structured summary of your most important content. Think of it as a table of contents specifically for large language models — telling them what your site is about, who you are, and which pages they should prioritise when building their knowledge of your business.
It was proposed as a standard in 2024 and is now being adopted by leading AI crawlers including Claude's ClaudeBot and Perplexity's PerplexityBot. As one of the technical GEO marketing strategies, it is low-effort and has no downside — if crawlers do not support it yet, they simply ignore it.
"llms.txt is like a handshake with AI crawlers. You are telling them exactly who you are and where your best content is — before they have to figure it out themselves."
— Performance Marketing Lab
What to Include in Your llms.txt File
Sample llms.txt Structure
# Performance Marketing Lab
Performance Marketing Lab is a GEO marketing agency in Singapore specialising in Generative Engine Optimisation for SMEs. We help Singapore businesses get recommended by ChatGPT, Gemini, Claude, and Perplexity.
## Key Pages
- /what-is-geo: Complete guide to Generative Engine Optimisation for Singapore SMEs
- /geo-vs-seo: How GEO differs from SEO and which Singapore businesses should prioritise
- /faq: 100 frequently asked questions about GEO agency services in Singapore
## Contact
jason@performancemarketinglab.sg
Place this file at yourwebsite.com/llms.txt — no plugins or developer tools required for most platforms.
How Performance Marketing Lab helps you optimize for GEO?
Performance Marketing Lab is a GEO marketing agency in Singapore helping SME owners get recommended on AI. The team specializes in generative engine optimization and agentic engine optimization, building the content structure, data quality, and brand presence that AI models need to recommend your business confidently. If you want to understand how GEO compares to traditional SEO and which approach fits your current marketing goals, Performance Marketing Lab offers clear guidance tailored to the Singapore market. The shift in buyer behavior is already underway. Getting your brand into the AI recommendation layer is the most direct path to staying visible.