Curated by
More in Measurement Toolkit (Crawl/Serve/Cite)
See all 8 →Measuring AI Visibility: Crawls, Serves, and Citations
app.notion.com
Google's Guide to Optimizing for Generative AI Features
developers.google.com
Peec Server-Logs Guide: Why Server Logs are Crucial for AI Search Strategy
peec.ai
More from Stacklist
See all stacks →Nightclubs & Cocktail Lounges in Campbell
6 cards
Fun Without Spending in Chicago
8 cards · Travel
Where to Find Good Coffee in Paris
10 cards · Places
We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read
The LLMSTXT study analyzes server logs from 137K domains to reveal that only 28% publish llms.txt files, with 97% receiving zero traffic and 96% of requests coming from bots. The research challenges industry speculation about llms.txt's importance for AI visibility, finding that it primarily serves as a temporary tool for AI coding applications rather than a critical SEO ranking factor.
Built for AI agentsACO · 5659 tokens
Summary
The LLMSTXT study analyzes server logs from 137K domains to reveal that only 28% publish llms.txt files, with 97% receiving zero traffic and 96% of requests coming from bots. The research challenges industry speculation about llms.txt's importance for AI visibility, finding that it primarily serves as a temporary tool for AI coding applications rather than a critical SEO ranking factor.
Tags
llms.txt · ai-bots · seo · web-analytics · generative-ai · content-marketing
Key entities
Louise Linehan (person, 0.95) · Jeremy Howard (person, 0.9) · John Mueller (person, 0.9) · Lily Ray (person, 0.85) · Ahrefs (organization, 0.95) · Google (organization, 0.95) · Answer.AI (organization, 0.85) · fast.ai (organization, 0.85) · llms.txt (technology, 0.98) · GPTBot (technology, 0.9) · Claude-Code (technology, 0.9) · Chrome Lighthouse (technology, 0.9) · generative-ai (concept, 0.95) · ai-visibility (concept, 0.9) · agentic-browsing (concept, 0.85) · LLMSTXT Study (event, 0.9)
Classification
analysis · language en · status final
Provenance
claude-haiku-4-5 via @stacklist/be@0.1.0, confidence 0.85, 15 Jul 2026