geolintv0.4.0AI-search readiness audit
https://github.com/
HTTP 200text/htmlTTFB 49mstotal 713msrobots.txt 200llms.txt 2002026-09-17 12:55 UTC
Grade B
1 error·4 warnings·9 hints
38/52 checks passed

Categories

AI Crawler Access
81
1 error · 2 hints
llms.txt
88
2 warnings
Structured Data
90
1 warning · 2 hints
Citability
90
5 hints
Technical Foundation
94
1 warning

AI crawler access 50/51 allowed · 1 blocked

BotPurposerobots.txtAccess
OpenAI
GPTBottraininghonored✓ allowed
OAI-SearchBotsearchhonored✓ allowed
ChatGPT-Useruser-fetchmay bypass✓ allowed
OAI-AdsBotmixedhonored✓ allowed
Anthropic
ClaudeBottraininghonored✓ allowed
Claude-Useruser-fetchhonored✓ allowed
Claude-SearchBotsearchhonored✓ allowed
anthropic-airetiredtrainingunverified✓ allowed
Claude-Webretiredsearchunverified✓ allowed
Perplexity
PerplexityBotsearchhonored✓ allowed
Perplexity-Useruser-fetchmay bypass✓ allowed
Google
Googlebotsearchhonored✓ allowed
Google-Extendedopt-outtraininghonored✓ allowed
Apple
Applebotsearchhonored✓ allowed
Applebot-Extendedopt-outtraininghonored✓ allowed
Meta
Meta-ExternalAgentmeta-externalagenttraininghonored✓ allowed
Meta-WebIndexersearchhonored✓ allowed
Meta-ExternalFetcheruser-fetchmay bypass✓ allowed
facebookexternalhituser-fetchunverified✓ allowed
FacebookBotretiredtrainingunverified✓ allowed
Amazon
Amazonbotmixedhonored✓ allowed
Amzn-SearchBotsearchhonored✓ allowed
Amzn-Useruser-fetchhonored✓ allowed
Mistral AI
MistralAI-Useruser-fetchunverified✓ allowed
MistralAI-Indexsearchunverified✓ allowed
MistralAI-Trainingtrainingunverified✓ allowed
Microsoft
Bingbotsearchhonored✓ allowed
DuckDuckGo
DuckDuckBotsearchhonored✓ allowed
DuckAssistBotuser-fetchhonored✓ allowed
You.com
YouBotsearchhonored✓ allowed
Moonshot AI
KimiBottrainingunverified✓ allowed
Kimi-Useruser-fetchunverified✓ allowed
Alibaba
TongyiBotmixedunverified✓ allowed
Exa
ExaBotsearchunverified✓ allowed
Tavily
TavilyBotsearchunverified✓ allowed
Timpi
Timpibotsearchunverified✓ allowed
ByteDance
Bytespidermixedunverified✕ blocked
Common Crawl
CCBottraininghonored✓ allowed
Cohere
cohere-aiuser-fetchunverified✓ allowed
cohere-training-data-crawlertrainingunverified✓ allowed
Diffbot
Diffbotmixedhonored✓ allowed
Webz.io
Omgilibotomgilibotretiredtraininghonored✓ allowed
webziotraininghonored✓ allowed
Webzio-Extendedopt-outtraininghonored✓ allowed
The Hive
ImagesiftBottraininghonored✓ allowed
Huawei
PanguBottrainingunverified✓ allowed
Kangaroo LLM
Kangaroo Bottrainingunverified✓ allowed
Allen Institute for AI
AI2Bottraininghonored✓ allowed
Ai2Bot-Dolmatraininghonored✓ allowed
NICT
ICC-Crawlertrainingunverified✓ allowed
Velen
VelenPublicWebCrawlertrainingunverified✓ allowed

Findings

✕Errors 1
✕ errorai-crawler/search-bots-blockedAI Crawler Access
AI search and user-fetch bots allowed by robots.txt

Bytespider is blocked by robots.txt — ByteDance cannot use your pages as AI answer sources

Bytespider (mixed) is disallowed from the site root, so ByteDance cannot read or cite this site.

FixRemove the Disallow covering Bytespider in robots.txt, or add an explicit "Allow: /" for it.

Disallow: / (matched by Bytespider)
⚠Warnings 4
⚠ warningllms-txt/broken-linksllms.txt
llms.txt links resolve

2 of 5 sampled llms.txt links are broken

Links in llms.txt should point to pages that actually load — broken entries undermine the whole file.

FixUpdate or remove the dead links in /llms.txt.

https://docs.github.com/api/article (HTTP 400)
https://docs.github.com/api/article/body (HTTP 400)
⚠ warningllms-txt/links-blocked-by-robotsllms.txt
llms.txt links are crawlable by AI bots

1 llms.txt link(s) point to pages robots.txt disallows for AI bots

The file recommends these pages to AI consumers while robots.txt tells their crawlers to stay away — the contradiction makes the curated list useless for exactly the audience it was written for.

FixAllow the recommended paths for AI crawler tokens in robots.txt, or remove those links from llms.txt.

https://github.com/github/github-mcp-server — blocked for Bytespider
⚠ warningschema/no-jsonldStructured Data
JSON-LD structured data present

No JSON-LD structured data on the page

AI engines use schema.org markup to identify entities, dates, authors and page types. Without it they fall back to unreliable inference.

FixAdd JSON-LD blocks describing the page (Article, Organization, BreadcrumbList, FAQPage as appropriate).

⚠ warningtechnical/sitemap-missingTechnical Foundation
XML sitemap discoverable

No sitemap discoverable

No Sitemap directive in robots.txt and /sitemap.xml does not resolve.

FixPublish an XML sitemap at /sitemap.xml and declare it in robots.txt ("Sitemap: https://…/sitemap.xml").

https://github.com/sitemap.xml → HTTP 406
ℹHints 9
ℹ hintai-crawler/crawl-delayAI Crawler Access
No crawl-delay slowing AI crawlers

Crawl-delay of 1s applies to GPTBot, OAI-SearchBot, ClaudeBot, anthropic-ai, PerplexityBot

Affected AI bots: GPTBot, OAI-SearchBot, ClaudeBot, anthropic-ai, PerplexityBot.

FixRemove the Crawl-delay or exempt AI search bots with their own groups if you want your content indexed promptly.

User-agent: gptbot, oai-searchbot, claudebot, anthropic-ai, perplexitybot
Crawl-delay: 1
ℹ hintai-crawler/stale-tokensAI Crawler Access
Retired AI bot tokens in robots.txt

Stale token 'anthropic-ai' — Anthropic now uses 'ClaudeBot'

'anthropic-ai' matched retired token anthropic-ai; this rule has no effect on current Anthropic crawlers.

FixReplace 'User-agent: anthropic-ai' with 'User-agent: ClaudeBot' (or delete the stale block).

User-agent: anthropic-ai
ℹ hintschema/no-organizationStructured Data
Organization schema present

No Organization schema found

Without entity grounding, engines cannot connect this site to a known organization — weaker trust signals for citation.

FixAdd an Organization JSON-LD block (name, url, logo, sameAs links) at least on the homepage.

ℹ hintschema/no-breadcrumbStructured Data
BreadcrumbList schema present

No BreadcrumbList schema found

Breadcrumbs expose site structure to machines; without them a page floats without context.

FixAdd BreadcrumbList JSON-LD matching the visible breadcrumb trail.

ℹ hintcontent/no-question-headingsCitability
Question-shaped headings

No question-shaped headings (h2/h3 ending in "?")

Question headings map directly onto user prompts and make sections self-contained citable answers.

FixRewrite a few section headings as the actual questions your audience asks.

ℹ hintcontent/no-authorCitability
Author attribution

No author attribution found

No meta[name=author], rel=author, JSON-LD author or author/byline markup — the content looks anonymous.

FixAttribute the content: an author byline, meta[name=author] or a Person in JSON-LD author.

ℹ hintcontent/no-data-pointsCitability
Concrete data points

Few concrete data points found (2 numeric stats)

Percentages, growth figures and quantities give AI engines precise, attributable claims to quote.

FixAdd verifiable numbers — percentages, counts, benchmarks — near the claims they support.

ℹ hintcontent/images-no-altCitability
Images carry alt text

17 of 24 images have no alt text

Alt text is the primary way AI systems understand what an image shows; missing alt makes visual content uncitable.

FixWrite descriptive alt text for meaningful images (purely decorative ones can keep alt="").

ℹ hintcontent/answer-firstCitability
Page leads with a direct answer

Lead paragraph after the H1 is thin (~18 words)

A teaser or caption-length opener is hard to quote verbatim; engines prefer a self-contained answer they can lift whole.

FixExpand the opening paragraph into a direct, self-contained answer (roughly 40–80 words) before diving into details.

Tools and trends evolve, but collaboration endures. With GitHub, developers, agents, and code come together on one platf