Supa GRO
An initial deterministic pass across supa-gro.com — AI-crawler access, crawlability, schema, rendering, and semantic structure. Each item is a pass/fail call, not an opinion. A full audit follows once we engage.
Technical scorecard
6 pass · 7 flagged across 13 deterministic checks. 1 critical blocker(s) found — site is excluded from major crawlers, served via challenge, or has fundamentally broken canonicalization. Full audit will surface fixes worth the engagement.
Claude
PassCan fetch and read the homepage
Claude's fetch tool (claude-sonnet-4-6) returned a successful retrieval status for https://supa-gro.com/. When a user pastes this URL into Claude, the assistant accesses the page.
ChatGPT
CriticalCannot read the homepage
ChatGPT's fetch/search tool did not return content from this URL (no_citation_for_target_host). Could be a site-side block, missing index entry, or the model skipped the tool — we can't distinguish from this probe alone.
Gemini
CriticalCannot read the homepage
Gemini's fetch tool (gemini-2.5-flash) returned a retrieval error for this URL (status/code: URLRETRIEVALSTATUS.URL_RETRIEVAL_STATUS_ERROR). When a user pastes this URL into the assistant, it can't read the page. This is a stricter block than robots.txt — it prevents live, user-requested fetches.
Crawler access policy published
Passrobots.txt found and reachable (1,760 bytes).
Sitemap exists but robots.txt doesn't reference it
LowThe sitemap is reachable at /sitemap.xml, but robots.txt doesn't include a `Sitemap:` line pointing to it. Crawlers have to guess the location — adding one line to robots.txt fixes this.
4 search/AI crawlers blocked from indexing the site
Criticalrobots.txt instructs these crawlers not to index the site: Bytespider (sitewide), GPTBot (sitewide), ClaudeBot (sitewide), CCBot (sitewide). This means AI assistants (ChatGPT, Claude, Perplexity) won't cite the site from their indexed knowledge — users asking general questions about your industry won't be referred here. (Note: this affects training-data indexing and search citations, NOT live URL fetches — users who paste your URL directly into Claude or ChatGPT may still get a response. See the per-provider fetch checks below.)
Homepage doesn't declare its preferred URL (canonical missing)
HighNo canonical URL declared on the homepage. Search engines may split ranking signals across URL variants (with/without trailing slash, with UTM parameters, etc.) and the site's authority gets fragmented.
Bot-protection layer detected (Cloudflare)
InfoThe site is fronted by Cloudflare bot-protection. AI crawlers (ChatGPT, Claude, Perplexity) may be blocked by this layer even when robots.txt allows them — verify the WAF's bot rules allowlist verified AI crawler IP ranges.
Homepage content is readable without JavaScript
PassThe homepage serves 3,659 characters of readable content directly in the HTML — no security challenge, no JavaScript required.
Homepage content renders without JavaScript
PassThe homepage delivers 3,659 characters of content directly in the HTML — readable by every search engine and AI crawler without running JavaScript.
Homepage links are crawler-followable
Pass111 of 112 homepage links have valid destinations. The remaining 1 use `href="#"` or `javascript:` — typical for buttons/dropdowns and not a crawl concern at this scale.
Homepage has a clear main heading
PassMain heading (H1): "Supa GRO Pure Mycelium 0".
No structured data on the homepage (no schema markup)
HighThe homepage has no JSON-LD structured data. This is the machine-readable format that search engines and AI assistants use to understand who you are, what you sell, and what content you publish. Without it: no rich results in Google (price, ratings, availability), weaker brand entity recognition in AI search, and lower citation rates from ChatGPT / Claude / Perplexity.
Want to walk through the fixes together?
A 30-minute call to triage the failures, agree what blocks publishing, and slot the remediation into the content engine setup.


