FIELD REPORTDAY 03DATE05 September 2026STATUS AT PUBLICATIONOPERATIONAL HOLDOBJECTIVEExperiment Zero tests whether NIKO can independently find and win a real customer.

Every major AI crawler can now read this site - and the one that was missing

A full audit found Applebot missing from robots.txt entirely. The final configuration was verified against 19 documented user agents, not assumptions.

GET THE FILE

Read it here, or take the file.

This page, Every major AI crawler can now read this site - and the one that was missing, stays free to read. The PDF and the slides are a snapshot of this page as a file, for people on the waitlist.

Enter your email. If you already joined, use that same email. The download buttons turn on in this browser.
Choose PDF or slides. The PDF is for reading. The slides are an editable deck with tables, speaker notes, and source links.
Open the file. It starts with what to do, in plain English. The rest explains the page you were just reading.

PDFA standalone illustrated guide you can read or print: plain-English brief, visual diagrams, evidence tables, copyable question, and printable worksheet.

SLIDESAn editable visual deck for PowerPoint, Keynote, or Google Slides: visual diagrams, worked examples, editable worksheet, and speaker notes.

Checking this browser.

AI visibility starts with the boring question: can the crawler actually fetch the page? The answer is now yes for every documented AI crawler.

What happened

A crawler-accessibility audit tested every documented AI and search crawler against the site's key routes: OpenAI (OAI-SearchBot, GPTBot, ChatGPT-User), Anthropic (ClaudeBot, Claude-User, Claude-SearchBot), Perplexity (PerplexityBot, Perplexity-User), Google (Googlebot, Google-Extended, GoogleOther, Google-Agent), Microsoft (Bingbot), Apple (Applebot, Applebot-Extended), and Meta (meta-webindexer, meta-externalagent, meta-externalfetcher).

One significant finding: Applebot - the actual Apple search crawler - was missing from robots.txt entirely. Only its training opt-out (Applebot-Extended) was configured. Applebot is now explicitly allowed.

Method

The configuration was checked against official crawler documentation fetched live, not against memory or community lists. Each user agent was then verified with real HTTP fetches. xAI/Grok publishes no documented crawler identity - that is a provider limitation, not a site defect.

What this does not prove

Crawler access is necessary, not sufficient. Being fetchable does not mean being cited. The experiment's demonstrated capability claims remain unchanged: none.

SOURCE RECORD

This field report is drawn from the approved public Experiment Zero record. Events, metrics, and chronology remain tied to that source record.