agentos.guide › blog
Before you pay a GEO specialist, your Agent OS can do the groundwork: crawler checks, snippet sweeps, schema drafts and content briefs.
This guide gives you a quick start, five copy-paste prompts and a clear line for when to hand over to a professional.
If you'd rather skip straight to an expert view, book a free strategy session with Julian's team.
GEO, or generative engine optimisation, is about being found and cited in AI answers.
Google's guide to optimising for generative AI features frames it as ordinary SEO aimed at AI results, so the groundwork is familiar.
Your agent can gather the facts in an afternoon.
That means any GEO specialist you hire later starts from evidence rather than guesswork, and you can judge their plan against it.
geo-groundwork and drop in your sitemap URL and a list of your ten most important pages.Each AI platform names its own search bot, and blocking it can keep you out of that platform's answers.
OpenAI, Perplexity and Anthropic all document theirs.
Fetch https://[yourdomain]/robots.txt.
For each user agent below, tell me whether it is allowed,
blocked, or not mentioned, and quote the exact line:
Googlebot, Bingbot, OAI-SearchBot, GPTBot, ChatGPT-User,
PerplexityBot, Perplexity-User, Claude-SearchBot, ClaudeBot,
Claude-User, Google-Extended.
Then fetch three of my key pages with a plain request and
report any 403 or challenge page, which may mean a firewall
or CDN rule is blocking bots.
Save the result as crawler-audit.md. Do not edit anything.
Read the output carefully.
Google says Google-Extended doesn't affect inclusion in Search, per its crawler documentation, so don't panic if it's blocked.
Googlebot is the one that matters for AI Overviews and AI Mode.
| Result | What it means | What to do |
|---|---|---|
| OAI-SearchBot blocked | OpenAI says blocked sites won't appear in ChatGPT search answers | Allow it, unless you deliberately want out |
| GPTBot or ClaudeBot blocked | Training opt-out only; search bots are separate | Your call; leave as is if intended |
| PerplexityBot not mentioned | Covered by your default rule | Check the default isn't a blanket disallow |
| 403 or challenge page | A firewall or CDN may be stopping bots before robots.txt matters | Ask your host to allow the published IP ranges |
| Google-Extended blocked | Google says this doesn't affect Search inclusion | No action needed for AI Overviews |
Note that user-triggered fetchers such as ChatGPT-User and Perplexity-User may not follow robots.txt in the same way, according to their own documentation.
So the search bots are the lines to focus on.
Crawl the URLs in pages.txt. For each one, report:
- the robots meta tag and X-Robots-Tag header, if any
- whether nosnippet, max-snippet or noindex appears
- any elements carrying the data-nosnippet attribute
Flag any money page where these rules would stop Google
using the text in AI Overviews or AI Mode.
Save as snippet-sweep.md. Draft only.
Google's robots meta tag spec explains that nosnippet also keeps a page out of AI Overviews and AI Mode as direct input.
One stray tag on a template can undo a lot of good content.
📞 Want an expert to read your crawler audit?
Julian's team can go through your agent's findings with you and turn them into a GEO plan. Book a free SEO strategy session to get started.
Read my About page and Contact page.
Draft JSON-LD using schema.org Organization (or LocalBusiness
if we serve customers at a location or in a service area).
Include name, url, logo, address, telephone and sameAs links
to our official profiles only.
Every value must match text visible on my site; list any
value you could not confirm instead of guessing.
Save as schema-draft.json. Do not publish.
Google's Organisation markup docs describe how this helps it tell your business apart from others with similar names.
Google also says there's no special schema needed for AI features, so treat this as clarity, not a shortcut.
For the page [URL], list the 8 questions a buyer would ask
an AI assistant before choosing a business like mine.
For each question, mark whether my page answers it, partly
answers it, or misses it.
Then suggest first-hand material only I can provide: our
process, real examples, photos, numbers we publish.
Do not write the page. Save as brief-[slug].md.
The reason this prompt asks for first-hand material is Google's push for "non-commodity" content.
A brief like this is exactly what a good GEO specialist should produce in week one.
Find 20 websites relevant to [industry] in [area] that
already feature businesses like mine: trade bodies, local
news, supplier blogs, partner directories.
For each, note why it fits and how they accept submissions.
Draft a short, fair outreach note for the top five.
Draft only. Do not send any email.
Keep it accurate.
Google's spam policies cover links made to manipulate rankings, and paid placements need rel="sponsored", per its link qualification guidance.
Once the first pass is done, rerun Prompts 1 and 2 at the start of every month.
Hosting changes, theme updates and new plugins can quietly re-block bots or add snippet rules.
Run Prompt 4 on one new page each fortnight, and Prompt 5 once a quarter.
Ten minutes of reading a fresh report each month is enough to catch most problems before they cost you visibility.
Note your starting numbers before anything goes live.
Google's Search Console generative AI reports show impressions and pages in AI features.
Bing Webmaster Tools' AI Performance report shows citations in Copilot.
In our experience, ChatGPT referrals appear in analytics with chatgpt.com as the source.
Review after four to six weeks, not the next morning.
Hand over when the findings outgrow your hours.
That usually means firewall changes you can't make yourself, more than a handful of pages to rewrite, or outreach you'll never get round to.
Take your agent's files to the call, and ask any GEO specialist the questions on Google's hiring an SEO page, including whether their GEO advice matches Google's own guidance.
Walk away from anyone who guarantees a ChatGPT mention or a #1 ranking.
Want the companion piece? Read what an AEO specialist does on this site.
To learn AI SEO yourself in depth, the AI Profit Boardroom teaches the full Agent OS workflow.
🔥 Turn these prompts into a weekly routine
Inside the AI Profit Boardroom you get step-by-step trainings, the installable Agent OS, four coaching calls a week and daily Q&A to learn AI SEO yourself.
📞 Ready for a GEO plan built on your groundwork?
Book a free SEO strategy session and Goldie Agency will review your audit files and map the next steps.
📘 Two free resources to go with your prompts
Grab 200+ AI SEO Prompts for more audits and briefs, plus the free link building book for the outreach side.
It can do the fact-finding: crawler checks, snippet sweeps, schema drafts and briefs. Judgement, firewall changes and outreach still need a person.
Keep it read-only and draft-only. Give it fetch access, no CMS login, and a rule to ask before any action outside its project folder.
The search bots: OAI-SearchBot for ChatGPT, PerplexityBot for Perplexity and Claude-SearchBot for Claude, plus Googlebot and Bingbot. Training bots are a separate choice.
OpenAI says robots.txt changes take about a day to register, but content and mentions take weeks, so review after four to six weeks.
Run the five prompts, keep everything as drafts, then book a free strategy session or learn the full workflow in the AI Profit Boardroom before you brief a geo specialist.
About Julian
I'm Julian Goldie, an AI entrepreneur, SEO expert and the founder of the AI Profit Boardroom, which has 3,400+ members.
I help business owners scale with AI agents, automation and SEO.
My YouTube channel has 400,000+ subscribers, and I run Goldie Agency, a seven-figure SEO agency.
→ AEO Specialist Groundwork: Run It In Your Agent OS
→ GEO Agency UK Groundwork: 5 Agent OS Prompts To Run First
→ Rank In Google AI Overviews: 5 Agent OS Prompts To Start
→ AI Search Optimisation Agency Groundwork In Your Agent OS
The installable system behind every guide on this site — dashboard, agents, memory and pipelines — updated as new tools land, with 3,400+ members and four coaching calls a week.
Join the AI Profit Boardroom →📺 Video notes + links to the tools 👉
🎥 Learn how I make these videos 👉