agentos.guide › blog
Generative AI Search Engine Optimization Agency Groundwork: Do It First In Your Agent OS
A generative AI search engine optimization agency charges for groundwork that your Agent OS can largely prepare for you, so you walk into the first call with an audit already in hand.
This guide shows you how: a quick start, five copy-paste prompts and a clear line on when to hand the job to a pro.
Every prompt is draft-only, and if you want a person to review what your agent finds, book a free SEO strategy session.
What your agent is preparing for
Generative search means Google AI Overviews and AI Mode, ChatGPT search, Perplexity and Copilot writing answers and citing websites.
Google's AI features documentation says there are no extra requirements for AI Overviews or AI Mode: a page must be indexed and eligible to show with a snippet.
OpenAI's crawler overview says ChatGPT search needs OAI-SearchBot to be allowed, and Perplexity's crawler page says the same about PerplexityBot.
So the groundwork is about access, clear pages and consistent facts, which is exactly the kind of checking an agent is good at.
Quick start in five minutes
- Open your Agent OS and start a new project called "AI search audit".
- Give it your domain and, if you have one, a list of your ten most important URLs.
- Turn on browsing or fetching so it can read live pages and robots.txt.
- Set a standing rule: "Draft only. Never edit, publish, email or submit anything."
- Run the prompts below in order and save each output in the project.
Keep a human check at the end of every step; the agent gathers evidence, and you make the decisions.
Prompt 1: Technical audit of snippet and index controls
This hunts for tags that quietly remove pages from AI answers. Google's robots meta tag guide says nosnippet also blocks use as a direct input for AI Overviews and AI Mode.
You are my SEO auditor. Draft only: change nothing on the site.
Crawl https://example.co.uk (max 200 URLs). For every page, report:
- HTTP status and canonical URL
- meta robots and X-Robots-Tag values (flag noindex, nosnippet,
max-snippet, noarchive, nocache)
- any data-nosnippet elements and the text inside them
- whether the main content is present in the raw HTML or only after JavaScript
Output a table sorted by severity, then the 10 fixes you would make first.Swap example.co.uk for your domain. Expect a severity-sorted table you can hand to whoever manages the site.
Prompt 2: Robots.txt check for AI crawlers
Search bots and training bots are separate, and that distinction is where most robots.txt mistakes hide.
Anthropic's crawler help page separates ClaudeBot (training) from Claude-SearchBot (search), and Google says Google-Extended does not affect inclusion or ranking in Google Search.
Fetch robots.txt for example.co.uk and every subdomain you can find.
For each of these user agents, tell me if it is allowed, blocked or not
mentioned: Googlebot, Bingbot, OAI-SearchBot, GPTBot, PerplexityBot,
Claude-SearchBot, ClaudeBot, Google-Extended.
Then fetch one key page with each search bot's user-agent string and
report the status code, so I can spot firewall or CDN blocks.
Finish with a suggested robots.txt that allows the search bots.
Do not edit any file. Draft only.The status-code test matters because a firewall can block a bot that robots.txt allows.
🔥 Your agent found blocked bots or nosnippet tags?
My team can confirm which fixes matter most and which can wait. Book a free SEO strategy session and bring the audit with you.
Prompt 3: Draft your organisation schema
Structured data won't win AI citations on its own, and Google's generative AI optimisation guide says there is no special schema to add.
It still helps Google understand who you are and stays useful for rich results, so draft it from visible facts only.
Read the visible text on https://example.co.uk/ and /contact.
Draft Organization JSON-LD (use LocalBusiness if there is a public
address) using ONLY facts that appear on those pages: name, url, logo,
address, telephone, sameAs links to profiles linked from the site.
List any field you left out because it is not visible on the page.
Validate the JSON syntax. Draft only: do not publish.Google says structured data should match the visible text on the page, which is why the prompt forbids invented fields.
Prompt 4: Content brief from real buyer questions
Google's guide says AI features may use query fan-out, running related searches across subtopics before writing an answer.
Your page needs to answer the follow-up questions, not just the headline query.
Topic: emergency boiler repair for a small heating firm.
1. List the 12 follow-up questions a buyer is likely to ask, grouped
by stage (problem, options, choosing a firm).
2. For each, mark whether our current page answers it (quote the line)
or not.
3. Write a content brief for ONE improved page: headings, the facts
only our engineers can supply (mark them [ASK TEAM]), and what to cut.
Do not invent experience, numbers or reviews.The [ASK TEAM] markers are the point: Google's guide rewards non-commodity content built on first-hand experience, which no agent can invent.
Prompt 5: Outreach list research
Mentions from relevant sites help, but Google's spam policies say paid links must carry rel="sponsored" or rel="nofollow".
This prompt researches targets and stops there.
Research outreach targets for a family-run bakery in Leeds.
Find up to 20 relevant local or food sites that publish guest features,
supplier stories or business round-ups. For each: site, page URL, why it
fits, and a contact page if one is listed.
Exclude link farms, private blog networks and sites selling "dofollow" links.
Draft only: do not send any email or fill any form.Review every site by hand before you contact anyone, and write each pitch yourself.
How to read what your agent hands back
Agent output is evidence, not a verdict, so sort it before acting.
- Blocking issues first: a search bot blocked in robots.txt or by the firewall, or a noindex on a money page.
- Visibility limits next: nosnippet, a tiny max-snippet, or noarchive on pages you want cited in Copilot.
- Content gaps after that: buyer questions with no page answering them.
- Nice-to-haves last: schema tidy-ups and small wording changes.
Check any surprising finding by hand before you change anything, because agents sometimes misread a page that loads slowly.
If a fix touches hosting, DNS or the CDN, pass it to whoever manages those systems rather than letting the agent near them.
A weekly workflow that keeps it moving
- Monday: rerun Prompt 1 on pages changed last week.
- Tuesday: rerun Prompt 2 if anyone touched hosting, the CDN or robots.txt.
- Wednesday: pick one brief from Prompt 4 and have the right person add their experience.
- Thursday: check the Generative AI performance report in Search Console and the AI Performance report in Bing Webmaster Tools.
- Friday: ask the agent to summarise the week in five lines.
In analytics, ChatGPT visits usually appear with chatgpt.com as the source; that is our own observation, not an OpenAI rule.
A worked example: a small dental practice
- Run Prompt 2 and confirm OAI-SearchBot and PerplexityBot can reach the treatments pages.
- Run Prompt 1 and remove a stray nosnippet tag left over from an old site theme.
- Run Prompt 3 to draft LocalBusiness markup using the address and phone shown on the contact page.
- Run Prompt 4 for "emergency dentist" and ask the dentist to fill every [ASK TEAM] gap.
- Run Prompt 5 for local health and community sites, then review the list by hand.
That is a week of evening work for the practice manager, and every step is checkable.
What to skip, according to Google
- Building an llms.txt file to help Google: Google says Google Search ignores it, though other services may use one.
- Splitting pages into tiny "chunks" for AI.
- Rewriting content in a special style just for AI systems.
- Chasing inauthentic mentions across forums.
To learn the full agent workflow for AI SEO, the AI Profit Boardroom walks you through it step by step.
🔥 Learn AI SEO yourself with your Agent OS
Inside the AI Profit Boardroom you get step-by-step video trainings, the installable Agent OS and four live coaching calls a week.
When to hand it to a pro
Your agent can prepare evidence, but some jobs need experienced judgement; when you reach one, Book a free SEO strategy session.
- The audit shows site-wide blocks and you don't control the hosting or CDN.
- You run several locations or a large product catalogue.
- You need outreach done properly, at scale, within Google's link rules.
- You want monthly reporting across Google, Bing and ChatGPT tied to enquiries.
Google's advice on hiring an SEO says no one can guarantee a #1 ranking, so be wary of anyone who does.
If you do hand it over, Goldie Agency covers SEO, GEO, AEO and link building, and Julian's self-reported figures list 1,000+ campaigns for 240+ clients.
For the Google side in detail, see our guide to ranking in Google AI Overviews.
📞 Bring your agent's audit to a free call
Book a free SEO strategy session and my team will turn your five prompt outputs into a prioritised plan.
🎁 Free resources for your agent
Load the 200+ AI SEO Prompts into your Agent OS and read the free link building book before you run Prompt 5.
Also On Our Network
FAQ
Can my Agent OS replace a generative AI search engine optimization agency?
It can prepare most of the groundwork: audits, robots.txt checks, schema drafts and briefs. Decisions, first-hand content and outreach still need people.
Why should every prompt be draft-only?
So the agent never edits your live site, publishes pages or contacts anyone without a person checking first.
Which bots should my robots.txt allow for AI search?
Googlebot, Bingbot, OAI-SearchBot, PerplexityBot and Claude-SearchBot are the search crawlers. Training bots such as GPTBot, ClaudeBot and Google-Extended can be blocked separately.
Does schema help me appear in AI Overviews?
Google says no special schema is needed for its generative AI features, though structured data still helps Google understand your business and supports rich results.
Final word on Generative AI Search Engine Optimization Agency Groundwork
Run the five prompts, fix what you can, and book a free strategy session when you want a generative AI search engine optimization agency to take it further.
About Julian
I'm Julian Goldie, an AI entrepreneur, SEO expert and the founder of the AI Profit Boardroom, which has 3,400+ members.
I help business owners scale with AI agents, automation and SEO.
My YouTube channel has 400,000+ subscribers, and I run Goldie Agency, a seven-figure SEO agency.
Related guides on agentos.guide
→ Generative AI SEO Services: Prep 5 Of The 7 In Your Agent OS
→ Generative Engine Optimization Consultant Prep In Your Agent OS
→ GEO Agency UK Groundwork: 5 Agent OS Prompts To Run First
→ Best AI Search Agency: Vet Every Pick In Your Agent OS
Get the whole Agent OS
The installable system behind every guide on this site — dashboard, agents, memory and pipelines — updated as new tools land, with 3,400+ members and four coaching calls a week.
Join the AI Profit Boardroom →📺 Video notes + links to the tools 👉
🎥 Learn how I make these videos 👉