agentos.guide › blog
An AI search optimisation agency charges for groundwork your Agent OS can largely draft first: crawler checks, page audits, schema and briefs.
This guide gives you a quick start, five copy-paste prompts and a clear line for when the job should move to a professional.
If you'd like help reading the results, book a free SEO strategy session or go straight to Book a free SEO strategy session.
ai-search/ with sub-folders for audits, schema, briefs and outreach.changes.md log, so every fix you approve has a date beside it.Before you start, skim Google's guide to generative AI features.
It says optimising for AI search is still SEO, which keeps your agent focused on real fixes rather than fads.
| Platform | What it needs | Doc |
|---|---|---|
| Google AI Overviews and AI Mode | Indexed and snippet-eligible; no extra files or schema | AI features |
| ChatGPT search | OAI-SearchBot allowed, OpenAI IP ranges not blocked | OpenAI bots |
| Perplexity | PerplexityBot allowed, WAF rules set | Perplexity crawlers |
| Claude | Claude-SearchBot allowed | Anthropic crawlers |
| Copilot | Same crawl and index base as Bing; avoid NOARCHIVE and NOCACHE | Bing guidelines |
Start here, because a blocked search bot makes every other fix pointless for that platform.
You are my AI search access checker. Draft only: do not change any file.
1. Fetch https://[my-domain]/robots.txt and list every User-agent group.
2. For each of these bots, say ALLOWED, BLOCKED or NOT MENTIONED:
OAI-SearchBot, GPTBot, PerplexityBot, Claude-SearchBot, ClaudeBot,
Googlebot, Google-Extended, Bingbot.
3. Flag any search bot (OAI-SearchBot, PerplexityBot, Claude-SearchBot,
Googlebot, Bingbot) that is blocked or caught by a "User-agent: *" disallow.
4. Leave training bots (GPTBot, ClaudeBot, Google-Extended) as a question
for me, not a recommendation.
5. Output a table plus a proposed robots.txt diff I can approve.OpenAI notes that robots.txt changes take roughly a day to take effect, so rerun the check the next morning.
If robots.txt looks fine but a bot is still missing, ask whoever runs your CDN or firewall: both OpenAI and Perplexity ask sites to allow their published IP ranges.
Next, find anything that hides your best pages from AI answers.
Audit these 10 URLs for AI search eligibility. Read the rendered HTML.
For each URL report:
- HTTP status and canonical URL
- robots meta tag and X-Robots-Tag (flag noindex, nosnippet, max-snippet, noarchive, nocache)
- any data-nosnippet sections and what text they hide
- whether the main answer appears as text in the first 150 words
- whether key facts sit only in images, tabs or scripts
Rank problems by impact. Do not edit the site. Save as audit-[date].md.This matters because Google's robots meta tag docs say nosnippet also keeps a page out of AI Overviews and AI Mode as a direct input.
Bing is replacing NOARCHIVE and NOCACHE with new training and grounding preferences from 1 February 2027, per its October 2026 post, so flag any page still using them.
📞 Want a second pair of eyes on what your agent finds?
Get a free SEO strategy session and my team will go through your crawler check and audit output with you. Or Book a free SEO strategy session straight away.
Structured data is not required for AI features, but it helps engines identify your business, and Bing asks for consistent entity names.
Draft Organization JSON-LD for my home page using ONLY these facts:
name: [legal trading name]
url: [home page]
logo: [logo URL]
sameAs: [profiles we own, one per line]
If we have a premises or service area, also draft the matching LocalBusiness
subtype with address and opening hours from [our contact page].
Every value must already appear on the visible page. List any fact you
could not find instead of guessing. Draft only.Check the draft against Google's Organization documentation before anything goes live, and make sure your Business Profile shows the same name, address and phone.
Google rates unique, first-hand content as the thing most likely to help in AI search over time.
Your agent can structure that, but the substance has to come from you.
Write a content brief for our [service] page.
Inputs: the call notes in /notes/[service].md and our current page.
The brief must include:
- the question a customer asks, answered in the first two sentences
- three things only we can say (process, real examples, our own data)
- the five questions customers ask before buying, one section each
- what to cut: anything generic a competitor could also say
No keyword lists, no extra pages for query variations. One page, one topic.🔥 Get the Agent OS these prompts run in
The AI Profit Boardroom is where you learn AI SEO yourself: step-by-step trainings, the installable Agent OS and four live coaching calls a week.
Mentions and links from relevant sites help both classic ranking and AI answers, as long as they stay inside the rules.
Research outreach targets for [business] in [niche/town]. Draft only.
1. Find 20 relevant sites: local press, trade bodies, suppliers, event pages.
2. For each, note why a link or mention would help a reader, the contact page
URL, and one idea we could genuinely offer (guide, data, quote).
3. Exclude link farms, private blog networks and sites selling links.
4. If any placement would be paid, mark it "needs rel=sponsored".
5. Write first-draft emails but DO NOT send anything.Google's link spam policy rules out buying links that pass ranking credit, and paid placements should carry rel="sponsored".
A person approves every email before it goes.
For the ChatGPT side of the same job, see our guide on how to rank in ChatGPT.
changes.md log tells you which fix lines up with which movement.Five prompts give you five files, which is too many to act on at once.
Ask your agent to merge them into a single plan with three columns: fix, effort and who does it.
Keep the plan short enough to read in two minutes.
If a line on it does not trace back to a document from Google, OpenAI, Bing, Perplexity or Anthropic, or to a real customer question, cut it.
An agent with good prompts and bad limits can cause more harm than no agent at all.
Write these into its standing instructions:
Google's advice on hiring an SEO reminds owners that they answer for the work done on their site.
The same applies when the worker is your own agent.
🎁 Two free add-ons for your agent
Load the 200+ AI SEO Prompts into your prompt library, and read the free link building book before Prompt 5 drafts a single email.
Your Agent OS is excellent at finding problems and drafting fixes.
Hand over when any of these is true:
Nobody, agent or agency, can guarantee a ranking or a citation; Google, OpenAI and Bing all say so.
What a strategy session gives you is a plan built on what your agent found.
The session is run by Goldie Agency, which covers SEO, GEO, AEO and link building through manual outreach, no PBNs.
By Julian Goldie's own published numbers, the team has worked on 1,000+ SEO and link building campaigns for 240+ clients, and Julian shares the AI search tests behind it with 425K+ YouTube subscribers.
📞 Ready to hand it to a pro?
Book a free SEO strategy session and bring your agent's audit file; we will turn it into a plan for Google, ChatGPT, Perplexity and Copilot.
It can draft much of the groundwork: crawler checks, audits, schema and briefs. Outreach, judgement calls and complex technical fixes still benefit from experienced people.
No. Keep it on draft only, approve each change yourself, and log the date so you can match fixes to movement in the reports.
The search bots: OAI-SearchBot, PerplexityBot, Claude-SearchBot, Googlebot and Bingbot. Training bots such as GPTBot, ClaudeBot and Google-Extended are your own decision.
Not for Google. Google says its Search doesn't use llms.txt, so it isn't part of these prompts.
Watch AI impressions in Search Console, citations in Bing Webmaster Tools and chatgpt.com referrals in analytics, alongside your change log.
Run Prompt 1 today, approve the fixes you agree with, and book a free strategy session when you are ready to hand the next stage to an ai search optimisation agency.
About Julian
I'm Julian Goldie, an AI entrepreneur, SEO expert and the founder of the AI Profit Boardroom, which has 3,400+ members.
I help business owners scale with AI agents, automation and SEO.
My YouTube channel has 400,000+ subscribers, and I run Goldie Agency, a seven-figure SEO agency.
→ AI Search Optimization Services: Prep It In Your Agent OS
→ GEO Agency UK Groundwork: 5 Agent OS Prompts To Run First
→ AEO Agency UK Groundwork: 5 Prompts For Your Agent OS
→ Rank In Google AI Overviews: 5 Agent OS Prompts To Start
The installable system behind every guide on this site — dashboard, agents, memory and pipelines — updated as new tools land, with 3,400+ members and four coaching calls a week.
Join the AI Profit Boardroom →📺 Video notes + links to the tools 👉
🎥 Learn how I make these videos 👉