Run all of this inside the full Agent OS — join the AI Profit Boardroom →

agentos.guide › blog

AEO Specialist Groundwork In Your Agent OS: Five Copy-Paste Prompts For The Audit, Crawler Check, Schema, Briefs And Outreach Research

By Julian Goldie · 11 November 2026 · agentos.guide

Illustrated hero: a gold-lit agent console scanning a website map, with crawler paths, a checklist and a schema card on a dark aubergine background

An AEO specialist spends a surprising share of every week on groundwork that an agent can do faster: fetching robots.txt files, reading meta tags, listing customer questions and drafting markup.

Your Agent OS can run that groundwork for you, as long as it reports and drafts rather than changing your live site.

Google's own guide to generative AI search calls AEO and GEO "still SEO", so these prompts stick to fundamentals rather than tricks.

If you would rather have my team review the output with you, book a free SEO strategy session.

Quick start: set up the workspace

Before you paste a prompt, give your agent a clean place to work.

  1. Create a folder called aeo-groundwork with subfolders for audit, briefs and schema.

2. Add a text file listing your domain and your ten most important page URLs.

3. Add a second file with your business name, address, phone, hours and services exactly as they should appear everywhere.

4. Tell the agent the rule for the whole job: read-only on the website, draft-only for anything that would be published or sent.

That last rule matters most, because every change and every message should pass through you.

Prompt 1: the priority-page audit

This prompt checks the pages you most want cited, using the same controls Google documents for AI features.

You are doing AEO groundwork for [domain]. Read-only: do not change anything.
For each URL in priority-urls.txt:
1. Fetch it and record the HTTP status and final URL after redirects.
2. Record any robots meta tag and X-Robots-Tag header, flagging noindex, nosnippet, max-snippet, NOARCHIVE or NOCACHE.
3. Note whether the main answer text sits inside an element with data-nosnippet.
4. Copy the first two sentences of the main content and say whether they directly answer the page's main question.
5. Note whether the key content is present in the raw HTML or only after JavaScript runs.
Save the results as audit/page-audit.csv and write a summary of the five worst problems in audit/summary.md.

Google's robots meta tag reference confirms nosnippet also applies to AI Overviews and AI Mode.

Bing's Webmaster Guidelines add that NOARCHIVE keeps content out of Copilot answers.

Prompt 2: robots.txt check for AI crawlers

Search crawlers and training crawlers are separate, and the agent should report them separately.

Fetch https://[domain]/robots.txt. Read-only.
Make a table with one row per user agent:
Googlebot, Bingbot, OAI-SearchBot, PerplexityBot, Claude-SearchBot,
GPTBot, ClaudeBot, Google-Extended, ChatGPT-User, Perplexity-User, Claude-User.
For each, state: allowed, blocked, or not mentioned (falls back to *), and quote the exact lines that apply.
Mark which agents are for search and which are for training, using only the official docs:
developers.openai.com/api/docs/bots, docs.perplexity.ai crawler page, support.claude.com crawler article,
and Google's common crawlers page.
Flag any search crawler that is blocked. Do not recommend changes to training crawlers; list them as my decision.
Save as audit/robots-check.md.

OpenAI's crawler overview says a site opted out of OAI-SearchBot will not be shown in ChatGPT search answers.

Perplexity's crawler page recommends allowing PerplexityBot and its IP ranges, and Anthropic's crawler article says blocking Claude-SearchBot may reduce your visibility in Claude's search.

Robots.txt is not the whole story: a firewall or CDN can still block a bot the file allows, so check your provider's bot settings by hand.

🔥 Your robots check flagged a blocked search bot?

Bring the report to a call and we will tell you which fix comes first. Book a free SEO strategy session.

→ Claim your free strategy session

Prompt 3: draft the schema, do not publish it

Structured data is hygiene, not a shortcut, and it must match what visitors see.

Using business-facts.txt and the visible text of https://[domain]/ and /contact,
draft JSON-LD for one Organization (or the most specific LocalBusiness subtype that fits).
Rules:
- Use only facts that appear on the visible page or in business-facts.txt.
- Include name, url, logo, address, telephone, openingHours and sameAs links to official profiles I list.
- Where the page and business-facts.txt disagree, do not guess: list the conflict.
Save the draft to schema/organization.json and the conflicts to schema/conflicts.md.
Draft only. Do not add it to the site.

Google's Organization markup guide explains how sameAs and organisation details help it tell businesses apart.

Google also says there is no special schema.org markup required for AI features, so ignore anyone selling "AI schema".

Prompt 4: a content brief from real questions

Google rewards what it calls non-commodity content, meaning first-hand detail beyond common knowledge.

Read the files in /inputs: call notes, reviews and support emails.
1. List every distinct question a customer asks, in their own words, with the file and line it came from.
2. Group them into topics and pick the five topics that come up most.
3. For the top topic, write a brief: the plain answer to open with, follow-up questions a buyer would ask next,
   and five interview questions I should answer so the page has first-hand detail only we can give.
Do not write the page itself. Do not invent statistics, prices or customer stories.
Save as briefs/brief-01.md.

Write one strong page per real problem, because Google warns that pages built for every query variation can fall foul of its scaled content abuse policy.

Prompt 5: outreach list research, draft only

Mentions on trusted sites help, but they have to be real.

Research only. Do not send, submit or sign up for anything.
Find 20 relevant websites for a [business type] in [area or niche]: local news, trade associations,
industry blogs and supplier directories that list businesses like ours.
For each: name, URL, why it is relevant, and the public contact page.
Then draft (do not send) a short, personal pitch for the top five, offering something useful such as a guide or expert comment.
Save as outreach/targets.csv and outreach/drafts.md.

Google's guide says chasing inauthentic mentions is less helpful than it seems, and its spam policies require rel="sponsored" or nofollow on any paid placement.

You read and send every message yourself.

🧠 Want the Agent OS that runs these prompts?

Inside the AI Profit Boardroom you get the installable Agent OS, step-by-step video trainings and four live coaching calls a week to learn AI SEO yourself.

→ Join the AI Profit Boardroom

How to read what the agent hands back

The output is only useful if you sort it quickly, so triage it in this order.

  1. Blocked search crawlers: fix these first, because no content work matters while a bot cannot reach the page. OpenAI notes a robots.txt change can take around 24 hours to show up for ChatGPT search.

2. Preview tags: a stray nosnippet or NOARCHIVE on a service page costs you AI answers on Google or Copilot, so remove it unless you chose it on purpose.

3. Weak openings: any page whose first two sentences do not answer its main question goes to the top of the rewrite list.

4. Fact conflicts: different phone numbers or hours across pages and profiles get fixed at the source, then the schema draft is rerun.

5. Everything else: nice-to-haves go in a backlog you review monthly.

Keep each week's files rather than overwriting them, so you and your agent can compare this week with last week and spot anything a site update broke.

The split between you and your agents

Think of the Agent OS as the junior on the team and yourself as the specialist signing off the work.

A weekly loop for a small business

Here is how a two-person bakery with a catering side might run it.

  1. Monday: run Prompt 2 and Prompt 1 on the five catering pages, and fix anything flagged with the web developer.

2. Tuesday: run Prompt 4 on last week's catering enquiries and spend twenty minutes answering the interview questions.

3. Wednesday: write the page from the brief, then ask the agent to check it against the brief and list anything missing.

4. Thursday: run Prompt 3 after any change to hours or address, and paste the draft into the site once you have checked it.

5. Friday: note AI impressions from Search Console's generative AI performance report, plus any ChatGPT visits in analytics, which in our accounts usually show chatgpt.com as the source.

What your agent should never do here

When to hand it to a pro

The prompts get you a clear picture, but some findings need an expert.

That is the point to book a strategy session: bring your audit folder, and an experienced team can turn it into a plan.

Goldie Agency works across SEO, GEO, AEO and link building, and describes its link building as "manual outreach, no PBNs".

Google's hiring guidance is a good filter too: give read-only Search Console access during any audit, and walk away from anyone who guarantees a #1 ranking.

🔥 Groundwork done? Let a team take the next step.

Book a free SEO strategy session and share your audit folder on the call.

→ Book your strategy session

🎁 Two free add-ons for your prompt library

Download the 200+ AI SEO Prompts to extend Prompts 1 and 4, and the free link building book to go further with Prompt 5.

→ Learn AI SEO yourself in the AI Profit Boardroom

If your Agent OS findings raise more questions than answers, grab a free SEO strategy session and walk through them with Julian's team.

Also On Our Network

FAQ

Can my Agent OS replace an AEO specialist?

It can do the fetching, comparing and drafting. Decisions about what to publish, which bots to block and which outreach to send still need a person.

Will these prompts change my website?

No. Every prompt is written as read-only or draft-only, so the agent reports and drafts while you make the changes.

Which crawlers should the robots.txt check look for?

Googlebot, Bingbot, OAI-SearchBot, PerplexityBot and Claude-SearchBot for search, plus GPTBot, ClaudeBot and Google-Extended as separate training choices.

Should the schema prompt add special AI markup?

No. Google says there is no special schema.org markup for AI features, so the prompt drafts ordinary Organization or LocalBusiness markup that matches the page.

When should I hand the work to a professional?

When the audit shows firewall blocks, conflicting business facts across many listings, or you need answer pages and links every week.

Final word on AEO Specialist Groundwork In Your Agent OS

Run Prompt 1 today, fix what it finds, and when the list outgrows your week, book a free SEO strategy session with a seasoned AEO specialist.

About Julian

I'm Julian Goldie, an AI entrepreneur, SEO expert and the founder of the AI Profit Boardroom, which has 3,400+ members.

I help business owners scale with AI agents, automation and SEO.

My YouTube channel has 400,000+ subscribers, and I run Goldie Agency, a seven-figure SEO agency.

→ Get my best AI training inside the AI Profit Boardroom

Related guides on agentos.guide

→ GEO Specialist Groundwork: 5 Prompts For Your Agent OS

→ AEO Agency UK Groundwork: 5 Prompts For Your Agent OS

→ How To Rank In ChatGPT: 5 Prompts For Your Agent OS

→ ChatGPT SEO Agency Groundwork: 5 Agent OS Prompts

Get the whole Agent OS

The installable system behind every guide on this site — dashboard, agents, memory and pipelines — updated as new tools land, with 3,400+ members and four coaching calls a week.

Join the AI Profit Boardroom →

📺 Video notes + links to the tools 👉

🎥 Learn how I make these videos 👉

🆓 Get a FREE AI Course + Community + 1,000 AI Agents 👉

← all guides on agentos.guide