agentos.guide › blog
Your Agent OS can do most of the groundwork on how to get cited by AI: checking crawler rules, flagging pages that hide snippets, and turning customer questions into page briefs.
Book a free SEO strategy session →
This guide gives you a quick start, five copy-paste prompts and a weekly loop, then shows where a person has to take over.
If you'd rather skip to a finished plan, book a free SEO strategy session with Goldie Agency.
An agent that believes in AI "hacks" will waste your afternoon, so load the platform docs before anything else.
Google's AI features page says AI Overviews and AI Mode have no extra requirements beyond SEO best practice.
Its generative AI optimisation guide says AEO and GEO work is still SEO, and that Google Search doesn't use llms.txt.
For the other engines, the crawler pages are the rulebook: OpenAI's bots overview, Perplexity's crawler guide and Anthropic's crawler article.
Save those links in rules.md and tell the agent to cite one of them for every recommendation it makes.
ai-citations in your Agent OS workspace.rules.md with the five links above.pages.txt listing your 10 to 20 most important URLs, one per line.questions.txt with real customer questions copied from emails, calls and reviews.Fetch https://YOURDOMAIN/robots.txt.
For each of these user agents, say whether it is allowed to crawl / :
OAI-SearchBot, PerplexityBot, Claude-SearchBot, GPTBot, ClaudeBot, Google-Extended.
Group them as SEARCH (OAI-SearchBot, PerplexityBot, Claude-SearchBot) and TRAINING (GPTBot, ClaudeBot, Google-Extended).
Flag any SEARCH crawler that is blocked, including by a User-agent: * rule.
Write the result to robots-check.md with the exact lines that cause each block.
Cite rules.md for each finding. Do not suggest edits to TRAINING rules; list them only.
Per OpenAI, a blocked OAI-SearchBot keeps your pages out of ChatGPT search answers, while GPTBot only covers training.
Anthropic says blocking Claude-SearchBot may reduce your visibility in user search results, and Perplexity says PerplexityBot surfaces and links sites.
Robots.txt is only half the story, so ask whoever runs your CDN or firewall to confirm no bot setting challenges those crawlers.
Book a free SEO strategy session →
🔥 Want these prompts ready-made in your Agent OS?
Inside the AI Profit Boardroom you learn AI SEO yourself: step-by-step video trainings, the installable Agent OS and four coaching calls a week.
For each URL in pages.txt, fetch the page and its response headers.
Report any of these: meta robots noindex, nosnippet, max-snippet:0,
an X-Robots-Tag header with noindex or nosnippet,
and any data-nosnippet attribute wrapped around the main answer text.
Output a table in snippet-check.md: URL, problem, exact tag or header.
Do not guess. If a page fails to load, say so and move on.
Google explains each of those controls on its robots meta tag page.
Google's AI features only link pages eligible for a snippet, so clear these flags before any writing starts.
Read questions.txt and pages.txt.
Group the questions by topic and match each group to the closest URL, or mark NEW PAGE.
For each group, write a brief in briefs/TOPIC.md with:
1. the direct answer in two sentences, marked DRAFT, for me to check
2. a list of first-hand details I must supply (photos, steps, numbers from our own work)
3. 4 to 6 FAQ questions taken word for word from questions.txt
Never invent figures, prices, reviews or customer names. Leave a TODO where you need a fact from me.
Google's guide favours a distinct, first-hand perspective over generic tips, so the agent leaves gaps for your own material instead of padding them.
Want a library of tested prompts like this one? Learn AI SEO yourself inside the AI Profit Boardroom, where the workflows are already built.
Take briefs/TOPIC.md and the current page at URL.
Propose a new outline: one H2 per buyer question, one comparison table, and a short FAQ.
Mark every claim that needs a source, and suggest the primary source to cite.
Write the outline to outlines/TOPIC.md. Do not rewrite the copy yet.
Bing's AI Performance announcement recommends clear headings, tables and FAQ sections, backed by examples, data and cited sources.
Book a free SEO strategy session →
You or a writer then fill the outline with your own detail.
Keep the agent's source suggestions in the outline, so every claim on the finished page links to the document it came from.
I will paste three exports each month:
1. Search Console Generative AI performance report (pages and impressions)
2. Bing Webmaster Tools AI Performance (citations and cited pages)
3. Analytics referrals filtered to source chatgpt.com
Merge them into citation-log.csv with one row per page and one column per source.
Compare with last month and list pages that gained or lost.
Do not treat Bing citation counts as rankings.
Search Console's Generative AI performance report counts impressions from AI Overviews and AI Mode, not clicks.
Bing says its citation counts don't indicate placement, ranking or authority, which is why the prompt says so.
OpenAI's help centre says ChatGPT adds a chatgpt.com source tag to referral links; no source documents an equivalent for Perplexity or Claude.
| Day | Agent does | You do |
|---|---|---|
| Monday | Runs prompts 1 and 2 | Fix any blocked search crawler or hidden snippet |
| Tuesday | Runs prompt 3 on new questions | Supply photos, steps and real numbers |
| Wednesday | Runs prompt 4 | Write or approve the page copy |
| Thursday | Lists changed URLs | Publish and send an IndexNow ping |
| Month end | Runs prompt 5 | Read the log and pick next month's pages |
The IndexNow documentation explains the ping, and Bing recommends it for added, updated or removed URLs.
After any robots.txt change, wait a full day before checking ChatGPT; OpenAI says its systems take about 24 hours to catch up.
robots-check.md.Book a free SEO strategy session →
User-agent: * block left over from a staging site. The owner removes it and allows the three search crawlers.nosnippet on the wholesale page. The developer takes it off.For a wider check of where you appear today, pair this with the AI visibility audit prompts on this site.
If a vendor owns your firewall, if the briefs pile up faster than you can write, or if the site needs coverage from real publications, bring in a team.
Goldie Agency's services span SEO, GEO, AEO and link building, with link work it labels "manual outreach, no PBNs."
In Julian's own published figures on his about page, the agency has served more than 240 clients across over a thousand campaigns.
Bring your citation-log.csv, robots-check.md and the briefs folder to the call, and the team will pick up exactly where your agent stopped.
That handover is quicker than starting cold, because the blockers, the questions and the baseline numbers are already written down; book a free SEO strategy session once the first log exists.
📞 Turn your agent's findings into a plan
Book a free SEO strategy session and get the blockers, rewrite order and tracking set up with the team.
Rather keep learning AI SEO yourself? The AI Profit Boardroom has the full workflows.
Free extras: 200+ AI SEO Prompts to extend your agent's toolkit, and the free link building book if outreach is next.
Want a slot now? Book a free SEO strategy session.
Book a free SEO strategy session →
Keep it on draft-only. Let the agent report which crawlers are blocked and why, then change robots.txt yourself or through your developer.
OAI-SearchBot, PerplexityBot and Claude-SearchBot, the three search crawlers. GPTBot, ClaudeBot and Google-Extended are training controls and a separate decision.
Google asks for first-hand experience and says summaries of other pages add little, so the agent marks where your own photos, steps and numbers belong.
Search Console generative AI impressions, Bing AI Performance citations and ChatGPT referrals from analytics, one row per page.
Run the five prompts this week, keep the loop going, and book a free strategy session when you want a pro to finish how to get cited by AI.
About Julian
I'm Julian Goldie, an AI entrepreneur, SEO expert and the founder of the AI Profit Boardroom, which has 3,400+ members.
I help business owners scale with AI agents, automation and SEO.
My YouTube channel has 400,000+ subscribers, and I run Goldie Agency, a seven-figure SEO agency.
→ Brand Visibility In AI Search: Track It In Your Agent OS
→ AI Visibility Audit: 5 Agent OS Prompts To Run It
→ Perplexity SEO Agency Prep: 5 Agent OS Prompts To Run First
→ ChatGPT SEO Agency Groundwork: 5 Agent OS Prompts
The installable system behind every guide on this site — dashboard, agents, memory and pipelines — updated as new tools land, with 3,400+ members and four coaching calls a week.
Join the AI Profit Boardroom →📺 Video notes + links to the tools 👉
🎥 Learn how I make these videos 👉