Prompt
How do I see if AI search visibility changed after we updated our website?
Latest observation
To see whether your AI search visibility changed after a website update, you want to compare before vs. after across a few AI/search surfaces, not just traditional Google rankings.
1) Define the date of the update
Pick the exact date/time of the site change and use that as your split point:
- Pre-update period: 2–4 weeks before
- Post-update period: 2–4 weeks after
If the change was major, it’s often worth checking a longer window because AI/search systems can lag.
2) Track visibility on AI search surfaces
Check how often your site appears in results from:
- Google AI Overviews
- Bing Copilot / AI answers
- ChatGPT with browsing/search
- Perplexity
- Any industry-specific AI search tools your audience uses
Look for:
- Whether your brand/site is mentioned more or less often
- Whether your pages are cited
- Whether the answer text reflects your updated content
- Whether competitors replaced you in citations
3) Use a repeatable query set
Create a list of 20–50 queries that matter to your business, such as:
- Problem/solution queries
- Comparison queries
- “Best X for Y” queries
- Branded queries
- Support/how-to questions
Then run the same queries before and after the update, and record:
- If your site appears
- Position/order of citation
- Whether a snippet or summary references your content
- Which URL is cited
A simple spreadsheet works well.
4) Check search console and analytics for indirect signals
Even if AI platforms don’t give perfect visibility data, you can infer changes from:
- Google Search Console
- Clicks, impressions, CTR, and average position
- Query-level changes
- Page-level changes
- Bing Webmaster Tools
- Analytics
- Organic traffic changes to updated pages
- Traffic from referral sources that may indicate AI tools
- Engagement changes on landing pages
If impressions rise but clicks fall, your content may be showing in AI/search surfaces but being answered directly.
5) Compare the content that AI systems can access
After the update, check whether you changed things that AI systems rely on:
- Title tags and headings
- Clearer answers near the top of the page
- Schema markup
- Internal links
- Canonical tags
- Indexing directives
- Page speed / rendering
- Removal of content that used to help with answers
Sometimes visibility drops because the updated page is less readable to search and AI systems.
6) Watch for citations and mention quality, not just rankings
AI search often values:
- Clear definitions
- Structured content
- Authoritativeness
- Freshness
- Citability
So track:
- Number of citations
- Whether your brand is named in AI answers
- Whether the answer uses your wording accurately
- Whether the AI cites an old or new URL
7) If possible, automate monitoring
If you do this often, use tools that monitor AI visibility and citations over time. Depending on your budget, you can use:
- SEO platforms with AI visibility tracking
- Custom scripts that run your target queries
- Manual spot-checks plus a monthly report
8) Decide whether the change was positive or negative
A useful scorecard is:
- Mentions up/down
- Citations up/down
- Traffic up/down
- Impressions up/down
- Conversion rate up/down
That gives you a fuller picture than rankings alone.
Quick practical method
If you want the fastest possible check:
- List your top 20 queries.
- Run them in Google AI Overviews, Perplexity, and ChatGPT search/browse.
- Record whether your site is cited before and after the update.
- Compare Search Console clicks/impressions for the same pages.
- Note any changes in mentions, citations, and traffic.
If you want, I can help you build a simple AI visibility tracking spreadsheet or a step-by-step process for Google AI Overviews and ChatGPT/Perplexity.