Koozai > Blog > How to Measure AI Search Performance

How to Measure AI Search Performance

| 3 minutes to read

If you’re still measuring organic search the same way you were three years ago, there’s a good chance you’re missing a big chunk of what’s actually influencing your customers.

Traditional SEO gave us something fairly predictable: a ranked list of links, click data, and a measurement model centred almost entirely on Google. AI search is a different beast. ChatGPT, Perplexity, Gemini, Copilot, Google’s AI Overviews; these platforms synthesise answers, vary outputs between sessions, and can influence a purchase decision without ever generating a click.

A potential customer could ask an AI assistant which PR tool is best for their agency, read the answer, form a clear preference, and then type your competitor’s name directly into Google. The AI platform drove that decision. Your analytics doesn’t capture this.

So the old model of measuring what’s measurable and calling it done is no longer enough on its own.

The good news: there’s a smarter way to approach this.

Three Layers That Actually Tell You What’s Going On

SEO consultant Aleyda Solis has developed a practical framework for AI search measurement that is genuinely useful. It breaks performance down into three connected layers, each answering a different question.

Layer 1: Presence – Are you actually showing up?

This is the starting point. Before you can fix anything, you need to know whether your brand is appearing in the AI answers that matter, and how it’s being represented when it does.

Presence measurement isn’t just about whether your name comes up. It covers:

  • Which platforms you appear on
  • Whether you’re being recommended or just listed
  • Whether those mentions include a clickable link
  • Whether you’re winning when AI compares you to competitors
  • Whether you’re being described accurately

If an AI assistant is describing your business incorrectly to thousands of people every week, that’s a commercial problem, even if your rankings look fine.

Layer 2: Readiness – Are you structurally set up to be found?

Readiness is the diagnostic layer. It explains why your visibility looks the way it does.

If you’re appearing but not getting links, that could point to how your content is structured. If your recommendation rate is low, it might be a differentiation or trust issue. If you’re being described incorrectly, entity consistency across the web is likely the culprit.

The point of Readiness work is to stop throwing generic optimisation at a problem you haven’t diagnosed properly. Different visibility gaps have different root causes. This layer helps you find the right lever.

Layer 3: Business Impact – Is any of this actually working?

This is where measurement gets honest. AI referral traffic is a useful signal, but it’s the floor, not the ceiling, of AI’s contribution to your business.

A large proportion of AI-influenced conversions never show up as AI referral sessions. Users see your brand in an AI answer, don’t click, and then search for you directly or type in your URL. That conversion gets attributed to branded organic or direct traffic. The AI influence is invisible unless you’re measuring for it.

Business Impact measurement combines observed data (actual AI referral sessions), proxy signals (branded search trends, direct traffic lifts, survey data), and modelled estimates to give a more complete picture. None of these individually tells the whole story. Together, they get you much closer to the truth.

Why This Matters More Than Another Dashboard

The value of this three-layer approach isn’t the metrics themselves, it’s how they connect.

Presence tells you what’s happening. Readiness tells you why. Business Impact tells you whether it matters commercially. When you run these in sequence, each one hands a hypothesis to the next. That’s what turns a reporting exercise into something you can actually act on.

We’ll be going deeper on each layer over the next few posts in this series. But if you want to get started now, the first step is simple: stop treating AI visibility as a binary. Your brand either showing up or not isn’t the question. How it shows up, where, and with what effect, that’s where the real work is.

In the next post, we’ll look at how to build a prompt library that actually represents how your customers use AI and why most businesses are getting this badly wrong.

Leave a Reply

Your email address will not be published. Required fields are marked *

Sophie Roberts

Managing Director

Sophie Roberts is Managing Director and owner of Koozai, one of the UK’s longest-established digital marketing agencies. Having joined the business in 2016, she became Managing Director in February 2018 before leading a successful management buyout in 2021.

With more than 30 years of marketing experience, Sophie specialises in AI Search, Digital PR, marketing strategy, agency leadership and helping businesses adapt to the changing search landscape. She works closely with clients and Koozai’s specialist teams to develop commercially focused digital strategies that improve visibility, strengthen brand authority and deliver measurable business growth.

Over the course of her career, Sophie has worked with more than 200 organisations, ranging from ambitious SMEs to household brands including Golden Wonder, Airfix & Humbrol and Victorinox Swiss Army Knives. Since joining Koozai she has helped shape digital strategies for clients including Travelbag, Trevor Sorbie, Red Funnel and Côte Brasserie, building long-term partnerships that often span many years.

Although clients often approach Koozai for Technical SEO, PPC, Digital PR or AI Search support, Sophie’s approach has always been to understand the wider business challenge rather than simply deliver a marketing service. She believes the best client relationships come from treating every client’s business as if it were your own, combining commercial thinking with honest advice and a genuine investment in long-term success.

Sophie’s career began in public relations, where she led award-winning campaigns before moving into digital marketing. One of her earliest successes was the BBC’s Service! campaign, which won the Catey Award for Best Independent Marketing Campaign and helped raise the profile of front-of-house hospitality careers across the UK.

Since then, she has developed marketing strategies for organisations across hospitality, construction, travel, tourism, healthcare, education, retail, ecommerce, finance, automotive and manufacturing, giving her broad commercial experience across both B2B and B2C sectors.

More recently, Sophie has become one of Koozai’s leading voices on AI Search and the impact of generative AI on marketing. She has developed the agency’s AI prompt library, built custom GPTs and AI agents to improve internal efficiency, and created Koozai’s AI usage policy to help the business adopt AI responsibly and effectively. She is particularly interested in how AI is changing the way people discover brands, products and services, and what businesses need to do to remain visible as search continues to change.

Sophie regularly writes about AI Search, Digital PR, organic growth, marketing strategy, leadership and the practical application of AI in marketing. She also reviews and fact-checks Koozai’s AI Search and digital strategy content before publication, ensuring it is accurate, practical and reflects current best practice.

Alongside her agency work, Sophie has delivered webinars on SEO for the construction industry, spoken at digital marketing events across Hampshire, featured in Search With Sean Live and supported the hospitality industry through judging and organising prestigious awards, including the UK Sommelier of the Year and UK Restaurant Manager of the Year. She also served on the organising committee for the National Restaurateurs Dinner.

Her work has been recognised through both personal and agency awards, including the Catey Award for Best Independent Marketing Campaign and the Construction Marketing Award for Best Small Agency.

Sophie holds a BA (Hons) in Marketing & PR together with Google and HubSpot marketing certifications. She continues to explore how emerging technologies can improve marketing effectiveness while keeping people, creativity and commercial thinking at the heart of every strategy.

Her insights and commentary have been featured by publications including Moz, Sitebulb, Yahoo News, The Business Magazine, Hampshire Business News, Portsmouth News, The Daily Echo, Professional Electrician, The Caterer, Restaurant Online, HVP Magazine and many other industry publications.

Away from work, Sophie is a self-confessed foodie, proud geek and lifelong learner who believes every day should be a school day. She is passionate about creating positive workplace cultures, supporting work-life balance and helping people build careers they genuinely enjoy.

aspect-ratio
ChatGPT AI Search
Kelly-Anne Crean

Your Competitors Are Showing Up in AI Search. Are You?

Kelly-Anne Crean
10th Sep 2026
SEO Blog
aspect-ratio
TV Interview
Isobel Walster

Koozai Couch: Interview with Matt Seabridge

Isobel Walster

aspect-ratio
Sophie Roberts

GEO, AEO Or AI Search Optimisation?

Sophie Roberts
@hospitalitysoph
3rd Sep 2026
Digital PR Blog
aspect-ratio
local seo agency
Sophie Roberts

Should You Let AI Manage Your Google Business Profile?

Sophie Roberts
@hospitalitysoph
2nd Sep 2026
SEO Blog

Digital Ideas Monthly

Sign up now and get our free monthly email. It’s filled with our favourite pieces of the news from the industry, SEO, PPC, Social Media and more. And, don’t forget – it’s free, so why haven’t you signed up already?