Vanity Metrics vs. KPIs: Millions of Impressions, Zero Impact

In their new column, Paulina Schumann and Timo Sander answer why platform metrics only tell half the story, how MPIs differ from vanity metrics, and why Mental Availability is changing the game.

Portrait of Timo Sander and Paulina Schumann
Image: © JUSTADDSUGAR, charles & charlotte.

Vanity Metrics in Marketing: Why Platform Metrics Aren’’t Enough

Social media reports often look impressive. Millions of impressions, benchmark-breaking CPMs, and solid watch times. Yet one question remains: Did any of it actually make a difference? For the brand, for perception, for sales? If we’’re honest, the answer is usually: We don’’t know. And that’’s the real problem. In this edition, we explain why platform metrics are structurally incapable of measuring real impact, what a better measurement framework looks like, and why the most important question is no longer, “How many people know our brand?”

#1 Why Is CPM Used So Often When the Impressions Behind It Say So Little?

Brands increasingly understand that contact quality is what really matters. Average Watch Time and Engagement Rate have become established metrics for evaluating communication. Yet internal decisions are still frequently based on CPM, and it continues to appear in reports as if it were a reliable performance indicator. The problem lies in two truths that are rarely considered together. First, an impression counts after just 0.1 seconds on screen. Second, around 60 percent of people skip ads, especially when they feel overly promotional (Source: Adzine, 2024). Bottom line: A contact lasting only a few seconds, or even less than one second, is still counted as a full impression, even though it was effectively incapable of generating advertising impact. In the end, CPM measures one thing above all: How much does it cost to be ignored a thousand times?

#2 Better Efficiency Metrics: Add Contact Quality

CPM still has its place as a benchmark for comparing channels and as an internal efficiency metric. But it should never stand alone. It needs to be complemented by more meaningful KPIs for your social media marketing. Anyone serious about measurement develops custom efficiency metrics that account for contact quality. Two practical examples are Cost per 15-Second View, which ensures a contact lasted long enough for a message to be received, and Cost per Minute Watch Time, calculated by dividing media costs by the total accumulated watch time. These metrics reveal what it actually costs to keep people engaged on a platform where they are free to decide whether to watch or scroll past. That is a fundamentally different signal from a traditional CPM.

#3 Even That’s Not Enough: Platforms Measure Efficiency, Not Effectiveness

Here’s the key point many marketers overlook. Even a strong Average Watch Time does not guarantee effectiveness. How many brands consistently ensure that their brand codes and core messages appear early enough in the creative asset so the average viewing time is actually long enough to communicate them? High watch time may simply mean people stayed engaged, yet remembered very little because the message wasn’t clear. Or because the content wasn’t memorable enough in a competitive environment with stronger creative work. Platform metrics will always remain vanity metrics because they are structurally incapable of proving real impact or effectiveness. That’s why marketing managers need to see these numbers for what they are: MPIs, or Media Performance Indicators. And make sure they are paired with genuine KPIs.

#4 Vanity Metrics vs. KPIs: The Measurement Pyramid

The easiest way to think about this is as a measurement pyramid. At the top sits the mission, the overarching objective your communication is meant to achieve. Beneath it is the KPI: the single metric that comes closest to reality and can reliably indicate whether the objective has been achieved. In most cases, this is a number derived from brand tracking or sales tracking. Below that are the MPIs, the platform metrics that should be monitored throughout a campaign to increase the likelihood of achieving the KPI. This layered perspective leaves far less room for positive bias. It regularly puts both marketing managers and their agencies to the test in a way that is demanding but honest.

#5 Ask Better Questions to Get Better Results

When searching for meaningful marketing KPIs, many companies turn to traditional brand tracking metrics such as Awareness, Consideration, Usage, or First Choice. These numbers tell you roughly where you stand. What they rarely tell you is what you need to do next. They are useful reference points, but not the foundation of a true insight-to-action system. The difference lies in the question itself. Instead of asking, “Which of these brands do you know?” the better question is, “In which specific buying or consumption situations do you think of each of these brands?” The same principle applies to brand attributes. By following Byron Sharp’s Mental Availability framework, every tracking study becomes a source of actionable insights. You understand exactly in which potential buying situations your brand needs to be more mentally available, and how your communication should evolve accordingly. That’s no longer just tracking. It’s a navigation system. Learn more from our friends at Appinio, whose digital panel and engaged research community make them a valuable market research partner.

Conclusion: Goodbye Vanity Metrics – What to Do Differently Starting Tomorrow

  1. Replace CPM with contact quality metrics. Cost per 15-Second View or Cost per Minute Watch Time provide a far more honest picture of what your media budget is actually delivering than surface-level vanity metrics.
  2. Make sure your brand message is fully communicated within the Average Watch Time. A video that captures attention but fails to deliver the message creates no real impact.
  3. Complement MPIs with real KPIs. Platform metrics are Media Performance Indicators, not proof of brand impact. Build a measurement pyramid with a clear mission, a genuine KPI from brand or sales tracking, and MPIs that help steer your communication.
  4. Expand your awareness questions with Mental Availability questions. Instead of asking, “Do you know this brand?” ask, “In which situations do you think of this brand?” That’s the difference between a nice tracking study and a genuine decision-making tool.
  5. Start every communication cycle with a baseline measurement and repeat it after six months. That turns your reporting cycle into a learning cycle that continuously strengthens your brand.
        go-live_Agenda_desktop_260701-2