Retail Media Breakfast Club

Today I dig into a question that’s been coming up more and more from retail media leaders: Should we be measuring retail media the same way we measure national media? It sounds simple, but once you get into it, things get complicated fast. I share insights from experts across my network to unpack why there’s no clean, one-size-fits-all answer, and what brands should actually be doing instead.

I explore the tension between commerce-specific measurement models and traditional marketing mix models. Where each one works, and where they fall apart. I also break down real-world failure modes, who should actually own measurement, and the critical mindset shift brands need to make before they even start analyzing performance. If you’ve ever struggled to reconcile ROAS, MMM, and retail media impact, this episode will give you clarity (and a few strong opinions).

This episode is sponsored by Mirakl Ads

Timeline

[00:00] – The big question: Can retail media and national media be measured the same way?
[01:00] – Why different objectives require different measurement frameworks
[02:00] – The “camera lens” analogy: why one model can’t do it all
[03:15] – What goes wrong when brands force a single MMM across everything
[04:00] – How measurement issues start influencing business decisions (in the wrong way)
[05:00] – Who really owns measurement: brands, agencies, or retail media networks?
[07:30] – The maturity gap: why not all brands are ready for advanced measurement
[08:15] – The key takeaway: define the job of each dollar before measuring success

Links & Resources

What is Retail Media Breakfast Club?

10 minutes of expert insights every weekday. Your morning ritual for staying ahead in retail media.

Should You Measure Retail Media Like National Media?
===

[00:00:00] Speaker: A CPG brand side retail media leader recently wrote in with a question I suspect that a lot of teams are wrestling with right now. How should brands think about commerce? Specific media mix [00:00:15] modeling tools. These are tools built to measure retailer level.

[00:00:18] ROI. Versus traditional marketing mix models that measure total market impact. Can you use both? Should you, and how do [00:00:30] you hold retail media to the same rigor as national media without forcing the wrong tool onto the wrong problem? It's a good question, and based on the responses I got when I put this out to my network, there is ~no tidy answer, but there is.~

[00:00:44] ~It is a good question and based on the responses I got and based on the responses I got when I put it out to my network, there's ~no [00:00:45] tidy answer, but there is a useful set of guardrails, taking shape.

[00:00:50] Let's jump in.

[00:00:51]

[00:00:52] Speaker: So here's what the peanut gallery all agreed on that different objectives need different measurement. just like [00:01:00] sprinters and bodybuilders don't train the same way retail, media and national media are optimizing for different objectives.

[00:01:08] So says Jordan Whitmer, head of Retail Media at the agency, salt xc. He explains [00:01:15] how retail media optimizes for conversion skew movement, retailer specific algorithms, while national media optimizes for reach frequency brand building.

[00:01:27] Jordan says that when a single model tries [00:01:30] to assign one ROI to spend, that serves both purposes. It blends two optimization strategies into one output. Jaya Kamara, who is the founder of Signal to Summit, an advisory [00:01:45] firm working with retail media networks, landed in a similar place, but framed it with a different analogy.

[00:01:51] He said to think of it like camera lenses. You have a wide angle lens that can technically shoot macro and a macro lens [00:02:00] that can technically shoot wide, but neither really does the other's job very well. Commerce MMM vendors and traditional MMM vendors both offer to measure across each other's lanes and they can technically do it, but [00:02:15] the models are trained for different data types and different decision cycles, and forcing a cross lane Reed produces a blurry picture.

[00:02:24] And finally, James dea, who advises retail media networks through his [00:02:30] firm.

[00:02:30] Coia Media was the most skeptical of the bunch. He says Retail, ROI and total market ROI answer different questions and trying to collapse them into one number often creates more confusion than [00:02:45] clarity. Retail media sits closer to trade spend. It's about driving outcomes within a specific retailer while national media is about growing overall demand.

[00:02:55] Both of these matter. But James argues they should be evaluated against their [00:03:00] own objectives before anyone tries to unify them. So what happens when you get this wrong? Jordan Whitmer shared two failure modes that he's seen firsthand.

[00:03:11] ~Number one, a brand uses a single traditional MMM across everything, and every time the model runs, the retail teams are pressured to justify their investment. It turns into a defensive spiral. Jordan had an analytics. Jordan had an analytics leader write to him during one of these cycles saying. Maybe you're new to this, but we don't like to question or adjust the methodology to make our work look better.~

[00:03:11] ~That was the response to a suggestion that lower CPCs and higher click-through rates on top category terms were a good sign when the M.~

[00:03:11] Number one is when a brand uses a single traditional [00:03:15] MMM across everything and every time the model runs, the retail teams are pressured to justify their investment. It turns into a defensive spiral Jordan Recounts one example that he faced here where a retail [00:03:30] media campaign was driving lower CPCs and higher click-through rates on top category terms.

[00:03:37] Great signals. Strong signals by any platform native measure. But the MMM evaluated it as [00:03:45] search CPM and called it too expensive. the analytics team's response when Jordan pushed back was, we don't like to question or adjust the methodology to make our work look better. Ooh. And the second example [00:04:00] Jordan gave was when a sales leader asked whether they should sign a JBP with a retailer specifically to protect us from the dollars getting cut.

[00:04:08] When the MMM runs. When your measurement framework is driving teams to seek shelter in [00:04:15] joint business plans, something has gone sideways. One other failure mode is subtler. A brand sets up multiple measurement approaches. Commerce, MMM alongside traditional MMM, but it doesn't cleanly [00:04:30] assign objectives upfront, so they default to legacy measurement, and when it doesn't look good, they pull out the secondary model as a backup.

[00:04:39] Jordan's take Here you're not really doing things differently. You've kind of just set up a backup plan. [00:04:45] The upstream issue, which is clearly defining what each investment is supposed to deliver, never gets addressed. And this connects to something that Jordan and I discussed recently, that whoever owns the budget, whether that's the sales team or [00:05:00] the brand team, gets to determine what retail media is even allowed to be and what it gets measured against.

[00:05:07] We did a whole webinar on this topic that I recommend checking out, and I'll link up to the summary blog post in the [00:05:15] show notes. Retailers know that a marketplace model can dramatically boost product assortment, shopper engagement, and total revenue. But to get [00:05:30] the most out of your marketplace, you need an ad tech solution that can really engage sellers. Miracle Ads is powering the future of retail media for leading retailers to activate both three P Sellers and one P [00:05:45] brands.

[00:05:46] Kiri Masters: Learn more@miracle.com. That's M-I-R-A-K l.com. So who should really own this? I spoke with Anne Hallick, who is the VP of Sales for the [00:06:00] Americas at Miracle Ads, who is also the sponsor of this podcast.

[00:06:04] Speaker: And she took a little bit of a different angle from the others. She's less focused on which tool. And more focused on who should be running the measurement. Her framework is that three [00:06:15] groups need to get M, M, M, right? But they'll each do it a little differently. Number one, agencies, agencies will do it at scale.

[00:06:23] They have to to maintain authority with clients. Number two, brands. Brands will do it in hyper [00:06:30] focus, building their own views, even if it means investing in tooling and data portability. Number three, RMNs RMNs will find it difficult to do because of their other competing priorities. In a perfect world, [00:06:45] every RMN would build world class MMM capabilities, but the reality is that they're triaging with other priorities and that frankly deliver an execution can and should come first.

[00:06:58] And that is not a failure of [00:07:00] ambition, but a rational prioritization. And there's a structural reason that brands and agencies need to own this. She says the walled garden can't smell the flowers outside. R Mens only see what happens on their own [00:07:15] platform. While brands and agencies are the ones with the whole picture view, they're the ones who can stitch together retailer level performance, and total market impact.

[00:07:25] So just closing this out. With Jaya Kamara who raised [00:07:30] one more important point worth flagging, which is that this whole conversation assumes a certain level of sophistication on both sides of the table. He says it's the more mature brands and media buyers are asking for these [00:07:45] sophisticated measurement approach.

[00:07:46] And it's the more mature RMNs that are investing in incrementality and outcome-based measurement rather than defaulting to impressions in CPM, both sides have to be ready for this to [00:08:00] work and that tracks the reader who sent this question in is clearly operating at an advanced.

[00:08:05] Level, but a huge portion of brands are still taking the ROAS number at face value and a huge portion of RMNs are still handing them [00:08:15] one. Although I have argued before that roas, while definitely imperfect has its place in the measurement ecosystem, still.

[00:08:25] There's no single model that answers every question here, but the experts I [00:08:30] talk to broadly agree on the starting point, decide what job each dollar is supposed to do before it gets spent, and measure against that objective, not against a universal number that tries to be everything to everyone. [00:08:45] Thanks for listening.

[00:08:46] I'll catch you tomorrow.

[00:08:47]