{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"The Experimentation Edge","title":"How Kargo turns losing experiments into competitive edges","html":"","width":"100%","height":180,"duration":1323,"description":"\nSummaryIn this episode of The Experimentation Edge, host Ashley Stirrup, CMO of GrowthBook, sits down with James Falzone, Director of Product Management at Kargo, to unpack how a high scale ad tech marketplace turns failure into its biggest advantage. James explains how Kargo connects advertisers to publishers through real time auctions that resolve in milliseconds across up to 10 billion ad requests a day, why experimentation is embedded in the company's culture rather than siloed in a team, and what happened when a winning click optimization model failed completely after being copied to a new customer type. The conversation is built for product managers, data scientists, engineers, and growth leaders who want a practical, honest view of running experiments at scale, learning from losses, and keeping AI grounded in solid infrastructure.\n\nChapters00:00 Welcome and introducing James Falzone01:45 What Kargo does and how real time ad auctions work04:45 Why experimentation is embedded in Kargo's culture07:45 The three things every marketplace has to deliver10:15 The experiment that failed: click optimization on third party demand12:15 A bad result versus a bad experiment13:45 Why different customer types need different signals15:30 Putting \"where did you fail?\" on every retro18:45 How experimentation evolves with AI21:15 Better not bigger: the closing takeaway\n\nTakeaways-A bad result is not a bad experiment. If you're not failing, you're probably not trying anything new.-The same metrics and signals don't apply to every customer type. Bad results often come from a lack of context, not bad tech.-Metrics and signals you test against should always be business driven, not ported from the last thing that worked.-Put failure on the agenda. A biweekly \"where did you fail?\" retro turns one person's dead end into the whole team's shortcut.-AI's biggest unlock is access. More people can run experiments, but it has to be built on solid ML and infrastructure. Better, not...","thumbnail_url":"https://img.transistorcdn.com/D9kLs0HSsqR4ttk_5ESEdC1jX-wmD76GK-OHmb3a9B8/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS80YTFk/MGU1MjJlODhlNjJh/MTdlZTZkN2Q1ODY5/OTdjYy5wbmc.webp","thumbnail_width":300,"thumbnail_height":300}