{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"The Experimentation Edge","title":"Why JobLeads says one test won't move you, but 100 will","html":"","width":"100%","height":180,"duration":1566,"description":"Summary\nWhat happens when the most logical feature you've ever built has zero impact? In this episode of The Experimentation Edge, host Ashley Stirrup, CMO of GrowthBook, sits down with Edd Saunders, product experimentation manager at JobLeads, to unpack the pizza personalization experiment that cut an ordering flow from 22 clicks to 5 and changed nothing. Edd shares the problem mapping framework he uses to move new experimenters from solution space to problem space thinking, how JobLeads grew from 0.3 to 2.8 experiments per month, and why democratizing experimentation across a whole company comes down to habit change rather than education. A practical conversation for product managers, data scientists, engineers, and growth leaders building experimentation cultures.\nChapters\n00:00 Introduction\n01:40 Meet Edd Saunders and JobLeads\n03:12 How JobLeads uses AI for prototyping\n04:05 Building experimentation operations and a knowledge base\n05:35 Learning over winning and compounding growth\n08:10 The pizza personalization experiment\n12:50 Moving from solution space to problem space\n17:05 Problem mapping on a 2x2 matrix\n22:20 Velocity and democratizing experimentation\n24:20 AI automation for the unsexy work\nTakeaways\n-A one click reorder feature that cut a pizza ordering flow from 22 inputs to 5 had zero impact on purchases, proving that removing friction can also remove the customer's sense of control.\n-Exploration is part of the customer's delight; returning customers wanted to browse the menu even though they ordered the same thing every week.\n-Moving new experimenters from solution space to problem space thinking raises win rates and produces learnings the whole organization can use.\n-Problem mapping on a 2x2 matrix of evidence versus impact turns customer research into a prioritized experiment roadmap, and one validated problem can spring a whole tree of testable ideas.\n-Scaling experimentation from 0.3 to 2.8 tests per month is less about education and more about...","thumbnail_url":"https://img.transistorcdn.com/D9kLs0HSsqR4ttk_5ESEdC1jX-wmD76GK-OHmb3a9B8/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS80YTFk/MGU1MjJlODhlNjJh/MTdlZTZkN2Q1ODY5/OTdjYy5wbmc.webp","thumbnail_width":300,"thumbnail_height":300}