{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"Global Perspectives on Digital Health","title":"Evaluation level up : Measuring what matters","html":"","width":"100%","height":180,"duration":2986,"description":"🎯 Evaluation! A make or break thing in the digital health. I sat down with Dr Shay Soremekun from the London School of Hygiene & Tropical Medicine to talk about the very hot topic of evidence generation and evaluation. Everyone's talking about LLM evals, technical performance, benchmarking. But ultimately people care about impact. Yet impact is rarely a neat, linear path to a yes/no answer. Anyone who's actually implemented something in the field knows about all the other contributing factors, the daily challenges and how hard it is to move the needle on big clinical outcomes with robust clinical evaluation.To understand why it improved care, if it did, was as important, if not more important, than understanding that it did. Because that will help us to understand how we need to potentially modify or adapt the intervention either in the same place or in future places to be able to achieve the same success. 🌟 Who will benefit from listening to this episode?Digital health companies : Founders, data scientists, AI/ML scientists, PMs, designers, clinical evaluation/study teams, cliniciansFunders : donors, investorsGlobal and public health professionalsImplementersResearchersRegulatorsShay explains the use of Program Theory and Logic models to visually connect your intervention, all the intermediate steps (not just technology, but people and change) to outputs, outcomes and long term impact.  Making space to observe other levers in the system you didn't initially anticipate. The work that Shay and her team have done with The Malaria Consortium and LSTM's Centre for Evaluation looking at a digital health tool for community health workers in villages and facilities showed this perfectly. Because they were intentional about observing the whole system, they discovered other factors contributing to impact and could redirect efforts accordingly.In this age of tightening budgets, and pressure to show clean shiny KPIs, how do you make room to observe these things? We also...","thumbnail_url":"https://img.transistorcdn.com/hZPIZ-J0wiJx5Bagp4XUMpa5ahoYyL_sqq9C89IZlTc/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS85ODYz/N2YyYzVkYzhjMjY2/YWQyMjc4YmU3MWM0/YWE2NS5qcGc.webp","thumbnail_width":300,"thumbnail_height":300}