The Knowledge Architects: Building Wisdom in the Information Age


Episode Summary

In May 2014, seven researchers at the University of Washington published a study so stark they compared it to a clinical trial that should have been stopped for benefit. They had pooled 225 studies of undergraduate STEM teaching. Their verdict: students in traditional lecture classes were 1.5 times more likely to fail than students in classes that actively engaged them. Exam scores improved by about 6 percent. The case was, by the standards of education research, closed.

In this episode we tell the story of the Freeman et al. (2014) meta-analysis and what the field learned in the decade that followed. We meet Eric Mazur, the Harvard physicist whose accidental discovery in 1991 became Peer Instruction. We unpack the equity finding of Theobald et al. (2020), which showed that active learning narrows achievement gaps for the students universities have historically underserved. We confront the most psychologically interesting result of the decade: students in active classrooms learn more but feel they have learned less, which helps explain why the better pedagogy keeps losing the popularity contest. And we ask the question that still haunts the field: if the evidence is this clear, why are more than half of STEM classrooms still being taught the way they were in 1950?


Key Topics Covered

  • The 2013 context: the PCAST report, the 60 percent STEM attrition rate, and why the field needed a meta-analytic verdict
  • Freeman et al. (2014): 225 studies, the inclusion criteria, the random effects model, and the headline numbers (g = 0.47, 1.5 times the failure rate, 3,516 more students who failed under lecture)
  • Carl Wieman's companion editorial and the "pedagogical equivalent of bloodletting" framing
  • Eric Mazur's origin story: the Force Concept Inventory, the student question that changed his career, and the birth of Peer Instruction
  • The bundle of active learning pedagogies: Peer Instruction, Flipped Classroom, Think Pair Share, POGIL, Problem Based Learning, Jigsaw, SCALE UP, and Just in Time Teaching
  • The ICAP framework (Chi and Wylie, 2014) and why some "active" activities outperform others
  • Theobald et al. (2020) on equity: 33 percent gap closure on exam scores, 45 percent on passing rates, and the "heads and hearts" hypothesis
  • Deslauriers et al. (2019) on the feeling versus learning gap and the 20 minute framing intervention that closed it
  • Stains et al. (2018) on what STEM classrooms actually look like: 55 percent still predominantly lecture
  • The predecessor studies: Hake (1998), Bonwell and Eison (1991), Springer, Stanne and Donovan (1999)
  • The minimal guidance critique (Kirschner, Sweller and Clark, 2006) and the boundary it marks
  • Why instructors resist change: incentives, evaluations, scale economics, and Henderson, Beach and Finkelstein (2011)
  • The AI wrinkle: Kestin et al. (2025) on AI tutoring versus in class active learning

Researchers Mentioned

  • Scott Freeman (University of Washington) : Senior author of the 2014 meta-analysis and follow up equity work
  • Carl Wieman (Stanford, formerly Colorado and UBC) : Nobel laureate physicist, founder of the Science Education Initiative, author of the 2014 PNAS commentary
  • Eric Mazur (Harvard) : Originator of Peer Instruction in the early 1990s
  • Michelene Chi (Arizona State University) : Originator of the ICAP framework
  • Louis Deslauriers (Harvard) : Lead author on the feeling versus learning study
  • Elli Theobald (University of Washington) : Lead author on the 2020 equity meta-analysis
  • Marilyne Stains (University of Virginia) : Lead author on the 2018 direct observation study of STEM teaching
  • Richard Hake : Author of the 1998 six thousand student physics survey
  • Charles Bonwell and James Eison : Authors of the 1991 ASHE ERIC report that named the field
  • Frank Lyman (University of Maryland) : Originator of Think Pair Share in 1981
  • Richard Moog, James Spencer and John Farrell (Franklin and Marshall) : Co founders of POGIL
  • Howard Barrows (McMaster) : Codifier of Problem Based Learning in the 1970s
  • Elliot Aronson : Developer of the Jigsaw method in 1971
  • Robert Beichner (NC State) : Originator of SCALE UP
  • Gregor Novak (IUPUI) : Originator of Just in Time Teaching
  • Charles Henderson, Andrea Beach and Noah Finkelstein : Authors of the 2011 review on instructional change

Key Studies and Sources

  • Freeman, S., Eddy, S.L., McDonough, M., Smith, M.K., Okoroafor, N., Jordt, H., and Wenderoth, M.P. (2014). "Active learning increases student performance in science, engineering, and mathematics." PNAS, 111(23), 8410 to 8415.
  • Wieman, C.E. (2014). "Large scale comparison of science teaching methods sends clear message." PNAS, 111(23), 8319 to 8320.
  • Theobald, E.J., Hill, M.J., Tran, E., et al. (2020). "Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math." PNAS, 117(12), 6476 to 6483.
  • Deslauriers, L., McCarty, L.S., Miller, K., Callaghan, K., and Kestin, G. (2019). "Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom." PNAS, 116(39), 19251 to 19257.
  • Stains, M., Harshman, J., Barker, M.K., et al. (2018). "Anatomy of STEM teaching in North American universities." Science, 359(6383), 1468 to 1470.
  • Hake, R.R. (1998). "Interactive engagement versus traditional methods: A six thousand student survey of mechanics test data for introductory physics courses." American Journal of Physics, 66(1), 64 to 74.
  • Bonwell, C.C. and Eison, J.A. (1991). Active Learning: Creating Excitement in the Classroom. ASHE ERIC Higher Education Report.
  • Chi, M.T.H. and Wylie, R. (2014). "The ICAP Framework: Linking Cognitive Engagement to Active Learning Outcomes." Educational Psychologist, 49(4), 219 to 243.
  • Crouch, C.H. and Mazur, E. (2001). "Peer Instruction: Ten years of experience and results." American Journal of Physics, 69(9), 970 to 977.
  • Smith, M.K., Wood, W.B., Adams, W.K., et al. (2009). "Why peer discussion improves student performance on in class concept questions." Science, 323(5910), 122 to 124.
  • Andrews, T.M., Leonard, M.J., Colgrove, C.A., and Kalinowski, S.T. (2011). "Active Learning Not Associated with Student Learning in a Random Sample of College Biology Courses." CBE Life Sciences Education, 10(4), 394 to 405.
  • Kirschner, P.A., Sweller, J., and Clark, R.E. (2006). "Why Minimal Guidance During Instruction Does Not Work." Educational Psychologist, 41(2), 75 to 86.
  • Henderson, C., Beach, A., and Finkelstein, N. (2011). "Facilitating change in undergraduate STEM instructional practices." Journal of Research in Science Teaching, 48(8), 952 to 984.
  • Kestin, G., Miller, K., Klales, A., Milbourne, T., and Ponti, G. (2025). "AI tutoring outperforms in class active learning: an RCT introducing a novel research based design in an authentic educational setting." Scientific Reports, 15: 17458.

Key Numbers to Remember

  • 225 studies : pooled in the Freeman meta-analysis across the STEM disciplines
  • 6 percent : average exam score improvement under active learning (Hedges' g = 0.47)
  • 0.88 : effect size on concept inventories, nearly twice the headline number
  • 1.5 times : relative failure rate under traditional lecturing versus active learning
  • 33.8 percent vs 21.8 percent : average failure rate under lecture versus active learning
  • 3,516 : additional students in the corpus who failed under lecture rather than active learning
  • 60 percent : share of US students who entered college intending a STEM major and then switched out (PCAST 2012)
  • 33 percent and 45 percent : reduction in exam score gap and passing rate gap for underrepresented students (Theobald 2020)
  • 0.46 SD higher and 0.56 SD lower : actual learning versus feeling of learning in active sessions (Deslauriers 2019)
  • 65 percent and 75 percent : students whose attitudes improved after a 20 minute framing intervention, and the share who credited the framing
  • 55 percent : STEM classes still predominantly didactic lecture four years after Freeman 2014 (Stains 2018, 2,008 sessions)
  • 0.23 vs 0.48 : normalized gains under traditional versus interactive engagement physics courses (Hake 1998)

Memorable Quotes

"If the experiments analyzed here had been conducted as randomized controlled trials of medical interventions, they may have been stopped for benefit."
Freeman et al. (2014)

"If a new antibiotic is being tested for effectiveness, its effectiveness at curing patients is compared with the best current antibiotics and not with treatment by bloodletting. However, in undergraduate STEM education, we have the curious situation that, although more effective teaching methods have been overwhelmingly demonstrated, most STEM courses are still taught by lectures, the pedagogical equivalent of bloodletting."
Carl Wieman (2014)

"Any college or university that is teaching its STEM courses by traditional lectures is providing an inferior education to its students."
Carl Wieman (2014)

"Professor Mazur, how should I answer these questions? According to what you taught us, or by the way I usually think about these things?"
a Harvard physics student to Eric Mazur, 1991

"Students' perception of their own learning can be anticorrelated with their actual learning under well controlled implementations of active learning versus passive lectures."
Deslauriers et al. (2019)

"The puzzle of active learning's slow adoption is not a puzzle about evidence. The evidence is overwhelming. It is a puzzle about institutions."

The Big Idea

Knowledge transfer is not a function of how much an expert says. It is a function of how much cognitive work a learner does. The lecture format optimizes for content delivery and underinvests in the engagement that turns delivery into learning. Active learning, in this frame, is less a teaching method than a recognition that the student's cognition is the bottleneck. Designing classes around what the student does, rather than what the instructor says, is the path that the evidence keeps pointing toward. The case has been settled at the average level for more than a decade. What remains open is institutional: faculty incentives, student evaluations, scaling economics, and the structural fact that the better pedagogy still loses the popularity contest. Change is hard. The evidence is not.


Next Episode Preview

Episode 23: The Expertise Reversal Effect : If active learning works for everyone, why can the same lesson help one student and actively hurt another? We explore the surprising finding that instructional methods that scaffold beginners can become counterproductive as expertise grows, and what this means for designing instruction that meets each learner where they are.

What is The Knowledge Architects: Building Wisdom in the Information Age?

The Knowledge Architects is a free, science-based podcast exploring how we learn, remember, and organize knowledge. Each episode translates peer-reviewed research from cognitive science, neuroscience, and psychology into practical insights—helping you understand how your mind works and how to work with it more effectively. Brought to you by ElysFlow.