Episode Summary
You have probably heard that a picture is worth a thousand words. But here is what the research actually shows. Combine words and pictures the wrong way, and you can wipe out the entire benefit. Put the label in the wrong corner of a diagram. Narrate an animation while the identical words scroll across the screen. Add one vivid, interesting photo that has nothing to do with the point. Each of these small choices can erase the advantage that words and pictures are supposed to buy you. Strangest of all, adding interesting material can make people learn less, not more.
In this episode we meet Richard E. Mayer, the psychologist who spent more than thirty years turning that designer's question into a science. Out of his laboratory at the University of California, Santa Barbara came the Cognitive Theory of Multimedia Learning and a catalog of roughly fifteen evidence based design principles, each with an effect size and a set of boundary conditions. We walk through the theory, the principles, and their numbers. Then we do the harder and more honest thing. We look at how big these effects really are once you step outside Mayer's own lab, why several have shrunk as the evidence accumulated, and where the whole enterprise is genuinely contested. The message is simple. Combining words and pictures is not automatically better. It is better only when the design respects the limits of a narrow mental channel.
Key Topics Covered
- The hundred year history of a wrong question: from Edison's 1922 prediction to educational film, radio, and television, each new medium promised a revolution and quietly failed
- Richard Clark's grocery truck argument: media are mere vehicles, it is the method that teaches, not the medium
- Mayer's shift from a question centered on technology to one centered on the learner, and the value added idea of changing one design variable while holding the medium constant
- The Cognitive Theory of Multimedia Learning: two channels, limited capacity, and active processing
- The select, organize, and integrate model, and why integration is the expensive step where most lessons fail
- Three demands on a narrow channel: extraneous, essential, and generative processing
- The multimedia principle: people learn more deeply from words and pictures than from words alone
- Reducing extraneous processing: coherence, signaling, redundancy, spatial contiguity, and temporal contiguity
- The seductive details effect: why interesting but irrelevant material makes people recall fewer main ideas
- Managing essential processing: segmenting, pretraining, and the modality principle
- Fostering generative processing: personalization and the conversational voice of instruction
- The modality principle as a cautionary tale, an effect that shrank as the evidence base grew and more labs weighed in
- How big the effects really are: independent syntheses land near g = 0.38, well below Mayer's own laboratory figures, and why publication bias, edition drift, and short lab lessons explain the gap
- Where the principles show up in the real world: shorter online videos and informal, personal delivery
Researchers Mentioned
- Richard E. Mayer (born 1947, University of California, Santa Barbara) : Creator of the Cognitive Theory of Multimedia Learning and the multimedia design principles, and one of the most cited figures in educational psychology
- Richard E. Clark (University of Southern California) : The "media are mere vehicles" argument that reframed the field, not to be confused with Ruth Colvin Clark, Mayer's later practitioner coauthor
- Roxana Moreno (1960 to 2010) : Mayer's central collaborator on the modality, personalization, and coherence studies and on the 2003 "nine ways" synthesis
- Logan Fiorella (University of Georgia) : Coauthor of the 2014 synthesis on reducing extraneous processing and of the book Learning as a Generative Activity
- Paul Ginns (University of Sydney) : Independent meta analyses of the modality, contiguity, and personalization effects
- Michael Noetel (University of Queensland) : The 2022 overview of reviews that produced the field's most conservative independent estimates of the effect sizes
- John Sweller (UNSW Sydney) : Cognitive load theory, the parallel framework behind Mayer's extraneous, essential, and generative processing (see Episode 15)
- Allan Paivio (1925 to 2016) : Dual coding theory, the source of Mayer's two channel assumption (see Episode 25)
- Slava Kalyuga (UNSW Sydney) : The expertise reversal boundary on Mayer's design principles (see Episode 23)
Key Studies and Sources
- Mayer, R.E. (2009). Multimedia Learning (2nd ed.). Cambridge University Press.
- Mayer, R.E. (2021). Multimedia Learning (3rd ed.). Cambridge University Press.
- Mayer, R.E. (Ed.). (2014). The Cambridge Handbook of Multimedia Learning (2nd ed.). Cambridge University Press.
- Mayer, R.E., and Moreno, R. (2003). "Nine ways to reduce cognitive load in multimedia learning." Educational Psychologist, 38(1), 43-52.
- Clark, R.E. (1983). "Reconsidering research on learning from media." Review of Educational Research, 53(4), 445-459.
- Mayer, R.E. (1989). "Systematic thinking fostered by illustrations in scientific text." Journal of Educational Psychology, 81(2), 240-246.
- Mayer, R.E., Steinhoff, K., Bower, G., and Mars, R. (1995). "A generative theory of textbook design: Using annotated illustrations to foster meaningful learning of science text." Educational Technology Research and Development, 43(1), 31-43.
- Harp, S.F., and Mayer, R.E. (1998). "How seductive details do their damage: A theory of cognitive interest in science learning." Journal of Educational Psychology, 90(3), 414-434.
- Moreno, R., and Mayer, R.E. (1999). "Cognitive principles of multimedia learning: The role of modality and contiguity." Journal of Educational Psychology, 91(2), 358-368.
- Noetel, M., Griffith, S., Delaney, O., et al. (2022). "Multimedia design for learning: An overview of reviews with meta-meta-analysis." Review of Educational Research, 92(3), 413-454.
- Cromley, J.G., and Chen, R. (2025). "A meta-analysis of Richard Mayer's multimedia learning research." Educational Research Review, 49, 100730.
- Guo, P.J., Kim, J., and Rubin, R. (2014). "How video production affects student engagement: An empirical study of MOOC videos." ACM Conference on Learning @ Scale.
- Fiorella, L., and Mayer, R.E. (2015). Learning as a Generative Activity: Eight Learning Strategies That Promote Understanding. Cambridge University Press.
Key Numbers to Remember
- d ≈ 1.39 : median effect size of the multimedia principle across eleven experiments in Mayer's lab, a very large effect
- d ≈ 1.22 : temporal contiguity, presenting narration and animation at the same time
- d ≈ 1.10 : spatial contiguity, placing words next to the part of the picture they describe
- d ≈ 0.86 : coherence (excluding seductive details) and redundancy (dropping identical on screen text)
- d ≈ 0.41 : signaling, cueing the structure of the material
- d ≈ 1.02 down to 0.76 : the modality principle across editions, from 2009 to 2014, as the evidence base widened from 17 tests to 61
- g ≈ 0.38 : the independent overall effect (Noetel et al. 2022), pooled across 29 meta analyses, 1,189 studies, and 78,177 participants
- g ≈ 0.20 : the modality effect after correcting for publication bias (Reinwein 2012)
- about 35 minutes : the lesson length past which the personalization effect disappears (Ginns, Martin, and Marsh 2013)
- about 6 minutes : the point where engagement drops sharply across 6.9 million online video sessions (Guo, Kim, and Rubin 2014)
- 15 principles : the count in Mayer's 2021 third edition, up from the original set
Memorable Quotes
"Media are mere vehicles that deliver instruction but do not influence student achievement any more than the truck that delivers our groceries causes changes in our nutrition."
Richard E. Clark (1983)
"People learn more deeply from words and pictures than from words alone."
Richard Mayer, the multimedia principle
"The goal of our research is to figure out how to use words and pictures to foster meaningful learning."
Mayer and Moreno (2003)
"These results provide promising preliminary evidence for the voice principle, but a larger evidence base is needed."
Richard Mayer, hedging one of his own principles
"Educators should have more conservative expectations."
Noetel et al. (2022), on the size of the independent effects
The Big Idea
For a hundred years, each new medium promised to transform education, and each one quietly disappointed, because the field kept asking the wrong question: what can this new machine do for students? Richard Mayer replaced it with a better one. Given how the mind actually works, how should we design the message? His answer is a set of roughly fifteen principles, each a small and testable rule for not overloading a narrow mental channel. Put the words where the picture is. Say it while you show it. Cut the interesting but irrelevant extra. Let the ear carry the words while the eyes watch the animation. The principles are real and useful, but they are moderate in size, bounded by conditions like lesson length and pacing, strongest for the learners who know the least, and smaller than Mayer's own laboratory numbers once independent researchers pool the wider evidence. That is the honest picture. Combining words and pictures is not automatically better. It is better only when the design respects the limits of the mind. Get the principles right and they compound into a genuinely better lesson. Get the theory wrong, by adding more media, more features, and more interesting extras, and you can make learning worse while feeling certain you have improved it.
Next Episode Preview
Episode 28: Concept Mapping : Mayer showed us how to combine words and pictures on a screen. But what if the most powerful visual tool is not something you look at, but something you build yourself? Next time we explore the science of concept mapping, and why making the diagram with your own hands can beat studying a finished one that someone handed you.
What is The Knowledge Architects: Building Wisdom in the Information Age?
The Knowledge Architects is a free, science-based podcast exploring how we learn, remember, and organize knowledge. Each episode translates peer-reviewed research from cognitive science, neuroscience, and psychology into practical insights—helping you understand how your mind works and how to work with it more effectively. Brought to you by ElysFlow.