The Knowledge Architects: Building Wisdom in the Information Age


Episode Summary

In 1969, a Cornell professor began a study that would take him twenty-two years to publish. He taught science to six and seven year olds, then kept interviewing them, year after year, all the way through grade twelve. About three years in, he hit a wall. He had a mountain of interview transcripts and no way to see what was actually inside a child's head. The tool his team invented to solve that problem escaped the laboratory, became a worldwide study technique, and forty years later was put on trial in the pages of Science.

For three episodes we have been building an argument. Episode 25 gave us the theory, Episode 26 the phenomenon, Episode 27 the engineering. But in all three, somebody else made the picture and the learner received it. This episode asks what happens when the learner draws it. We trace Joseph Novak's concept map from its origins as a measurement instrument, through David Ausubel's assimilation theory, into one of the larger evidence bases in educational psychology. Then we do the harder thing and read that evidence honestly, because it contains three uncomfortable findings, and every one of them was stated by the field's own researchers.


Key Topics Covered

  • The concept map was deduced, not stumbled upon: Ausubel's theory said cognitive structure is hierarchical, therefore the drawing had to be hierarchical
  • Novak's twelve year longitudinal study, the federal funding it never received, and the kits he ran it on
  • Novak and Musonda (1991): the lasting effect of two years of tape guided science lessons at ages six to eight
  • The quietest finding in that study: ten years of ordinary schooling barely dented the uninstructed children's misconceptions
  • David Ausubel's assimilation theory: meaningful learning versus rote learning, and the epigraph that defined Novak's career
  • Why meaningful learning is volitional, and why the ordinary objective test fails to reward it
  • The rote to meaningful continuum is Novak's amendment: Ausubel resisted it, then published it himself in 2000
  • The formal grammar of a concept map: concepts, linking phrases, propositions, hierarchy, cross links, and the focus question
  • Why the linking phrase is the whole ballgame: it turns a diagram into a claim that can be true or false
  • Mind maps have no words on their lines, so you cannot be wrong on one, only unassociated
  • Mind mapping's evidence base is far weaker than its market share: Farrand et al. (2002) was not statistically significant
  • Trochim's completely different method of the same name, coined one college away at the same university
  • The two meta analyses, and why the second is not an independent replication of the first
  • The comparison condition problem: mapping looks excellent against a lecture and nearly vanishes against an outline
  • Publication bias: published effects run about four times larger than unpublished ones
  • Concept mapping is not among the ten techniques Dunlosky and colleagues rated
  • Karpicke and Blunt (2011) in Science, the eleven author Comment, and the defense the critics missed
  • Blunt and Karpicke (2014): retrieval, not the diagram, is the active ingredient
  • What concept maps are genuinely best at: diagnosis and knowledge elicitation

Researchers Mentioned

  • Joseph D. Novak (1930-2023, Cornell and IHMC) : Invented the concept map around 1972 as a research instrument, then spent fifty years turning it into a theory of education
  • David P. Ausubel (1918-2008) : The physician and psychiatrist whose assimilation theory the concept map is a diagram of; wrote the epigraph that defined Novak's career, then left the field in 1973
  • D. Bob Gowin (Cornell) : Co author of Learning How to Learn (1984), the book that carried concept mapping out of the laboratory
  • Alberto J. Cañas (IHMC) : Built CmapTools, co authored the canonical theory document, and signed the Science Comment
  • John C. Nesbit (Simon Fraser, emeritus) and Olusola O. Adesope (Washington State) : Authors of both major meta analyses, and, unusually, the most reliable skeptics of their own findings
  • Noah L. Schroeder : Lead author of the 2018 meta analysis, the largest synthesis in the field
  • Jeffrey D. Karpicke (Purdue) : Put concept mapping on trial in Science as an untenured assistant professor, then ran the experiment that vindicated it
  • Janell R. Blunt (Purdue) : An undergraduate honors student when the 2011 Science paper was written, later first author on the 2014 resolution
  • Joel J. Mintzes (CSU Chico) : Novak's longtime collaborator and lead author of the Science Comment
  • Donald F. Dansereau (TCU) : The knowledge map tradition, built on a common set of labeled links
  • William M. K. Trochim (Cornell) : Author of a completely different method also called concept mapping
  • Tony Buzan (1942-2019) : Popularized mind maps in 1974, the imposter Novak was least gracious about
  • John Hattie (Melbourne) : Visible Learning ranks concept mapping at d = 0.57, a number worth opening up
  • Maria Araceli Ruiz-Primo and Richard J. Shavelson : The psychometricians who showed that different mapping tasks measure different things

Key Studies and Sources

  • Novak, J.D. and Musonda, D. (1991). "A Twelve-Year Longitudinal Study of Science Concept Learning." American Educational Research Journal, 28(1), 117-153.
  • Ausubel, D.P. (1968). Educational Psychology: A Cognitive View. Holt, Rinehart and Winston. (Epigraph on p. vi.)
  • Novak, J.D. and Gowin, D.B. (1984). Learning How to Learn. Cambridge University Press.
  • Novak, J.D. and Cañas, A.J. (2008). The Theory Underlying Concept Maps and How to Construct and Use Them. IHMC Technical Report CmapTools 2006-01 Rev 01-2008.
  • Nesbit, J.C. and Adesope, O.O. (2006). "Learning With Concept and Knowledge Maps: A Meta-Analysis." Review of Educational Research, 76(3), 413-448.
  • Schroeder, N.L., Nesbit, J.C., Anguiano, C.J., and Adesope, O.O. (2018). "Studying and Constructing Concept Maps: a Meta-Analysis." Educational Psychology Review, 30(2), 431-455.
  • Anastasiou, D., Wirngo, C.N., and Bagos, P. (2024). "Concept Mapping in Science Education: A Meta-Analysis." Educational Psychology Review, 36(2), 39.
  • Karpicke, J.D. and Blunt, J.R. (2011). "Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping." Science, 331(6018), 772-775.
  • Mintzes, J.J., Cañas, A., Coffey, J., et al. (2011). "Comment on 'Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping'." Science, 334(6055), 453.
  • Karpicke, J.D. and Blunt, J.R. (2011). "Response to Comment on 'Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping'." Science, 334(6055), 453.
  • Blunt, J.R. and Karpicke, J.D. (2014). "Learning with retrieval-based concept mapping." Journal of Educational Psychology, 106(3), 849-858.
  • Camerer, C.F. et al. (2018). "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015." Nature Human Behaviour, 2, 637-644.
  • Farrand, P., Hussain, F., and Hennessy, E. (2002). "The efficacy of the mind map study technique." Medical Education, 36(5), 426-431.
  • Trochim, W.M.K. (1989). "An introduction to concept mapping for planning and evaluation." Evaluation and Program Planning, 12(1), 1-16.
  • Dunlosky, J. et al. (2013). "Improving students' learning with effective learning techniques." Psychological Science in the Public Interest, 14(1), 4-58. (Concept mapping is not among the ten rated techniques.)

Key Numbers to Remember

  • 22 years : from the study's start in 1969 to its publication in 1991
  • c. 1972 : the concept map invented, about three years into the study
  • 9.73 vs 4.50 : valid concepts held by instructed and uninstructed students at grade twelve
  • 1.07 vs 6.25 : misconceptions at grade twelve, instructed and uninstructed
  • 7.70 to 6.25 : the uninstructed group's misconceptions from grade two to grade twelve, ten years of schooling
  • 67 effect sizes, 55 studies, 5,818 participants : Nesbit and Adesope (2006)
  • 142 effect sizes, 11,814 participants, g = 0.58 : Schroeder et al. (2018)
  • g = 0.72 vs g = 0.43 : creating a map versus studying someone else's
  • g = 0.74 vs g = 0.194 : constructing a map against a lecture, and against constructing text or an outline
  • 0.2 : the threshold below which Nesbit and Adesope said one may question pedagogical significance
  • g = 1.039 vs g = 0.254 : journal articles versus grey literature (Anastasiou et al. 2024)
  • d = 1.50 : retrieval practice over concept mapping (Karpicke and Blunt 2011)
  • 84% and 75% : students who learned more from retrieval, and students who predicted the opposite
  • 12 days : from the paper appearing online to the eleven author Comment being received
  • d = 0.09 to 0.16, not significant : map versus paragraph within retrieval practice (Blunt and Karpicke 2014)
  • g = 0.32 : what studying somebody else's map is worth to a university student

Memorable Quotes

"We kept asking ourselves, what is really going on in this child's brain? ... We struggled with this problem for several months."
Joseph Novak

"Ausubel's view that knowledge is stored hierarchically in cognitive structure meant that we should seek to show the concepts and propositions in an interview transcript in a hierarchical manner. This kind of structure we called a concept map."
Joseph Novak

"If I had to reduce all of educational psychology to just one principle, I would say this: The most important single factor influencing learning is what the learner already knows. Ascertain this and teach him accordingly."
David Ausubel (1968), p. vi

"As an effect size drops below .2 standard deviations, one may be justified in questioning its pedagogical significance and whether it might be attributed solely to experimenter bias."
Nesbit and Adesope (2006), whose own fairest comparison came in at .194

"We hasten to add that concept mapping itself is not inherently just an elaborative study task... Students could also create concept maps in the absence of materials they are learning, and then the activity would involve practicing retrieval of knowledge."
Karpicke and Blunt (2011), conceding the critique months before it arrived

"This is puzzling, because many papers, including those by the authors, emphasize that concept mapping requires minimal training."
Karpicke and Blunt, Response (2011)

"Retrieval itself, rather than merely the act of writing, drives the benefits of retrieval-based learning activities."
Blunt and Karpicke (2014)

The Big Idea

A concept map is a theory of mind drawn on paper. Its hierarchy and its cross links are not design preferences, they are literal claims about how knowledge is organized, which is why Novak insisted a good map needs both. And it works, genuinely. But it works because of what it makes you do, not because of what it is. When Karpicke and Blunt put it on trial in Science, concept mapping lost so badly that eleven senior figures of the field wrote a rebuttal. They argued about training hours and laboratory sterility, and they missed the one defense that would have worked, which its attacker had already named in the original paper: the students drew their maps while looking at the text. Three years later the decisive experiment isolated the active ingredient, and it was not the diagram. Move the paper away and mapping ties free recall; leave it there and mapping becomes a sophisticated form of copying. The column that predicts learning is not "which format?" but "was the text present?" A decade long fight, resolved by moving one piece of paper.


Next Episode Preview

Episode 29: The Brain's Inner GPS : We spent this episode drawing knowledge as a map. But your brain already has mapping hardware, actual cells that fire when you are in a particular place, and a grid system that tiles space like graph paper. It won a Nobel Prize in 2014. And it may explain why "where were we?" is such a natural question to ask about ideas.


What is The Knowledge Architects: Building Wisdom in the Information Age?

The Knowledge Architects is a free, science-based podcast exploring how we learn, remember, and organize knowledge. Each episode translates peer-reviewed research from cognitive science, neuroscience, and psychology into practical insights—helping you understand how your mind works and how to work with it more effectively. Brought to you by ElysFlow.