WEBVTT NOTE This file was generated by Descript 00:00:03.581 --> 00:00:12.871 Gene Tavernetti: Welcome to Better Teaching, Only Stuff That Works, a podcast for teachers, instructional coaches, administrators, and anyone else who supports teachers in the classroom. 00:00:13.701 --> 00:00:19.701 This show is a proud member of the BE Podcast Network shows that help you go beyond education. 00:00:20.121 --> 00:00:24.471 Find all our shows@bepodcastnetwork.com. 00:00:24.971 --> 00:00:27.731 I Am Gene Tavernetti the host for this podcast. 00:00:27.821 --> 00:00:35.711 And my goal for this episode, like all episodes, is that you laugh at least once and that you leave with an actionable idea for better teaching. 00:00:36.331 --> 00:00:38.881 A quick reminder, no cliches, no buzzwords. 00:00:39.216 --> 00:00:40.586 Only stuff that works. 00:00:41.521 --> 00:00:43.461 My guest today is Dr. Brian Ponce. 00:00:44.481 --> 00:00:48.271 Brian is a professor of school psychology at Oklahoma State University. 00:00:48.711 --> 00:00:56.111 His research focuses on academic interventions and behavioral principles of learning, specifically in the area of mathematics. 00:00:56.851 --> 00:01:15.851 Dr. Ponce created the Measures and Interventions for Numeracy Development, M-I-N-D, MIND, and Facts on Fire, a set of free materials to support teachers in the assessment and implementation of empirically validated interventions to increase early numeracy and computation skills. 00:01:16.341 --> 00:01:22.721 He is co-author of Effective Math Interventions: A Guide to Improving Whole Number Knowledge. 00:01:23.241 --> 00:01:25.471 I think you're gonna find this one interesting. 00:01:25.521 --> 00:01:26.961 I think you're gonna like it. 00:01:28.140 --> 00:01:32.760 Brian, thank you so much for being on Better Teaching: Only Stuff That Works. 00:01:32.810 --> 00:01:34.110 Brian Poncy: All right. 00:01:34.110 --> 00:01:35.630 Well, thank you so much for having me. 00:01:35.630 --> 00:01:36.940 I'm excited to be here. 00:01:36.940 --> 00:01:40.190 I love listening to your podcast, and so let's get cracking. 00:01:40.580 --> 00:01:41.500 Gene Tavernetti: All right. 00:01:41.570 --> 00:01:50.740 Well, I have heard you on several podcasts and talking about fluency, fact fluency, and I know you have a couple programs. 00:01:50.740 --> 00:01:56.660 Could you describe the programs that you've developed and and kinda how they are available to folks? 00:01:57.600 --> 00:01:57.860 Brian Poncy: Yeah. 00:01:57.860 --> 00:02:00.430 So, yeah, I'm a school psychologist by training. 00:02:00.940 --> 00:02:07.980 And because of that, I you know, when I worked in schools, and now that I'm a professor, we have practicum students that are out in schools. 00:02:08.370 --> 00:02:14.570 And so invariably we get children referred to us, you know, that struggle with their basic f- basic facts in math. 00:02:14.610 --> 00:02:23.670 But I mean, is, whether it's reading or math or writing you know, kids generally are just not fluent or accurate or fluent in their kind of basic skills. 00:02:24.080 --> 00:02:41.820 And so I saw this a decade ago, and so I created what was called the Measures and Interventions for Numeracy Development, MIND with, it has periods in between because somebody else has Mind Math, and mine's- They, they, they contacted me, and- Right, 00:02:41.820 --> 00:02:42.120 Gene Tavernetti: right. 00:02:42.150 --> 00:02:42.390 Sure 00:02:42.390 --> 00:02:44.700 ... Brian Poncy: people were getting confused, so anyway. 00:02:45.060 --> 00:03:01.290 But what I did was really that was a resource for tiered supports, and it was basically like, you know, here's, we're gonna kind of task analyze these computation skills, and we're gonna have kinda sub-skill mastery measures where you can assess students, look at patterns in responding. 00:03:01.290 --> 00:03:10.670 And then there was basically four interventions that you could use, flashcard drill cover, copy, compare tape problems, and explicit timing. 00:03:10.830 --> 00:03:22.050 And so, and basically we had intervention materials, supports, treatment integrity forms, and so that, you know, people could you know, drive those types of practices in their schools. 00:03:22.730 --> 00:03:23.490 And so that- You don't- So that- 00:03:23.690 --> 00:03:23.880 Gene Tavernetti: Yeah 00:03:23.940 --> 00:03:25.020 ... Brian Poncy: that was the initial one. 00:03:25.900 --> 00:03:26.450 Yeah, sorry. 00:03:26.950 --> 00:03:27.110 Gene Tavernetti: No. 00:03:27.110 --> 00:03:29.690 I was just gonna say, you know, you listed the four. 00:03:29.840 --> 00:03:32.280 Could you list them again quickly so I don't have to remember? 00:03:32.880 --> 00:03:34.170 The Yeah. 00:03:34.200 --> 00:03:35.410 Brian Poncy: A flashcard drill. 00:03:35.780 --> 00:03:35.840 Okay. 00:03:35.840 --> 00:03:41.510 And of course, after you know, I mean, flashcards are the vehicle, the drill and practice is the instruction. 00:03:41.510 --> 00:03:50.000 And so- Right ... in that light you know, and so, you know, we kinda get into ratios to start with, and then how to adapt that based off a student responding. 00:03:50.390 --> 00:03:56.230 Cover, copy, compare is where, you know, you have a problem, the problem's on the page with a space next to it. 00:03:56.490 --> 00:04:02.170 The kids look at it, they cover it, they write it, and then they uncover it to make sure they're correct. 00:04:02.170 --> 00:04:07.430 So it's basically a self-mediated flashcard intervention where, you know, the kid kinda does it. 00:04:07.680 --> 00:04:20.940 Tape problems is a time delay procedure, and that is when a child will look at a problem, like three plus eight, and then the tape will read, "Three plus eight is," and it gives a two-second delay, and they have to try to beat that. 00:04:20.940 --> 00:04:23.500 And if they don't, they get immediate feedback on that. 00:04:23.770 --> 00:04:32.950 So again, with those three, whether it's flashcard drill, cover, copy, compare, tape problem, there's all an an- there's an antecedent component to all of those. 00:04:33.330 --> 00:04:39.040 And then obviously the student responds, but in all of those, the child gets immediate feedback on whether they're right or wrong. 00:04:39.290 --> 00:04:43.140 So those interventions are really good to build accurate responding. 00:04:43.430 --> 00:04:54.950 And obviously, if you're working one-on-one with flashcards versus tape problems, which you could do in a group, you see that saliency of the antecedent and the consequent procedures kind of lessen. 00:04:54.950 --> 00:05:06.120 And what that does is it allows for increased rates of responding, and you're kind of fading that support for students until then you would go to explicit timing, which is timed retrieval practice. 00:05:06.760 --> 00:05:07.120 But again- 00:05:07.450 --> 00:05:07.620 Gene Tavernetti: Yeah 00:05:08.090 --> 00:05:12.250 ... Brian Poncy: but again, that tape prac- pr- problems is that bridge there, right? 00:05:12.250 --> 00:05:23.920 Because it has the immediate feedback, but what you're really doing is you're trying to get the child to kinda independently retrieve that before they need the the consequent procedure or the feedback on it. 00:05:24.580 --> 00:05:39.110 Gene Tavernetti: You basically answered my follow-up question, which is everybody's heard of flashcards, everybody's heard of the things that you've talked about, but it's not necessarily it's the flashcard, it is how you implement what you're doing w- with the kids. 00:05:39.380 --> 00:05:41.640 So let's just take flashcards for a second. 00:05:42.080 --> 00:05:44.620 You have some str- I'm gonna say strict guidelines. 00:05:44.620 --> 00:05:47.290 You have some protocols for the teachers to use. 00:05:47.580 --> 00:05:56.180 Where do teachers... Where have you found that the flashcards have not been used properly that you don't get the impact that it could have had? 00:05:57.010 --> 00:05:57.240 Brian Poncy: Yeah. 00:05:57.240 --> 00:06:03.215 So it's all about set size- opportunities to respond and repetitions, right? 00:06:03.215 --> 00:06:09.545 So for example the flashcard is, it's just literally a medium for the information. 00:06:10.115 --> 00:06:18.305 And so if I was at home and I was teaching 50 sight words and I went through them all one time, it's not gonna work, right? 00:06:18.755 --> 00:06:24.335 And so, again so what I see is that, you know, people need to control those ratios. 00:06:24.335 --> 00:06:26.145 So there's a really interesting study. 00:06:26.515 --> 00:06:27.315 It's it's old. 00:06:27.315 --> 00:06:43.345 It's 2008, but it's Nestin Joseph, and they compared all unknowns, a folding in technique, which was, like, three to s- three unknowns to six knowns, and then an incremental rehearsal, which was one known to nine unknowns. 00:06:43.695 --> 00:06:54.765 And anyway, they compared all of those three, and they looked at the amount of words learned, and then they also looked at the kind of efficiency and the rate of learning. 00:06:55.085 --> 00:07:01.085 And so what they found was the most effective was incremental rehearsal, but it also took the most time. 00:07:01.615 --> 00:07:05.965 And so, you know, so most kids responded best to all unknown, right? 00:07:06.025 --> 00:07:09.385 And when I said that, that would be words learned per instructional minute. 00:07:09.785 --> 00:07:14.695 But the amount of words learned per session the most was with incremental rehearsal. 00:07:14.695 --> 00:07:18.935 And if we think about that, it's really all about OTRs or repetitions. 00:07:19.225 --> 00:07:28.835 And so when I'm working with kids from typically developing to maybe intellectually disabled, it's all about understanding the set size and the OTR. 00:07:28.835 --> 00:07:33.965 So I could do 10 flashcards with five repetitions, see how the kid does. 00:07:33.965 --> 00:07:38.345 Let's say they don't, so then I could do five cards with 10 repetitions. 00:07:38.615 --> 00:07:43.665 In both cases, the kid would get, you know, 50 repetitions in their sight words. 00:07:43.965 --> 00:07:49.485 And then, like, if a kid, if you could do 10 words with five repetitions, obviously you would wanna do that. 00:07:49.515 --> 00:07:53.935 But if that didn't work for the student, you could do five cards with 10 repetitions. 00:07:54.215 --> 00:08:00.225 And so you kind of search for those ratios to see, you know, how a child learns most efficiently. 00:08:00.575 --> 00:08:07.475 And that should be kind of the purpose of response to intervention models you know, when we look at special education eligibility. 00:08:08.195 --> 00:08:21.575 Gene Tavernetti: Okay, I wanna talk w- a lot more about that later, but just k- kind of, kind of a clarification here or on the, On the expectations of this program, because you mentioned, you know, th- this has been going on for years. 00:08:22.085 --> 00:08:29.335 It's been going on as lo- you know, I've only been in education since 1977, and it's been going on since then. 00:08:29.775 --> 00:08:36.205 And it's almost has been, ... And then when I started consulting in lots of schools, it would be the same thing. 00:08:36.205 --> 00:08:42.705 It's like, "Well, we have ... Our kids don't know math facts." And the question should be, "Well, what are you doing about it?" 00:08:43.125 --> 00:08:43.535 Okay. 00:08:43.755 --> 00:08:54.705 So if you're doing something like, like your program let's say in a general ed setting is it, are these is this program appropriate for a general ed setting? 00:08:56.035 --> 00:09:03.535 Brian Poncy: Well, the initial one, we kind of combined interventions, and we did cover, copy, compare, and explicit timing. 00:09:03.905 --> 00:09:06.735 And so I called it the skill remediation package. 00:09:07.215 --> 00:09:11.975 And so, basically what a teacher would do is they would assess every kid in the class. 00:09:12.275 --> 00:09:21.335 They would place them in their instructional level, and then, I mean, that might be in a fourth-grade classroom, you had sums to 10, sums to 18 multiplication. 00:09:21.365 --> 00:09:22.675 I mean, all over the place, right? 00:09:22.675 --> 00:09:30.045 But you could have 30 kids on different things all working in unison because the intervention procedures were the same, right? 00:09:30.045 --> 00:09:44.005 It was four 2-minute blocks, and kids were either using cover, copy, compare if they were kind of low with fluency and needed to focus on some accuracy-building components, or it would be all explicit timing, right? 00:09:44.155 --> 00:09:47.945 But what was interesting is where we differentiated it was with the curriculum. 00:09:48.185 --> 00:09:50.425 So the intervention procedures were the same. 00:09:50.655 --> 00:09:54.585 The curricular materials were differentiated across students. 00:09:54.955 --> 00:09:59.065 And so in that case, I was like, "I came up with a great intervention." But guess what? 00:09:59.245 --> 00:10:09.445 I started, like, teachers were like, I would get these superstar teachers that would find it, 'cause you know, I never really talked about it, and I wasn't on a podcast till like 2024. 00:10:09.885 --> 00:10:24.375 And they would get it, and they would be like, "This is so great and it's free and it works. I'm gonna get my colleagues to do it." And the colleagues were like, "Oh gosh, no. This is way too much work." 'Cause you had to assess the kids, place the kids, do intervention all week, score it. 00:10:24.705 --> 00:10:27.855 You know, see if the kids moved from skill or intervention. 00:10:28.105 --> 00:10:31.265 You'd have to, you know, reprint stuff for the next week. 00:10:31.575 --> 00:10:42.945 And so there's constantly this kind of assessment and intervention feedback loop, which I thought was fantastic, but I mean, teachers don't have time to go to the restroom sometimes during the day. 00:10:43.275 --> 00:10:49.415 So obviously asking them to do these things you know, it's just it was too large of a lift. 00:10:49.705 --> 00:11:00.665 And so then as teachers you know, kind of communicated these things with me, I was like I need to come up with something for Tier 1 to support teachers," and that's where Facts on Fire 2.0 came in. 00:11:00.945 --> 00:11:05.215 And my goal with that is I need to lessen the amount of effort on the teacher. 00:11:05.565 --> 00:11:08.955 I need to ensure you know, that it works really well with kids. 00:11:09.175 --> 00:11:16.945 I need to kind of, you know, keep kids uniform since it is tier, Tier 1.5, as Dr. Vanderheyden calls it. 00:11:16.975 --> 00:11:28.465 But I mean, honestly, I just... A- and the other thing is as a school psychology profes- person, going in and assessing it was never an isolated 20% of kids that were struggling with math facts. 00:11:28.815 --> 00:11:44.155 It's widespread And so, like, I mean, I know when I go into any school I don't even tell them, "Well, why don't you assess your kids and see if they don't know their facts?" 'Cause I've yet to have anybody come back and be like, "Yep, our kids are pretty fluent with their math." Not one time. 00:11:44.515 --> 00:11:44.665 Gene Tavernetti: Oh. 00:11:44.665 --> 00:11:45.135 Brian Poncy: Not one time. 00:11:45.135 --> 00:11:45.205 Okay. 00:11:45.205 --> 00:11:59.535 Like, I was talking to a school today, and they assessed their kids up to fourth grade, and you know, they use illustrative math as their core curriculum, and all of their kids started at sums to 10, whether they were in first grade or 10th grade. 00:11:59.535 --> 00:12:19.915 And they supplemented with Jennifer Bay-Williams and, you know, their math specialist and people were doing probably a wonderful job teaching the things they were taught in their colleges of ed, which was, "We don't want kids to memorize their facts because, you know, that's gonna prevent them from multiple strategies and coming up thing, you know, with things on their own." 00:12:20.245 --> 00:12:24.075 And that, to me, is kind of the crux right now in education. 00:12:24.075 --> 00:12:38.575 Like, any fourth grade teacher will tell you, "I can't teach what I'm supposed to teach 'cause kids can't access the curriculum." But if you ask people, "Well, why are you doing what you're doing?" And it's like, "Well, I want, we, you know, well, we want kids to think flexibly." 00:12:38.575 --> 00:12:43.155 Like, that's the big definition of NCTM with fluency, is about flexibility. 00:12:43.425 --> 00:12:46.365 And that's a really important skill for kids to have. 00:12:46.905 --> 00:12:54.545 But if they build accuracy and then they memorize the fact, that is the bridge to the multiple strategies and flexibility. 00:12:54.905 --> 00:12:57.585 And so, again, there's kinda research that shows this. 00:12:57.895 --> 00:12:58.965 It's correlational. 00:12:58.965 --> 00:13:00.745 There's not a ton of it out there. 00:13:01.035 --> 00:13:29.485 But, you know, as I see it, and I think the data that's coming in from my grant work and some other things where we're using Facts on Fire broad math scores are going up quite a bit from just six minutes of you know, timed practice, and that's probably due to the fact that it is increasing kids' skill and allowing them access to the curricula, which most core curricula are focused on representations and multiple strategies. 00:13:30.005 --> 00:13:30.385 Gene Tavernetti: All right. 00:13:30.385 --> 00:13:38.425 So you touched on my next question because y- I think if folks are listening to this podcast we'll just stipulate what you just said. 00:13:38.425 --> 00:13:40.995 We agree with the kids needing to know their math facts. 00:13:41.335 --> 00:13:47.115 So then the next question is, Well, the first question is, what do we do? 00:13:47.145 --> 00:13:48.085 And you answered that. 00:13:48.085 --> 00:13:49.135 You've got your program. 00:13:49.725 --> 00:13:53.395 Now the question is, like, how much time does it take? 00:13:53.395 --> 00:14:05.665 What is actually the investment of time in a day, in a week for a a tier one classroom teacher to be able to administer and oversee this program? 00:14:06.475 --> 00:14:10.175 Brian Poncy: I would say 10 minutes, and I'm being con- and I'm being liberal. 00:14:10.665 --> 00:14:11.035 Right? 00:14:11.035 --> 00:14:23.335 So the the, there's a tape problems and an explicit timing piece- The tape problems takes about three and a half minutes to four minutes, and then the explicit timing is one minute. 00:14:23.835 --> 00:14:26.785 And we have a, like a whiteboard type. 00:14:26.845 --> 00:14:27.995 Like, you would download it. 00:14:28.255 --> 00:14:29.615 You would get it on the whiteboard. 00:14:29.615 --> 00:14:30.935 It reads the directions. 00:14:30.935 --> 00:14:32.585 It times everything out. 00:14:32.925 --> 00:14:36.795 You know, the students have their workbooks that match kind of the instruction. 00:14:37.165 --> 00:14:42.525 And so if a teacher's really good with her transitions, she can have it done in six minutes per day. 00:14:43.095 --> 00:14:47.085 And so, you know, so six minutes per day obviously is 30 minutes per week. 00:14:48.285 --> 00:14:48.575 Gene Tavernetti: Wow. 00:14:48.785 --> 00:14:59.695 Okay, and just to be clear, because the first time I heard you talk about the taped the taped component, I was a little bit confused because I know Eureka Math uses a tape model. 00:15:00.015 --> 00:15:03.415 So but when you say tape, are you talking about recorded? 00:15:03.455 --> 00:15:04.635 There's something recorded. 00:15:05.135 --> 00:15:09.365 Brian Poncy: Yeah, back when I was in graduate school, we used tapes , tape record- Okay. 00:15:09.515 --> 00:15:09.795 Gene Tavernetti: Yeah. 00:15:09.825 --> 00:15:10.155 Okay ... until 00:15:10.155 --> 00:15:11.285 Brian Poncy: we went to CDs. 00:15:11.285 --> 00:15:13.305 But yeah, it's basically an audio cue. 00:15:13.595 --> 00:15:13.815 Gene Tavernetti: Okay. 00:15:13.815 --> 00:15:13.925 And 00:15:13.925 --> 00:15:15.605 Brian Poncy: it, yeah, it paces the kids. 00:15:15.605 --> 00:15:20.065 And again the program is very carefully sequenced with its sets. 00:15:20.115 --> 00:15:27.275 And so like when I talked a little bit about flashcards and what makes them effective or ineffective you know, I the... 00:15:27.445 --> 00:15:37.505 So, so if we take sums to 10 Facts on Fire is literally 30 lessons, and there's 12 problems in the first 15 lessons, and then there's 12 problems in the second. 00:15:37.945 --> 00:15:44.315 So when you look at you assess for one minute and get a baseline on all of those 16 problems. 00:15:44.465 --> 00:15:49.575 For most kids it's usually around six to 10 problems per minute. 00:15:49.945 --> 00:15:50.375 Okay? 00:15:50.895 --> 00:15:54.595 And then lesson one, we isolate four problems. 00:15:54.635 --> 00:16:00.595 And so that taped problems piece, it does four items, so it restricts it to four items. 00:16:00.845 --> 00:16:07.585 It does six repetitions, and then the following one-minute timing times them on only those four problems. 00:16:08.235 --> 00:16:10.365 Okay, and then it goes to lesson two. 00:16:10.605 --> 00:16:15.695 It folds out one problem, it folds in one problem, and they do the same thing. 00:16:15.695 --> 00:16:24.445 And so over the initial first 15 lessons, the first 10 of those is just systematically incorporating you know, new items. 00:16:24.445 --> 00:16:32.925 So by the time they're done with the 10 lessons, they've been exposed to all 12 items in very small sets with high repetition. 00:16:32.925 --> 00:16:43.165 So in tape problems, four items, six repetitions, and then of course they go into the timed practice so that they can independently com- complete those, right? 00:16:43.505 --> 00:16:50.415 And then the last five lessons of that 15 lesson is we- we call warming up, and that is just retrieval practice. 00:16:50.985 --> 00:16:53.875 Gene Tavernetti: So you have so this is all laid out for the teachers. 00:16:54.225 --> 00:16:57.095 And let's assume that a teacher does this. 00:16:57.975 --> 00:17:05.720 Is there a- percentage of kids that are not going to learn their math facts this way? 00:17:06.200 --> 00:17:09.880 You know, does this... I guess I'm asking does this work for everybody? 00:17:10.990 --> 00:17:18.020 Is there checkpoints to be able to say, "Well, maybe we need to do some of the interventions that you talked about earlier"? 00:17:18.050 --> 00:17:20.550 What should be the expectation in a tier one class? 00:17:20.910 --> 00:17:27.900 Brian Poncy: That's such a fantastic question, and unfortunately it is not the panacea and cure-all that I hoped it would be. 00:17:28.320 --> 00:17:28.640 Gene Tavernetti: But 00:17:29.260 --> 00:17:46.820 Brian Poncy: you know, what happens is A, kids need to obviously have, You know, like, if you start the program, it goes all the way back to kindergarten, and kids have to count, and they have to write numbers, and then they subitize, and then they combine kind of sets and learn larger and smaller. 00:17:47.120 --> 00:17:49.210 And so, you know, there's things that happen. 00:17:49.210 --> 00:17:53.170 So, you know, when we start with sums to six, kids already can count. 00:17:53.170 --> 00:17:55.160 They have one-to-one correspondence. 00:17:55.230 --> 00:17:56.750 They've practiced these things. 00:17:57.030 --> 00:18:01.380 And this works great when a kid starts from kindergarten and goes through the whole program. 00:18:01.680 --> 00:18:10.600 You know, so you're never gonna put a kid in unless they have prerequisite skills kind of known and able to do those fluently. 00:18:10.750 --> 00:18:20.010 But when teachers start this in, like, fourth grade, there's a whole host of skills that kids might have been taught and might or might have learned, right? 00:18:20.010 --> 00:18:20.820 Might not have learned. 00:18:21.510 --> 00:18:23.440 And so that complicates things. 00:18:23.440 --> 00:18:34.830 And so, what we're finding with our initial results is your typical kid will generally double double their baseline to the end of the program fact. 00:18:34.830 --> 00:18:40.250 And so the end of the program is usually either a six or a nine-week you know, kind of investment. 00:18:40.250 --> 00:18:46.150 And so if a kid starts... and I do things with problems per minute, not digits correct per minute. 00:18:46.590 --> 00:18:57.950 But anyway, kids generally will start between 8 and 12, and then at the end of the intervention, they're generally up in that 20 to 25 problem per minute range. 00:18:58.640 --> 00:18:58.880 Gene Tavernetti: Okay. 00:18:58.880 --> 00:19:02.920 And so- Just to... I just wanna be, be clear again in the language. 00:19:03.330 --> 00:19:06.470 You're calling the entire program an intervention. 00:19:06.470 --> 00:19:16.270 You're not talking about, "Let's take these kids out. Let's have an intervention teacher." This is an intervention for the entire class for math. 00:19:17.200 --> 00:19:17.630 Brian Poncy: That's right. 00:19:17.670 --> 00:19:27.510 Because again- Okay ... yeah, 'cause again, you go into any school, and their core curriculum are generally you know, more in query and concept-based, which I'm fine with. 00:19:28.010 --> 00:19:42.755 But because they are so ambitious and teaching so many standards and concepts they don't really provide that they, they don't provide that time for dedicated practice, and that's where Facts on Fire comes in. 00:19:43.255 --> 00:19:52.035 And so you basically know regardless of what you're doing, probably supplementation to kind of, automatize your basic facts is a good idea. 00:19:52.735 --> 00:20:16.995 Gene Tavernetti: Well, you know, it's interest- it's interesting, like, I said, you know, I just talked about the word intervention, and because I know I've talked to Sarah Powell before, you know, University of Texas and her math, and she started out as an interventionist, you know, working with struggling s- kids, not necessarily identified for special ed but struggling students as you talked about here. 00:20:17.525 --> 00:20:23.855 And then I've talked to Sarah Oberly about executive functions and how, you know, these are for all kids. 00:20:24.125 --> 00:20:30.735 And I talked to Faith Howard about the literacy work she's doing in secondary with her with her intervention. 00:20:30.775 --> 00:20:36.055 But what she's doing in her intervention class is exactly what she's doing with her regular ed students. 00:20:36.335 --> 00:20:45.805 So I I've always been puzzled by these programs that are successful and that have been proven successful. 00:20:46.225 --> 00:20:52.165 Why haven't they migrated to tier one and just say, "This is what we do in tier one instruction"? 00:20:53.600 --> 00:21:03.441 Brian Poncy: Yeah, because generally really successful interventions like, like mine, they're very, they're reduced down to a very kind of- Target skill, right? 00:21:03.441 --> 00:21:05.121 So I look at computation. 00:21:05.511 --> 00:21:12.241 When I go out and I train schools, I never tell them like, "Well, you get your kids automatic in their math facts, we're done. 00:21:12.241 --> 00:21:14.981 Pat ourselves on the back." "This is fantastic," right? 00:21:15.361 --> 00:21:25.321 Like literally i- if alls my program did was affect their fact scores their computation scores, and not their broad math scores, then why would we do what we're doing? 00:21:25.721 --> 00:21:31.761 But where I think core curricula, they try to be they try to be everything to everybody. 00:21:31.961 --> 00:21:36.821 And because they do that, they're a jack of all trades, master of none, so to speak. 00:21:37.221 --> 00:22:00.501 And so what people like Dr. Powell have done is, you know, look at vocabulary instruction or scheme instruction, or me with computation instruction, and we've just said we are gonna very carefully scope and sequence what we do, how we design it, how we sequence it, so kids are constantly being introduced to one new thing all the time, right? 00:22:00.611 --> 00:22:07.221 A- as compared to you may go a week and now you do another unit that's not even related to it, right? 00:22:07.501 --> 00:22:12.381 And so it's just not scope and sequenced in a way that's skill-focused. 00:22:12.381 --> 00:22:15.591 It's more idea-focused, I think, in those core curricula. 00:22:15.931 --> 00:22:22.181 And of course, we know to think and to kind of connect concepts and ideas, we have to have a lot of skills. 00:22:22.401 --> 00:22:32.031 Well, I think sometimes the core curriculums focus on concepts and ideas really outpaces the skills they're building within the students. 00:22:32.031 --> 00:22:34.321 What we do is just focus on the skills. 00:22:34.681 --> 00:22:47.521 And then lo and behold, when kids get the vocabulary and the fact skills and the schemas, you know, now all of a sudden when teachers are teaching, you know, the concepts and the ideas, they have the things to connect. 00:22:47.521 --> 00:22:48.991 They have access to it. 00:22:49.291 --> 00:23:06.791 And, you know, the same teacher that was ineffective like two years before- ... they do Maths on Fire, now all of a sudden their state test scores increase a lot, and their map scores or their benchmark scores increase because the kids coming to them have that better skill base. 00:23:07.081 --> 00:23:10.561 And so it's not all a all or none, right? 00:23:10.611 --> 00:23:14.971 It's we need to do... A- and it's not about balance either, so I hate that term. 00:23:15.021 --> 00:23:22.531 But I mean, we have to be very systematic and programmed about how we design curriculum, match instruction to that. 00:23:22.811 --> 00:23:27.161 And, you know, as Dr. Oberly like talked about on y- on your podcast, right? 00:23:27.161 --> 00:23:31.561 Like- ... there's things, especially for young kids, that we need to take into account. 00:23:31.811 --> 00:23:36.221 So for example, when she talked about executive functioning, well, think about my program. 00:23:36.651 --> 00:23:41.091 They get the s- the same whiteboard, the same directions, the same structure. 00:23:41.301 --> 00:23:42.811 Everything's predictable. 00:23:43.081 --> 00:23:44.091 They're setting goals. 00:23:44.091 --> 00:23:45.401 The routine's all there. 00:23:45.601 --> 00:23:46.611 Well, what's that do? 00:23:46.641 --> 00:23:53.981 It allows the student to focus in on exactly what we want them to do, and there's no confusion about what we're asking them to do, right? 00:23:53.981 --> 00:23:54.231 Right, 00:23:54.281 --> 00:23:54.561 Gene Tavernetti: right. 00:23:55.031 --> 00:24:13.431 Brian Poncy: So when people are like, "How does that work so well?" Well, it's design, and so i- it's scope and sequence that's matched to instruction that takes into account those kind of environmental variables that can kind of add to distracting or kind of overloading students in the process. 00:24:14.098 --> 00:24:26.328 Gene Tavernetti: So, if a Tier 1 teacher does what you just described and again, we're looking at the fact fluency math, you know, m- math facts, not the general math capabilities. 00:24:27.148 --> 00:24:32.008 But if they do that I wanna ask you a percentage and I'm gonna give it some context this time. 00:24:32.308 --> 00:24:45.918 So, i, I thi- I think like in California, I know at one time, you know, if you had over 10% of your kids identified for special ed state was gonna come looking at you- Mm-hmm ... 'cause you've ident- you've identified too many kids. 00:24:46.258 --> 00:24:46.648 Brian Poncy: Yes. 00:24:46.898 --> 00:25:01.418 Gene Tavernetti: So if a teacher and I would guess that some of, only some of those kids would have some sort of deficit or discrepancy or whatever word I'm supposed to be using you know, today in math. 00:25:01.458 --> 00:25:02.348 It would be in math. 00:25:03.308 --> 00:25:09.318 So what would be a an expectation of a classroom teacher doing this well? 00:25:10.128 --> 00:25:13.638 Could she expect 95% of the kids to be successful? 00:25:13.638 --> 00:25:13.828 All 00:25:14.588 --> 00:25:14.808 Brian Poncy: right. 00:25:15.048 --> 00:25:16.928 I wish I could share screen with you. 00:25:16.928 --> 00:25:16.988 Okay. 00:25:16.988 --> 00:25:23.648 I literally have bo- I have box plots up, and I know this- Okay ... doesn't help your audience, but let's put it this way. 00:25:23.648 --> 00:25:41.488 In first grade the average kid was about at six problems, and the bottom quar- quartile so, so the 25th percentile was at about four, and the upper 75th percentile was at around 12. 00:25:41.848 --> 00:25:54.338 And so after the 30 lessons the average went from about 8 to 18, and the bottom quartile was from about probably s- 16 to 32. 00:25:54.648 --> 00:25:59.688 And the average, yeah, and the average is, again, right around that kind of 19, 20 area. 00:26:00.048 --> 00:26:03.818 But the point is like in the box plots, they don't overlap. 00:26:04.803 --> 00:26:05.883 Does that make sense? 00:26:05.883 --> 00:26:08.173 So, I mean, are there kids that don't respond? 00:26:08.173 --> 00:26:26.503 Of course, but your bottom 25% of kids went from about three to four problems per minute to about probably 15, 16 problems per minute, and then your upper kids went from about probably it looks around 13 to about 30. 00:26:27.383 --> 00:26:29.559 Gene Tavernetti: And we're talking about a six-week intervention. 00:26:29.589 --> 00:26:29.649 Yeah, 00:26:29.649 --> 00:26:32.459 Brian Poncy: so that, that would be their sums to 10 growth. 00:26:33.239 --> 00:26:33.739 Gene Tavernetti: Okay. 00:26:33.779 --> 00:26:37.219 so in a school year with 36 weeks 00:26:37.749 --> 00:26:38.089 Brian Poncy: Mm-hmm 00:26:38.569 --> 00:26:43.919 ... Gene Tavernetti: we might not get those that much growth replicated, but would there certainly be continued growth? 00:26:44.559 --> 00:26:58.619 Brian Poncy: Yeah, they typically go fr- across about three to four skills in a year, and we suggest right now that you kind of move those kids along uniformly because we don't wanna overload teachers with having to juggle a bunch of balls. 00:26:58.619 --> 00:27:11.459 Although the ones that are using it, they're like, "This works really good," but like I feel like, you know, some kids could really take off and run with this, which they can give them packets and just have them practice on the side, right? 00:27:11.459 --> 00:27:31.849 Now, with tiered intervention, the kids that are non-responders those kids probably need a double dose of this, and with those you'd probably know very early on in the intervention process, like 'cause of the small sets, like four per day, like you would see them grow from that baseline across all the problems on those first four. 00:27:32.089 --> 00:27:42.339 You're gonna wanna see them go from like eight to, you know, 16, 20, 23 problems, you know, because it's on that small set, and that shows that within-session growth. 00:27:42.589 --> 00:27:47.829 And if you get a lot of within-session growth across sessions, you're gonna have good pre/post growth. 00:27:48.099 --> 00:27:48.979 Does that make sense? 00:27:49.019 --> 00:27:50.159 Gene Tavernetti: That make, that makes sense. 00:27:50.159 --> 00:28:08.439 So, so, and this is always, you know, we always wanna know we use these words that are measurement words but sometimes don't mean a lot, so what would be an expectation of proficiency or grade level or, you know, what would we be shooting for in these? 00:28:08.479 --> 00:28:18.859 Brian Poncy: I had that, the same conversation with the school earlier today, and this is how I want people to think about it that's really simple and it cuts through all the psychometric jargon, right? 00:28:19.689 --> 00:28:25.799 So, a- if a kid does six problems per minute- They're doing one problem every 10 seconds. 00:28:26.319 --> 00:28:27.419 That's horrible, right? 00:28:27.939 --> 00:28:34.909 If they do 10 problems a minute, that means a kid is getting a problem right on average every six seconds, right? 00:28:34.909 --> 00:28:51.969 So ask yourself as a teacher, if you're in fourth grade and you give a basic fact assessment and your average is 10, then that means if you show a kid six times four on average, it'll take him six seconds to answer it, okay? 00:28:52.179 --> 00:28:57.929 Now, if we did that with a phonics card or is- like, no one would stand for that. 00:28:57.929 --> 00:29:00.279 So then we get to 20, right? 00:29:00.649 --> 00:29:03.949 And obviously 20 is one problem right every three seconds. 00:29:04.269 --> 00:29:05.809 And then obviously you go up. 00:29:05.809 --> 00:29:10.549 If you get 30 problems per minute, now you got one problem every two seconds. 00:29:10.929 --> 00:29:15.239 And so if... and so, there's a lot of people that have a lot of different criteria. 00:29:15.269 --> 00:29:16.279 This is mastery. 00:29:16.279 --> 00:29:17.599 This is instructional. 00:29:17.999 --> 00:29:23.839 And Matt Burns has done a lot of really great research on it, as Robin Codding, and I've even done some. 00:29:24.229 --> 00:29:31.809 And kids need around 10 digits or 10 problems per minute at least to respond to things like explicit timing. 00:29:32.209 --> 00:29:45.479 And so, you know, to me 10 digits to, to 30 digits is what I have as an instructional range, and that just means that kids can independently kind of do timed practice and they'll respond fairly well to it. 00:29:45.739 --> 00:29:48.439 If they're below that, then that's a frustration level. 00:29:48.439 --> 00:29:49.419 It's really hard. 00:29:49.649 --> 00:30:04.249 I mean, it's taking a kid, you know, six to 10 seconds to do every problem, and so they are deep in a burdensome cumbersome you know, procedure at that point, where they're counting or doing, you know, whatever they're doing to come up with answers. 00:30:04.639 --> 00:30:22.989 And so in the spirit of the program, you know, I want, like, I want kids between 30 and 60 problems per minute, but I know if I go into schools and be like, "Well, we need to set our goal at 60 minutes or 60 problems per minute," you could get there with this program, but you couldn't get there in six minutes a day. 00:30:23.019 --> 00:30:24.909 You'd have to do a higher dose. 00:30:25.479 --> 00:30:36.019 And so, so when I designed this, I'm kinda thinking to myself, "Well, I have to... i- if we don't provide a short enough amount of time, then nobody's gonna adopt it. 00:30:36.299 --> 00:31:07.259 But if we don't do it for enough for a high enough dosage, then kids aren't gonna respond." And so, you know, basically I kind of went with the six-minute timeframe, and what we're seeing is it's getting your average kid pretty much around 25 problems per minute, which in sums to 18 and multiplication is around 40 to 50 correct digits per minute, which is in m- into mastery ranges in, in most kind of research published criteria 00:31:13.324 --> 00:31:14.134 Gene Tavernetti: Well, you know, it's interesting. 00:31:14.134 --> 00:31:21.424 You were gracious enough to share some correspondence you had with a teacher and asking your advice about how to move some students along. 00:31:21.864 --> 00:31:33.294 And one of the things that, that caught my attention that I hadn't thought of before was how quickly a student can actually write and form numbers with a pencil. 00:31:34.564 --> 00:31:34.954 Brian Poncy: Yes. 00:31:34.954 --> 00:31:43.754 Gene Tavernetti: And had never thought... Are there any other confounding factors besides just knowing the facts and writing that you could think of that teachers should be aware of? 00:31:43.804 --> 00:31:52.074 Because, you know, now we see that, you know, handwriting is gonna be, you know, we're gonna emphasize handwriting a little bit more. 00:31:52.074 --> 00:31:55.174 Any other factors that could confound the issues or...? 00:31:56.334 --> 00:32:00.474 Brian Poncy: You know, I look at things as alterable variables, like things we can control. 00:32:00.974 --> 00:32:13.024 And so, you know, I look at, you know, I'm a behaviorist in my training and my philosophy, and so I always wanna do direct observation of behaviors that are amenable to intervention and change. 00:32:13.514 --> 00:32:20.284 And so, you know, are there biophysical genetic, you know, kind of caps on performance? 00:32:20.424 --> 00:32:21.104 Maybe. 00:32:21.184 --> 00:32:22.894 I can't change those. 00:32:23.384 --> 00:32:36.794 And I mean, for example, I did a research study one time it was s- it was second graders, and I shrunk the set and we gave a lot of a lot of practice, but we got the entire, like, second grade class to 80 digits correct per minute. 00:32:36.864 --> 00:32:43.834 I mean, you know, like people will be like, "Well, kids can't really do things that fast." And it's like, well, it depends on how much time you spend on it. 00:32:44.994 --> 00:32:47.064 Gene Tavernetti: Well, it, and it brings me to something else. 00:32:47.174 --> 00:32:52.034 I don't know if y- you, if it was in the stuff that you sent me or somebody else talking about motivation. 00:32:52.664 --> 00:32:52.714 Oh. 00:32:52.714 --> 00:33:10.934 And I think of these, and I think of these kids you know, getting the... I- if they're, they don't do well with their math facts fluency in the early grades, and there's not some sort of effective program like yours, they're doing the same stuff over and over again, day after day, year after year. 00:33:11.829 --> 00:33:14.299 That's gotta be an important factor, the motivation 00:33:14.619 --> 00:33:15.779 Brian Poncy: it's a huge factor. 00:33:15.779 --> 00:33:20.309 And so, you know, as a behaviorist, I refer to that as a learning history. 00:33:20.849 --> 00:33:27.569 And so when kids see things like computation facts on a page yeah, i- if... A- and think about it. 00:33:27.569 --> 00:33:39.989 If you're a teacher and you're like, "Well, I know fact fluency's important, so I'm just gonna go print a worksheet," and the worksheets are randomized, and you do it once a week, you're literally wasting the child's time, right? 00:33:39.989 --> 00:33:53.809 Because they're only... Y- you don't even know what problems they're doing, how many repetitions they're getting, and the, and if it's hard for the kid you know, when you start at the beginning of the year, they're gonna make no growth more than likely across the year. 00:33:53.839 --> 00:34:00.899 Now compare that to, you know, you take a very tightly controlled, and now they're practicing maybe... 00:34:00.899 --> 00:34:02.549 And teachers do this all the time, right? 00:34:02.549 --> 00:34:06.899 They do it with twos, and then they'll move to fives, and then they move to tens. 00:34:06.899 --> 00:34:10.199 And so they'll do these small sets, and kids get those. 00:34:10.449 --> 00:34:13.839 The point is that eventually you gotta interleave all of those together. 00:34:14.219 --> 00:34:16.799 You know, and that's kinda what the fluency practice does. 00:34:16.849 --> 00:34:25.359 But if we think about, you would get small sets to build accuracy, but you also wanna do small sets to build fluency to those really high levels. 00:34:25.639 --> 00:34:30.749 But then you have to be systematic about folding in new problems and interleaving. 00:34:31.099 --> 00:34:36.889 So, you know, like in my program, I start with four problems and I end with four problems. 00:34:36.889 --> 00:34:41.529 But in that time, like, they get exposed to all 36 problems. 00:34:41.529 --> 00:34:52.879 Now, you probably have people listening being like, "What the hell is he talking about, 36 problems?" So what our research has shown is that zeros and ones, like most kids know those and they're rule-governed. 00:34:53.009 --> 00:34:55.109 That's 33% of the problems. 00:34:55.359 --> 00:35:00.919 So if there's 100 problems, you take out zeros and ones, boom, right out the gate, right? 00:35:01.239 --> 00:35:07.459 In addition, what we know is if a kid knows three plus five, they generally know five plus three. 00:35:07.729 --> 00:35:10.879 So boom, now you take out half of the 72. 00:35:11.189 --> 00:35:16.249 That leaves you with 36 individual problems they need to work on automatizing. 00:35:17.239 --> 00:35:22.969 Gene Tavernetti: You know, d- you made me think of something that's I never asked anybody that actually knew the answer. 00:35:23.829 --> 00:35:29.489 So I always wondered, you know, well, the kids know their twos, and they're two, four, six. 00:35:29.489 --> 00:35:30.619 It's almost like a song. 00:35:30.619 --> 00:35:31.849 Same thing with fives. 00:35:32.339 --> 00:35:34.859 Can't we do a song with sixes and sevens? 00:35:35.509 --> 00:35:38.929 I mean, I mean, no I, you know, I know you're laughing, but I'm serious. 00:35:38.929 --> 00:35:43.709 It's like the ones that they don't know, could it, isn't it just as easy to start? 00:35:43.709 --> 00:35:46.899 Because they, it's not like they're knowing the meanings or anything. 00:35:46.899 --> 00:35:46.959 Sure. 00:35:47.329 --> 00:35:53.579 It's like singing, it's like singing the alphabet, which will become useful information later, but they don't know what the letters mean. 00:35:53.579 --> 00:35:54.399 They- It's just a song 00:35:55.114 --> 00:35:57.674 Brian Poncy: It, why is, why are songs important? 00:35:57.854 --> 00:36:00.654 And why do they enhance learning in young children? 00:36:00.654 --> 00:36:01.114 Do you know? 00:36:02.454 --> 00:36:04.334 Gene Tavernetti: That's why I have experts on the show. 00:36:04.764 --> 00:36:05.174 Brian Poncy: Okay. 00:36:05.244 --> 00:36:08.664 So- the ABC Song, do you know what song that is? 00:36:09.064 --> 00:36:09.344 Gene Tavernetti: No. 00:36:10.034 --> 00:36:11.034 Brian Poncy: Twinkle, Little Star. 00:36:11.034 --> 00:36:11.594 Gene Tavernetti: Oh, that's right. 00:36:11.644 --> 00:36:11.784 Brian Poncy: Yes. 00:36:11.784 --> 00:36:11.844 Yeah. 00:36:11.844 --> 00:36:12.024 Okay. 00:36:12.024 --> 00:36:20.604 So, so basically when you s- w- like sing songs, what it does is it allows you like 'cause some people think it's all musical and they do all this. 00:36:20.914 --> 00:36:26.584 But no, what it is it's a learning history of, and it cues how to organize information. 00:36:26.854 --> 00:36:36.564 And so they basically put the letters in order and they kind of hook it into that melody that a child should already know with Twinkle, Little Star. 00:36:36.874 --> 00:36:40.064 And that's why it helps guide and cue that. 00:36:40.424 --> 00:36:44.344 So it's not a biophysical thing that our brains are wired for music. 00:36:44.674 --> 00:36:54.644 It's, you know, about you know, it's about prior knowledge and automatized you know, over repetition with the nursery rhyme that you attach those letters to. 00:36:55.034 --> 00:36:58.304 Gene Tavernetti: So could we find a song for sixes and sevens and eights? 00:36:58.734 --> 00:37:11.294 Brian Poncy: Well, my guess is that I know they're out there, and my guess is if you ask teachers "Do you sing-song your skip counting?" And then you would ask them, "Is it a different song for each number?" And they would be, "Oh, who would do that? 00:37:11.294 --> 00:37:12.184 That's dumb." Yeah. 00:37:12.184 --> 00:37:14.804 "No, it's the same song, it's different numbers," right? 00:37:14.804 --> 00:37:17.664 And- Yeah ... and my guess is that's what, you know, that's why. 00:37:17.714 --> 00:37:29.604 But again, you know, when we think about explicit instruction and how we wanna break things down into small chunks, but also attach it to our prior knowledge, that's why, you know, things like that work. 00:37:29.664 --> 00:37:34.944 But I mean, I've talked to kindergarten teachers, and they're just like, "Kids learn so good with music." 00:37:34.944 --> 00:37:36.514 And it's like, well, let's really think. 00:37:36.834 --> 00:37:38.444 A- and not that it's not true. 00:37:38.444 --> 00:37:39.934 It provides those hooks. 00:37:40.164 --> 00:37:40.224 Yeah. 00:37:40.274 --> 00:37:43.774 But you know, like learning is not magic, right? 00:37:43.774 --> 00:37:54.984 Like learning is not magic, and I wish people would get away from thinking like, "Well, if I knew their processing speed," or, "If I knew this," this somehow would open up this magic. 00:37:54.984 --> 00:37:57.844 It's like, no, learning is really predictable. 00:37:58.194 --> 00:37:59.834 You know, it's about what do they know? 00:37:59.864 --> 00:38:01.164 What am I gonna teach? 00:38:01.194 --> 00:38:04.594 How do I task analyze and break that as, into components? 00:38:04.834 --> 00:38:11.024 And how do I systematically build on one of those you know, to put things together into larger skills? 00:38:11.064 --> 00:38:30.094 So- If people really wanna get into some awesome reading precision teaching and they literally talk about this as tool skills, which would be like writing numbers, and then com- component skills, which would be like your single digit facts, and then a component skill, which would be a multi-digit algorithm. 00:38:30.244 --> 00:38:38.574 And so if you want a kid to basically learn the com- the composite skill, they need to have the tool skills and the component skills. 00:38:38.664 --> 00:38:45.004 And before you learn that component skill, single digit addition, you probably need to have those tool skills as well. 00:38:45.244 --> 00:38:53.694 And so everything's very sequential and you know, built on, every- everything you do instructionally should be dependent on what you've done before. 00:38:54.644 --> 00:39:11.254 Gene Tavernetti: Well, I'm gonna mention it one more time, because if I have a listener who wants to try a teacher who wants to try to go to those six, sevens, and eights earlier- Because I have never talked to a teacher that did say, "Oh, they just have trouble with the six, sevens, and eights." 00:39:11.304 --> 00:39:17.604 And again, listening to you and what I know about instruction, it seemed like maybe those are the ones we should be hitting more. 00:39:18.134 --> 00:39:19.584 They should get- Yeah ... more frequency. 00:39:19.584 --> 00:39:19.664 Now, 00:39:19.864 --> 00:39:22.224 Brian Poncy: are you talking addition or multiplication? 00:39:22.714 --> 00:39:23.814 Gene Tavernetti: Multiplication, yeah. 00:39:24.044 --> 00:39:24.174 Brian Poncy: Yeah. 00:39:24.174 --> 00:39:24.384 Yeah. 00:39:24.584 --> 00:39:27.594 So the problem is, I've had stu- I had a student come in. 00:39:27.594 --> 00:39:36.314 She was a professor's kid, just bright kid, and I was like, "You know your math facts?" And she literally sings, she sang her sixes and sevens. 00:39:36.314 --> 00:39:41.924 'Cause I'm like, "Six times seven," and she's like, "7, 14, 21, 28, 35" Oh. 00:39:42.254 --> 00:39:52.764 I'm like, "Well, okay." But anyway but the problem is with that is even if you taught that that would give them access to respond to the stimulus, like six times seven. 00:39:53.024 --> 00:39:53.154 Gene Tavernetti: Yeah. 00:39:53.194 --> 00:39:53.594 Brian Poncy: Right? 00:39:53.594 --> 00:40:01.714 But if kids use that now, we're usurping all that working memory to focus on a counting procedure, which would be skip counting. 00:40:01.994 --> 00:40:08.384 And so it puts you in the same exact problem of, well, what do you do when it's 729 times 34? 00:40:08.444 --> 00:40:08.624 Oh. 00:40:09.014 --> 00:40:10.984 We want them see- things, you know. 00:40:11.074 --> 00:40:12.144 Now, I get it, it's a bridge. 00:40:12.144 --> 00:40:12.294 Okay. 00:40:12.294 --> 00:40:12.384 Right? 00:40:12.384 --> 00:40:12.644 It's a 00:40:13.034 --> 00:40:13.214 Gene Tavernetti: bridge. 00:40:13.214 --> 00:40:15.464 Tha- thanks for raining on my parade there, Brian. 00:40:15.464 --> 00:40:15.574 Okay? 00:40:15.894 --> 00:40:16.164 I tried to 00:40:16.164 --> 00:40:17.004 Brian Poncy: rain on your parade. 00:40:17.814 --> 00:40:18.134 Gene Tavernetti: I'm sorry. 00:40:18.134 --> 00:40:18.224 Okay. 00:40:18.434 --> 00:40:24.634 I'm, I wanna go way back to the beginning of this, because you alluded to something and I wanna be clear, okay? 00:40:24.974 --> 00:40:33.104 About what do we do with the kids that don't get to those levels that, that we want, that we're expecting. 00:40:33.364 --> 00:40:44.004 And you mentioned some some ways that the instruction might look different in, and I'm gonna call it tier two, but I'm gonna call it outside of the regular instruction. 00:40:44.004 --> 00:40:45.324 And you mentioned some things. 00:40:45.754 --> 00:40:48.044 You mentioned fewer problems in the set. 00:40:48.044 --> 00:40:48.074 Mm-hmm. 00:40:48.414 --> 00:40:50.074 What were s- what else were some of the things- Yeah 00:40:50.074 --> 00:40:50.984 that a teacher might do? 00:40:51.499 --> 00:40:53.479 Brian Poncy: Yeah, fi- there, there's five points. 00:40:53.479 --> 00:40:58.689 As a school psychologist, when I had a treatment non-responder, I always look at five things. 00:40:59.059 --> 00:41:01.429 The first one is are we on the right skill? 00:41:01.469 --> 00:41:04.579 And so that's where that scope and sequence is really important. 00:41:04.779 --> 00:41:12.829 And what I wanna do, and think about a child that you wanna, want them to you know, have high oral reading fluency scores, but they don't. 00:41:13.179 --> 00:41:18.839 Well, then I would go back to, you know, probably some y- you know, their nonsense word fluency. 00:41:19.089 --> 00:41:23.039 So kind of CVC letter sounds you know, that kinda thing. 00:41:23.039 --> 00:41:28.979 And I would just make sure that those sub-skills were known to kind of mastery levels, right? 00:41:29.069 --> 00:41:43.749 And so the first thing, so, so if, i- if your target is oral reading fluency, but the child's still at, like, 30 sounds per minute on their individual sounds, then the right intervention target isn't oral reading fluency, it's letter sound fluency. 00:41:44.129 --> 00:41:51.089 So the first thing you gotta make sure is don't expect the child to grow on a skill when they don't have the prerequisites, okay? 00:41:51.499 --> 00:41:52.489 And so that's the first thing. 00:41:52.489 --> 00:41:54.059 Are we targeting the right skill? 00:41:54.059 --> 00:41:55.069 So we do that. 00:41:55.409 --> 00:42:02.339 Now we're on the right skill, but now we need to know are we matching, doing the right skill by treatment interaction. 00:42:02.339 --> 00:42:19.509 So Matt Burns does research on this skill by treatment interactions, and it's I'm gonna assess them on those letter sounds or math facts, and if they're accurate, right, then I can just have them probably, you know, do explicit timing and just, you know, high rates of practice to get better. 00:42:19.699 --> 00:42:26.339 But if they're inaccurate, now if I do timed assessment, it's gonna be very detrimental to the child, right? 00:42:26.339 --> 00:42:32.669 And so in that case, I need to do things like flashcard drill, cover, copy, compare, maybe tape problems. 00:42:32.669 --> 00:42:39.429 But you're gonna have to have instructional components you know, that have antecedent and consequent procedures. 00:42:39.649 --> 00:42:41.189 So we're on the right skill. 00:42:41.349 --> 00:42:57.769 Now we need to see is the child accurate or inaccurate, and then you're gonna go ahead and choose interventions that incorporate those instructional components, because the instructional components need to build accuracy are different than what's gonna be needed to build fluency, okay? 00:42:57.769 --> 00:42:57.859 Yeah. 00:42:57.859 --> 00:42:59.844 So now- I'm sorry, go 00:42:59.844 --> 00:43:00.164 Gene Tavernetti: ahead. 00:43:00.244 --> 00:43:00.504 No 00:43:00.654 --> 00:43:02.214 Brian Poncy: Yeah, now let's say we have those. 00:43:02.524 --> 00:43:04.904 Now the third thing I'm gonna check is motivation. 00:43:05.104 --> 00:43:10.094 Sometimes it's the right skill, it's the right topography, and kids aren't growing. 00:43:10.094 --> 00:43:16.164 And so now I'll add reinforcement because some- And the reason why is 'cause it's easy for a teacher to check out. 00:43:16.394 --> 00:43:19.684 But sometimes kids actually respond, right? 00:43:19.684 --> 00:43:24.764 They do the practice, but they're just not really focused in on the practice at all, right? 00:43:24.764 --> 00:43:37.714 So they're, it's kinda like that kid you talked about, like, "I've done this forever. I don't like it." And so, like, if I go out and I'm practicing basketball, I can haphazardly throw up 100 shots, but it doesn't make me good. 00:43:37.744 --> 00:43:47.734 What would make me good, right, is if I'm focused on technique and where my elbow is and when I'm gonna release my shot, so I can be very mindful about the practice that I'm engaging in. 00:43:48.194 --> 00:44:02.304 And so by re- mo- motive- you know, providing a reward for a kid to beat their previous score, what you do is you check to make sure they're giving optimal attention and engagement you know, in, within those intervention sessions. 00:44:02.774 --> 00:44:10.944 Gene Tavernetti: So do your materials contain some sort of protocol or assessment for those ar- those sub areas that you just described? 00:44:11.274 --> 00:44:13.204 Or it'd be kinda hit-and-miss for the teacher? 00:44:13.254 --> 00:44:13.704 Brian Poncy: Not yet. 00:44:13.754 --> 00:44:16.174 I will be making a two things. 00:44:16.404 --> 00:44:25.594 I'm working on a book right now, a second edition with Robin Codding when, and Rob Volpe, and we're gonna, in the book we're gonna go through this intensively. 00:44:25.894 --> 00:44:42.004 And then also I'm going to, this summer, make an intervention manual for Mind 2.0, and within that I'm gonna subsume the other interventions so it'll all be a single intervention, and it will it will describe how to use this across tiers. 00:44:42.394 --> 00:44:54.794 Gene Tavernetti: But I think if a teacher, you know, is working with a student who for whatever reason is in that Tier 2 environment if they start with something and it's not, that's not it, they could move on to something else. 00:44:54.794 --> 00:44:58.574 It doesn't have to be this formal type of assessment to, to move them on. 00:44:59.489 --> 00:45:02.599 Brian Poncy: Well, it's it's just formal hypothesis testing. 00:45:02.989 --> 00:45:03.139 Okay. 00:45:03.139 --> 00:45:03.389 Right? 00:45:03.559 --> 00:45:03.799 Okay. 00:45:03.799 --> 00:45:03.899 Yeah. 00:45:03.929 --> 00:45:04.169 Yeah. 00:45:04.269 --> 00:45:12.029 The, so, so with the small sets, what's so cool about it is you don't have to wait a long time to know whether it's gonna work or not, right? 00:45:12.029 --> 00:45:14.329 So you can do a can't do, won't do assessment. 00:45:14.329 --> 00:45:37.809 If a child's not really growing and you could be like, "Well, I'll give you five minutes of tablet time if you can beat your score." And if the kid jumps, you know, like 50 to 100% on their score, so they go from like 7 to 12, then think about if every single time the child practiced their math facts, you know, they were more engaged and they nearly doubled their practice. 00:45:37.809 --> 00:45:40.449 You're gonna see better long-term gains, right? 00:45:40.479 --> 00:45:45.299 But let's say you assess the kid and they don't get any better, and we all know these kids. 00:45:45.299 --> 00:45:48.729 They're trying hard they're doing the work, but they're not responding. 00:45:48.729 --> 00:45:56.909 And so you're like, "Well, should I back up a skill?" You assess that and you're like, "No." And so then that's when you're like, "Now I'm gonna increase the dose." 00:45:56.909 --> 00:45:58.509 That's the fourth thing you can do. 00:45:58.839 --> 00:46:16.369 You can just say, "Instead of doing Facts on Fire for six minutes a day, now I'm gonna do it for 12 minutes a day, and we're gonna see if that works." And so there you know, there's research out there that shows kids are non-responders at one level, but then you increase that dose, and then they'll finally respond, right? 00:46:16.429 --> 00:46:30.729 And then the last and final one, and this is especially relevant for students with severe disabilities, is, you know, if I have a set of 12, they're, you know, it may just be too many items for them to focus on at once. 00:46:31.029 --> 00:46:36.579 You know, a- and so because the more items you have, the less repetitions per session you're gonna have. 00:46:36.829 --> 00:46:39.019 So then you shrink the set size. 00:46:39.019 --> 00:46:40.019 That's the fifth thing. 00:46:40.419 --> 00:46:44.669 And so then you might use the same intervention, but you shrink the set. 00:46:44.989 --> 00:46:54.159 And so again, instead of doing like eight items eight items with you know, 10 repetitions, you could do four items with 20 repetitions. 00:46:54.569 --> 00:46:55.539 Does that make sense to you? 00:46:55.789 --> 00:46:55.889 Gene Tavernetti: That 00:46:55.889 --> 00:46:56.449 Brian Poncy: makes sense. 00:46:56.449 --> 00:47:15.319 And so you basically would kind of... So, so, so the whole goal is regardless of the child's disability or processing speed or any of this stuff, you're "How can I systematically manipulate the instructional components that are alterable so I can find the conditions under which this child is successful," right? 00:47:15.319 --> 00:47:18.479 And again, alls you can do is what does the child know? 00:47:18.719 --> 00:47:20.799 What do you wanna learn, them to learn? 00:47:20.829 --> 00:47:32.699 You shrink it down into bite-sized pieces, and then you literally make sure they're engaged, they get ample opportunities to respond, and they get those repetitions to have within-session growth. 00:47:33.059 --> 00:47:40.109 And then after they have within-session growth, now the next day you're gonna check to see if they maintain that growth, right? 00:47:40.109 --> 00:47:43.999 Because again, k- all kids learn pretty much the same way. 00:47:44.219 --> 00:47:48.889 It's just they're different in the rate in which they learn and the rate in which they forget. 00:47:49.484 --> 00:47:54.824 And so again, in my view, learning is a very predictable exercise. 00:47:54.824 --> 00:48:00.124 It but the complexity isn't in the instruction, it's actually in the curriculum. 00:48:00.604 --> 00:48:17.424 And so it's really about how you you know, kind of distill and break up those component pieces and systematically put those together, and the degree of automaticity which you program those prerequisite skills so that, you know, they link to the new information. 00:48:18.654 --> 00:48:27.044 Gene Tavernetti: So if a, And you've done this several times today, you have also compared this to reading, and so this is... 00:48:27.044 --> 00:48:32.054 A- and now you've said learning, you know, learning is predictable, it's the curriculum. 00:48:32.054 --> 00:48:39.414 So having said that if the teacher gets better at doing these interventions, gosh, I hate to use those words. 00:48:39.544 --> 00:48:52.194 If the teacher c- you know, gets better at this instruction with these kids in math, it's gonna carry over into the instruction in language arts and reading and other things, because the learning is learning. 00:48:53.064 --> 00:48:53.514 And, 00:48:53.514 --> 00:48:54.504 Brian Poncy: S- and I... Yes. 00:48:54.504 --> 00:49:04.984 And the thing is, a- and this is I have a saying, I say this on podcasts, so I'm not trying to be redundant, but empirically validated interventions were really cool to me when I was young. 00:49:05.264 --> 00:49:19.274 But it didn't take me long to realize that it's really kind of- It's not all that helpful of a term because you can take an empirically validated intervention, and in one context it'll work great, in another context it won't work at all. 00:49:19.614 --> 00:49:35.554 And so, you know, to really be an expert, you know, with you know, a- as teachers are, you know, you really begin to figure out the context under which this intervention works and this one doesn't, and that's where that skill by treatment interaction stuff comes in. 00:49:35.894 --> 00:49:44.174 So, you know, there's very, it is act- A- and so again, w- like when we get into, well, should we do explicit instruction or inquiry-based instruction? 00:49:44.414 --> 00:49:49.254 There's times when inquiry-based instruction is the right thing to do, right? 00:49:49.344 --> 00:50:15.844 And, but that is in like if we talk about the instructional hierarchy or h- explicit instruction, it's at the end when we know kids have the prerequisite skills, and now we want those kids to kind of model, you know, whatever more kind of larger database problem-solving or critical thinking skill or whatever it is, which is basically a multi-step procedure where they're gonna put those things together. 00:50:16.174 --> 00:50:26.944 And you know, and again, I think that's what a lot of the, you know, kind of progressive folks, they really love that type of instruction and outcomes because that's what experts do. 00:50:27.264 --> 00:50:35.184 But I think the explicit people are like, "Well, we want that too, but we gotta start very controlled." And so it's not balanced by any means. 00:50:35.474 --> 00:50:44.924 It is literally about if you're building accuracy, you do this, when you're building fluency, you do this, and when you kind of program generalization is what we call it. 00:50:44.924 --> 00:50:52.974 But basically, when you're applying skills to controlled you know, kind of settings you know, that would be pretty explicit. 00:50:52.974 --> 00:51:06.774 But then when we get ki- people into novel problem-solving, then that's highly independent, and that's when inquiry-based, problem-based approaches when you have assessed and know kids have the prerequisite skills, when those are highly useful. 00:51:08.204 --> 00:51:08.634 Gene Tavernetti: All right. 00:51:08.634 --> 00:51:11.554 Well, Brian I think that's a good place to leave it. 00:51:11.664 --> 00:51:25.239 I think the, for me, the most important thing that I got out of this conversation is that the Like all programs it's going to take teacher the expertise of the teacher to manage it. 00:51:25.649 --> 00:51:27.239 The program isn't magic. 00:51:27.519 --> 00:51:28.969 The program isn't magic. 00:51:29.269 --> 00:51:36.059 You know, you have to, you know, as they say, you gotta work the program and then take that data and what did you call it? 00:51:36.059 --> 00:51:37.989 Hypothesis- Yeah 00:51:38.159 --> 00:51:38.319 ... Brian Poncy: yeah. 00:51:38.319 --> 00:51:40.579 It's called inductive hypothesis testing. 00:51:40.809 --> 00:51:40.869 Yeah. 00:51:40.869 --> 00:51:49.869 Which is it, which is another just way of saying kids are really complicated and but we wanna use if/then statements, so we make a hypothesis. 00:51:49.869 --> 00:51:54.819 I think a kid is struggling because of because they can't accurately respond. 00:51:54.819 --> 00:51:58.909 So if I do this instruction, they'll learn how to accurately respond. 00:51:59.499 --> 00:52:02.929 Gene Tavernetti: Well, I think your place is a, you know, your stuff is a good place to start. 00:52:03.019 --> 00:52:05.539 And and I think that's how we become expert. 00:52:05.539 --> 00:52:15.859 We use somebody else's stuff, and then we take care of the nuances after we are- Yeah, that's right ... after we have some fl- some fluency with that and some generalization. 00:52:16.129 --> 00:52:18.219 Well, Brian, do you have any questions for me? 00:52:19.261 --> 00:52:20.501 Brian Poncy: Oh, man I do. 00:52:20.501 --> 00:52:36.591 I, so, you know, listening to your podcast, I know as an instructional coach you know, in, in your notes you talked to me about working a- and getting, In special education, a lot of kids are reported to have processing difficulties. 00:52:37.191 --> 00:52:37.631 Gene Tavernetti: Yes. 00:52:37.851 --> 00:52:38.381 Brian Poncy: Okay? 00:52:38.381 --> 00:53:01.991 And so my question to you as an instructional coach is do you feel that you know, kind of fixating on within child hypotho- hypothetical constructs like processing speed do you s- did you see teachers using that as an off-ramp to justify why students can't learn things that typical students learn? 00:53:03.081 --> 00:53:13.411 Gene Tavernetti: Well, , first of all I'm kinda laughing because whenever I work with a teacher and you know, we do we do lesson design for, you know, we'll meet for a coaching cycle. 00:53:13.411 --> 00:53:18.251 We'll meet to talk about a lesson and then observe the lesson and then debrief it. 00:53:18.941 --> 00:53:24.521 Usually the first meeting to talk about lesson design, that's when I find out, "Well, I have this many English learners. 00:53:24.521 --> 00:53:27.141 I have this many kids on RSP, this..." You know what? 00:53:27.401 --> 00:53:31.861 And I don't care you know, because we're gonna do the, we're gonna do the instruction. 00:53:32.261 --> 00:53:41.521 Because what I have found is that there is, the more effective the instruction, you're just eliminating that variable. 00:53:41.936 --> 00:53:42.846 From what's happening. 00:53:43.106 --> 00:53:50.386 There was, there's enough confounding issues going on in the classroom, let's not instruction be one of them. 00:53:50.676 --> 00:53:53.086 Let's be sure we're giving opportunities to respond. 00:53:53.086 --> 00:53:56.906 Let's be sure we've had clear explanations, you know, e- et cetera, et cetera. 00:53:57.336 --> 00:53:58.936 And yeah, I don't even listen. 00:53:59.036 --> 00:54:01.226 I don't even, I don't even wanna hear it. 00:54:01.366 --> 00:54:01.456 Yeah. 00:54:01.506 --> 00:54:03.696 In fact you know, I've said this over and over again. 00:54:03.696 --> 00:54:06.496 I was a principal and I was not a good principal. 00:54:06.496 --> 00:54:09.436 I didn't know what I know now when I was a principal. 00:54:10.066 --> 00:54:29.376 And if today I were to go back and I would get some sort of referral for a student study team or, you know, I don't know what they call them in different places, but just, you know, it's kind of like one of the steps to get to a special ed referral, things that you need to do. 00:54:29.786 --> 00:54:34.966 I wouldn't even accept it until I was clear that instruction was going well. 00:54:36.016 --> 00:54:39.386 There, there was a ... Oh, gosh, how long ago was this? 00:54:39.386 --> 00:54:40.666 This was in the '90s. 00:54:40.946 --> 00:54:46.136 California, which is where I am they decided they were gonna do class size reduction. 00:54:47.206 --> 00:54:55.925 And they were using data and studies done in Tennessee, that they reduced class sizes everything you know, just a lot of good things happened. 00:54:56.535 --> 00:55:00.321 California did it, and they went down to 20 to one. 00:55:00.661 --> 00:55:03.511 Tennessee was, like, about 13 to one , you know? 00:55:03.551 --> 00:55:03.701 Wow. 00:55:03.931 --> 00:55:06.241 So we go- we're not, we're still not even close. 00:55:06.581 --> 00:55:08.431 But so 20 to one, it was better. 00:55:08.431 --> 00:55:20.531 And one of the, one of the one of the rationales for doing that is because with a smaller class size, we would have fewer special ed referrals, the teacher would be able to pr- and it didn't happen. 00:55:21.231 --> 00:55:29.171 The teachers that had the most special ed referrals with 28 kids had the same percentage at 20 kids. 00:55:30.311 --> 00:55:36.881 And so, so if a teacher's telling me, you know, a- all about their kids, I don't wanna hear it . You know? 00:55:37.171 --> 00:55:44.661 Let's d- let's take care of the variable of the best instruction that we can give with appropriate materials, and then we'll take a look. 00:55:45.001 --> 00:55:52.361 And the other thing that, that we say is that, you know, you're always gonna have some kids that are not gonna be successful in a particular lesson. 00:55:53.311 --> 00:55:54.181 And guess what? 00:55:55.101 --> 00:56:01.191 You're gonna have a much smaller subset of your class if the instruction was done well, as effective. 00:56:01.561 --> 00:56:02.841 And then guess what you're gonna do? 00:56:02.841 --> 00:56:08.151 You're gonna pull that small group of kids and do the types of things that, that you're talking about. 00:56:08.151 --> 00:56:13.231 Maybe fewer repetitions, maybe, you know, what, all those things that, that we can do to provide support. 00:56:13.691 --> 00:56:17.551 But, That group that you're gonna pull at the end is gonna be fluid. 00:56:18.601 --> 00:56:23.291 Instead of just saying, "These kids aren't gonna get it," we're gonna give them a shot to get it. 00:56:23.671 --> 00:56:23.741 Yeah. 00:56:23.741 --> 00:56:25.281 And then, okay now let's do it. 00:56:25.281 --> 00:56:29.821 And I think the teachers found that, And I th- and I think it gets back to some motivation too. 00:56:29.851 --> 00:56:41.761 When the kids that never were able to do things started being able to do things, not only their motivation increased, but the teachers' sense of efficacy in- increased. 00:56:41.761 --> 00:56:45.391 So yeah I didn't even wanna hear that, Brian, but I'm working with- 00:56:45.991 --> 00:56:48.471 Brian Poncy: Well, here's an e- here's an easy question for you. 00:56:49.621 --> 00:56:50.851 Where did you play football? 00:56:51.771 --> 00:56:52.651 Gene Tavernetti: Northern Arizona. 00:56:53.381 --> 00:56:54.561 Brian Poncy: Northern Arizona. 00:56:54.851 --> 00:56:55.151 Gene Tavernetti: Yeah. 00:56:55.741 --> 00:56:56.141 Brian Poncy: All right. 00:56:56.141 --> 00:56:59.591 Well, I heard that you were a football star in back in your younger days. 00:56:59.811 --> 00:57:04.151 Gene Tavernetti: Well, you know, back in my younger days was a long time ago, Brian. 00:57:04.761 --> 00:57:06.831 So, so anyway, yeah. 00:57:06.861 --> 00:57:07.851 That was an easy one. 00:57:08.261 --> 00:57:19.351 But anyway, Brian, it has been a pleasure chatting with you, and glad we got to see whatever... I never... I know it's not in person, but as close as we're gonna get. 00:57:19.351 --> 00:57:21.591 Brian Poncy: Well, well, I appreciate you having me on. 00:57:21.631 --> 00:57:27.401 You know, doing podcasts with me is kinda like herding cats, and so, I feel for you. 00:57:27.401 --> 00:57:37.421 But hopefully we got some good nuggets of info out and so yeah, just for you know, teachers you know, look at the website, try the stuff out. 00:57:37.501 --> 00:57:38.681 It's www.factsonfire.com. 00:57:39.181 --> 00:57:45.071 People are finding really good success with it, and the kids like it. 00:57:45.531 --> 00:57:53.151 And you know, I've really tried to make it easy for teachers and effective for students, and that, that's a good combination to have. 00:57:53.831 --> 00:58:00.071 Gene Tavernetti: Now, if that daughter of your friend ever comes into your office again, h- do a recording of her six, sevens, and eights for me, would you? 00:58:00.561 --> 00:58:02.601 Brian Poncy: I will do that. 00:58:03.011 --> 00:58:03.771 Gene Tavernetti: All right, Brian. 00:58:03.801 --> 00:58:04.471 Thanks a lot. 00:58:04.831 --> 00:58:05.531 Brian Poncy: All right, take care. 00:58:07.589 --> 00:58:10.229 Gene Tavernetti: If you're enjoying these podcasts, tell a friend. 00:58:10.529 --> 00:58:16.099 Also, please leave a 5 star rating on Apple Podcasts, Spotify, or wherever you listen. 00:58:16.789 --> 00:58:26.869 You can follow me on BlueSky at gTabernetti, on Twitter, x at gTabernetti, and you can learn more about me and the work I do at my website, BlueSky. 00:58:27.279 --> 00:58:27.709 Tesscg. 00:58:28.699 --> 00:58:44.069 com, that's T E S S C G dot com, where you will also find information about ordering my books, Teach Fast, Focus Adaptable Structure Teaching, and Maximizing the Impact of Coaching Cycles.