IDC04 - Project-based Assessment: Interview with Dr. Kristin Shingler

Show Notes

Episode 4 of the ID Corner podcast. Interview with Dr. Kristin Shingler about her project-based approach to assessment.

What is ID Corner Podcast?

A podcast where we talk about all things teaching and learning.

Welcome to Episode four of the ID Corner podcast,

where we talk about everything teaching and

learning. Over the summer, I had the opportunity

to attend the International Forum on Active

Learning Classrooms held at the University of

Minnesota as a first time attender. It was an

enriching time, learning about current practice

and an opportunity to meet others passionate about

active learning. One of the contacts I made put me

in contact with my guest for today. Dr. Christian

Schindler was a teaching specialist at the

University of Minnesota School of Dentistry. So,

Kristen, can you please share for our listeners a

little bit about your role in the School of

Dentistry? Sure. So I started in the School of

Dentistry about three and a half years ago as a

postdoc at first, and I was researching

bacteriophage. And through that, I had the

opportunity to start teaching in the microbiology

and immunology courses, specifically doing the

component of the immunology then and from there,

it just sort of grew. And I'm at the point where

I'm directing the microbiology and immunology

course for the dental students, a similar course

for the dental hygiene students. And I also

directed biochemistry course for the dental

students. So I teach quite a bit. Awesome. Thank

you. Can you specifically describe the the course

for which the this activity that we're going to

talk about is for? Yeah. So this this activity is

a final project for the microbiology and

immunology course for the dental students. And so

the way I inherited the course was that it had

four fifty point multiple choice exams and that

was the grading system for it. So there's about

one in and students in the class. It's a really

big class for what I'm used to. And so getting

those assessments graded quickly with feedback was

a concern. I'm not the biggest fan of multiple

choice exams, particularly basing an entire score

off of that. So the first thing I did was to

integrate some podcast assignments into it for a

couple of years, where students listen to some

Radiolab podcasts and talked about how scientific

communication happened relating to topics. And

from there I decided that projects and different

assignments like that, where students could really

think about the content and apply it to different

situations that could be relevant to their

profession gave me the biggest understanding of

their understanding of the material is presenting.

So I moved the assessments for the course to one

fifty point exam and everything else is project

based assessment. Wow. Wow, that's awesome. So

you've mentioned the assignment a little bit. Can

you can you give us some detail about it? Yeah. So

I found this paper several years ago in the

Journal of Microbiology and Bilel Biology

Education and A.M. publication where a professor

had started having his students create murder

scenes from an infection with a microorganism. And

so students worked in groups to create these these

murder scenes, essentially these homicide scenes,

and design different clues to point to the

identity of the microorganism responsible. And

then they went through and sort of solved all of

these crime scenes. And I thought, wow, what a

great way for students to be exposed to a wider

variety of microorganisms. Get some practice

comparing and contrasting features of bacteria and

viruses and fungal pathogens as well as parasites,

and to really hone in on some differential

diagnosis skills that they need as practicing

clinicians, since my students are dentists. So I

took that paper and used it as sort of a

foundation to to design the final project or my

course. OK, so so this assignment, as you've

described it, really meets some of the the

important course objectives that you've got for

for your students. Yeah. And I think it's a useful

and sort of fun, low stress way to really get to

those higher levels of doing taxonomy during

assessment without. Creating some really intricate

problem for students to solve or some long essay

to write or something like that, and there can be

a group component and an individual component as

well. Awesome. Yeah. So I have kind of the next

question I had was why this type of assignment,

which I think you've kind of been answering. I

mean, any time, any time you can bring fun into it.

I think it's a it's a great thing. How how have

students received this assignment? Does the group

project and I know from my experience, group

projects are kind of like, I don't want to do a

group project. So. So what's been your experience?

Yeah. So I've only done it one year so far. Full

disclosure, but it was much more successful than I

anticipated, so that was really, really great. I

actually only had one student comment negatively

on the group aspect. So one person said group

projects are never a good idea. But that was the

only negative feedback I got, which I was shocked.

I expected a lot more pushback. One thing I did, I

let the students choose their own groups. So I

presented 11 different microorganisms that they

could choose from. And the class was divided into

two groups, worked on the same micro-organism and

they could sign up then based on the five of us

want to work together or hey, I'm really

interested in this microorganism, who else is

interested in it? So the groups formed in both of

those ways, sort of organically. We just used a

live Google doc to do that. That was kind of fun

watching students edit. Sure, sure. There are

groups and things in real time. Would you do it

the same way again? Just kind of let it happen

organically? You know, I think I would because it

seemed to work. I haven't asked students if they

preferred forming their group first and then

picking a microbe or just sort of signing up for a

microbe and seeing who else was interested in that.

But that would be some interesting sort of

feedback to get. And then another thing I did to

to really make sure that the groups were

functioning well together for the group portion

because the group grade was worth about half of

the project, was I incorporated self-evaluation

and peer evaluation into it. And I was really

careful with the peer evaluation chunk. And I said,

you know, you can earn up to five points and it's

going to be an average of the scores you get from

your other group members. And if your average

score from the peer evaluations is under two point

five, so essentially 50 percent, you don't get

peer evaluation points. So I made it sort of your

group members have to be satisfied, reasonably

satisfied with your contributions to earn those

points. And everyone did earn them. But there was

that range of evaluation points. So it just sort

of up the stakes on you need to be involved in

this component. Sure. And so that was five points

out of their total score. Yeah. And I think. I

can't actually remember off the top of my head, I

believe the group component was worth 50. Yes,

five points and then I think, yes, a total of 50

for the group. Yep. And then the the individual

component where they actually went through and

solved crime scenes was also worth fifty points.

So you could earn half of the points for the

entire project on your own, which is another way

to sort of alleviate those groupware concerns. Yes.

Yes. So this is in the context of the course. This

is a final project. What kinds of support or

scaffolding did you provide the students before

they get here, both in terms of the the activity,

the content itself, but then also the peer to peer

and group kind of dynamics, things like was it

just here you go? Or so I made a document that

sort of broke down. Here's a group component of

this, and you earn your points in these ways. So

the main component of earning points in the group

project or the clues that you provided in your

crime scene. So sort of building out the crime

scene for your classmates to solve the self and

peer evaluation. And then you also had to provide

the rest of the class with the information to

solve the crime scene. Right. So you made the

groups made a little ID card that had things like

symptomology of the organism, whether it's a

bacteria or virus, it's gram positive, gram

negative. Those types of informations,

epidemiology, any vector associated with it, the

sort of critical pieces of knowledge and then a

sort of a fun, creative bit, I had them create a

mug shot for their their perpetrator, if you will,

as well. So there was very clear point values

associated with all of those. And I tried to

provide a clear description about what you needed

to do to get to those point values and have an

independent part was a little easier because it's

it's solving the crime scene. Right. You identify

what the microorganism is that caused that crime

scene and then give me a treatment option that's

available in one way that that could have been

prevented. So to bring in the treatment and

prevention and I also showed them an example. So

when we talked about it in class, I went, for an

example, crime scene with them so they could have

a general idea of what other people had done.

Awesome. Awesome. What have you learned about

student learning through this activity? So in

general, I'm still working on that, I guess is the

best answer. I've actually started to do some

research on this. I just got the IRB approval for

an exemption for education related material. And

I'm looking at the way this can these sorts of

projects can impact student retention of the

general principles of microbiology. So because

I've taught this course before without the project,

I have control groups sort of one year post class,

two years post class, and I just give them a short

term question, multiple choice quiz about what I

think our main concepts that I would like them to

know long term. And then I'll do that with the

groups that have done the crime scene project as a

final project as well to see if it is enhancing

their retention of the material. That sounds

really exciting. Yeah, on a lesser scale, just

sort of the comments from the course were pretty

positive. A lot of students said that it was a fun

way to learn. They said that they liked seeing how

creative their classmates were, particularly when

they're in other rigorous, structured science

courses. That doesn't that maybe don't give the

outlet for creativity as much. So it gives them

more of a glimpse into their classmates,

personalities and interests. And I had a few

comments that said you should keep this around

this group. So that was nice. Very cool. And I

guess the last question that I've got for you

related to this is, is there anything that you

would change? So you've done this once. Yeah. Is

there anything that you would change about the

assignment and why? Yeah, so I think I would

shrink the group size No. One, so I had groups of

four or five this time. And one comment that I got

from a student would kind of stuck with me. They

said, you know, with a group of five, we each sort

of picked a certain aspect of this microorganism

to research and tackle. And I didn't really feel

like I learned much about the microbe as a whole.

And so I think that limiting the group size, you

would get more of an overview because you'd be

more in tune with different components of it. And

it would also give me the opportunity to increase

the number of microorganisms in the project itself.

So we had 11 last year, which was a decent number,

but I'd like to get in more that have more closely

related symptomology so it can be a little bit

more difficult to discern them. You have to pay

attention to a little bit more. And I also wish

that students incorporated more sort of diagnostic

tests into their clues. So I was hoping for here's

a picture of a gel from a PCR reaction or

something along those lines. So I was thinking

about scaffolding. I want this many clues about

symptoms, a maximum of this, many clues about

epidemiology to really make it have more aspects

of the disease represented in the crime scenes. So

those are the sort of two things that I am working

on refining a little bit. That sounds very cool.

And I think as you're describing it, the the

changes one will make the the exercise more. I

mean, you mentioned more difficult, but at the

same time hopefully provide a greater opportunity

for the students to learn more detailed

information. So thank you for sharing that. One

thing that you mentioned earlier that kind of

piqued my interest also is that you said you

mentioned that you've done podcasting and I don't

have any scripted questions about that. But I

would be interested to hear how when I think about

biology, immunology and podcasts, that they're not

two things that I would immediately put together.

And so that that sounds very interesting to me.

Can you share a little bit about that? Sure. So I

have always been a fan of the Radiolab podcast. I

think that they're very interesting and they're

presented really well in an engaging way. And a

lot of the topics of their podcasts have to do

with microorganisms. I talk about in microbiology

concepts. I talk about in microbiology and

immunology. So the way that those assignments work

is I pick five different Radiolab podcasts that

relate to content we're talking about in class,

and students have to pick two out of the five to

listen to throughout the semester. And so they

have a little bit of control to pick information

that's most interesting to them. Or I think a lot

of times it might boil down to I don't have a lot

else going on this week because they can get sort

of swamped with exams. But that's that's fine, too.

And what they do is they listen to it. And then I

ask them to write just a short one to two page

response to me about how did this podcast relate

to content we covered in class? What did you like

about how these scientific concepts were presented?

Did you think that the podcast did a good job

talking to a broad audience about these concepts?

So so people who might not have a strong biology

background or other type of scientific background,

and how do you envision using these sorts of

communication methods with your patients in the

future? So how can you use this as a springboard

for talking about scientific concepts with your

patient? Was maybe an accountant or an electrician?

OK, very cool. Have you ever so you're having the

students evaluate the podcasts? Yeah. OK, have you

considered having them create podcasts? I have. Um,

and so right now I don't have an assignment where

students specifically have to create a podcast in

the biochemistry course I direct their final

project is to choose a disease that affects the

sort of craniofacial region and explain the

biological basis of that disease and its diagnosis

and treatment to. A patient in a way that most

patients can understand, and I let the medium of

that wide open, so I have had students submit

podcasts to me through that assignment and they're

just always really fantastic. They made them

really quirky or sort of funny things. Some of

them even pick their own introduction music. I had

one student who interviewed his brother as a guest

on the podcast for his final assignment. So those

are those go well, I just haven't dreamed up a

project yet where the only podcast should be

submitted. Sure, sure. How have you thought about

and how do you go about assessing? So if there's

if there's an option for a podcast or whatever,

how does how does the assessment of that differ

from an exam or a paper or how have you have you

worked that into into that. Right. So for that

particular project, everyone is submitting some

sort of information piece. So I have had

everything from the podcast to children's books to

pamphlets you would pick up at a doctor's office

to a recorded PowerPoint presentation. Someone did

a YouTube video. And so I try and take the

creativity out of it as much as possible because

those sorts of projects always intimidated me when

I was in school. I don't think of myself as a

particularly creative person. I have like zero

drawing abilities. So what I do is I make really

detailed rubrics about this is what I want you to

tell me about the biological basis of the disease.

This is what I want you to tell me about the

treatment of the disease. This is what I want you

to tell me about the diagnosis. And so the point

values are for the science itself, for people that

like sound information and then appoint value for.

Did you communicate this to a broad audience?

Right. So if you're trying to talk to a kid about

cavities, is this accessible for someone who's 10

years old or if you're trying to talk about

oropharyngeal cancer or are you talking to someone

who's an electrician in a way that they understand

and don't feel overwhelmed about it? So the medium

is is left to the students to show their

creativity and they're not judged or graded on

that component. Awesome. Thank you. You really

highlighted how the objectives, the the things

that you want the students to demonstrate really

are key and that the the medium isn't as important

in that in the or. Exactly. And that can, I think,

increase the fun of the project and decrease the

stress as well. And that's a big thing that I want

to do, is allow students to communicate to me how

they've learned and progressed throughout the

semester in a way that they're comfortable with

because most people just aren't comfortable with

exams. Right. They're high stress environments. So

if you can do it in a fun way, why not? And

there's one agreed. It is not a catalogue or a

stack of. Yeah, just scantron sheets or whatever.

Right. It's really get a sense of the personality

of each student. And I feel more connected to my

classes after these projects. I think that would

resonate with a lot of a lot of people. You know,

we're we're always talking about sense of

belonging and student engagement and retention and

all of those things. But I think what it comes

down to is that that connection between the

instructor and the student, you hit the nail on

the head. So thank you. Of course. Well, I really

want to thank you for your time and your

willingness to be interviewed. And it was awesome

to be able to talk with you today. So we're going

to take a quick break and then I'll be right back

to share some closing thoughts about the interview.

Welcome back. I think that there are three key

ideas that we can take away from Kristen's example.

First, learning objectives are key. All of the

work that students did was informed by the

learning goals that Christine set for her class.

Christine had a clear idea about the skills she

wanted the students to develop and then identified

an activity to meet those goals. Second, the

medium doesn't matter. The creative media forms

that students use to complete projects were

secondary to the objectives and skills that the

students were working toward. Not requiring a

specific format or medium provides choice for the

students in representing what they know. Lastly,

the option for creativity benefited both student

and teacher. The students were able to participate

in a fun activity. They were able to bring more of

their authentic selves into the project. The

creativity also benefited the teacher in not

having to grade lengthy papers or exams. I hope

that this interview has inspired you to consider a

project based approach in your teaching. I hope to

have Christian back in the future to discuss the

results of her research on the effects of her

project based approach. My guess is that her

students will retain the information better

through the project versus exams. Thank you for

listening. If you do not already, please subscribe

to the podcast. The Corner podcast is available on

Apple podcast, Google Play podcast and Spotify

notes. Resources and episode transcripts are also

available on my blog at staff Lawrence Dunedoo.

Rex Jay, have a great day.