Thursday, August 5, 2010

Dunning-Kruger: Teachers of Pre-Med Students

Continuation of this discussion on teaching pre-med students.

So I find myself in something of a conundrum. I recognize the reasons that my students are unable to obtain the scores they want on the MCAT. Broadly, they either have poor study skills or they have poor problem solving skills. But I'm left banging my head against the Dunning-Kruger effect:


"When people are incompetent in the strategies they adopt to achieve success and satisfaction, they suffer a dual burden: Not only do they reach erroneous conclusions and make unfortunate choices, but their incompetence robs them of the ability to realize it."

Basically, in this situation what it means is that those students who are capable of realizing they are doing things poorly and improving have already realized their flaws and tried to fix them. That is the difference between the 30-to-36 student and the 24-to-28 student.

As I've come to understand these things, I've come to understand that I too am flawed. I stand at the front of the classroom and lecture on things (the facts of chemistry and biology important to know for the MCAT) that ultimately don't address the fundamental needs of these students. While it might be flattering to think that because I understand what the true needs of my students are, I'm better than the other teachers, despite my understanding I'm not really sure how to help them. I, too, am a victim of Dunning-Kruger. As a teacher, I have an obligation to help these students learn, but I am unable to figure out what to do. There are teaching techniques, ways of reaching and influencing students that I should know but which I don't know.

So I come back to these different types of questions Morris proposes in his article on anosognosia. I've asked a question that I don't know how to answer, a question I believe no one actually knows how to answer: How do you help students become better test-takers? Take problem solving skills as an example, I've done some research on the issue. It turns out that problems are solved in two steps. Before a test, one must internalize the steps necessary to solve a large number of types of problems. Then, when taking a test, one must properly categorize each particular problem as one of those types and then execute the steps we carry in our minds. But knowing that this is how we solve problems only raises other issues. Without accounting for time constraints and class sizes, how does one teach an abstract skill such as categorizing a problem as one of the hundreds of types a student ought to know, and then successfully following through on each of the steps? How, for that matter, do I teach students whose problem might be poor reading comprehension how to read better?

I'm not going to pretend I have the answers to these questions. This is kind of where I am right now, trying to figure out if anyone else has the answers or if there even are answers. I'm trying a few techniques out to see how they work. For a while I have been telling students that when they get a problem wrong, they need to understand why they got it wrong. That, in other words, practice without improvement is useless, that it doesn't matter how many questions you do if you don't learn to do any of them better. But as Dunning has suggested, I'm always frightened to find out, in one-on-one discussions, that students haven't listened to my advice and continue to plow through practice problems unreflectively, valuing quantity over quality. Of the students who do listen, many don't really understand the advice. They look for the reason they got the problem wrong, but they don't actually try to go through the right method to solve the problem step by step to get that routine in their mind. It's a subtle, but extremely important difference, knowing what you did wrong versus knowing how to do it right the next time.

I've also taken to more explicitly telling students the steps I'm taking as I solve a problem. For all MCAT questions the first step is determining if the answer was in the test passage, if it draws on things the student is expected to know, or if it is a fusion of the two. But there are more steps past that. What concept is being tested? What are the relevant equations, facts and rationalizations surrounding that concept? This technique has helped a little in that while most often a student who can't get started just can't figure out what the question is asking (a reading comprehension issue), a significant  portion of the time I'll uncover that the student simply doesn't know something he ought to know. But this leads back to another thing I've had difficulty understanding. If I tell students that they ought to memorize things, why do they not memorize them? When I took a science test, I always made a list of things I ought to know (and memorized them) and things I ought to understand (and made sure I could explain them). Many students seem to lack this skill. More, as Dunning-Kruger teaches, they seem to be unaware that they ought to know this skill. Basically, every time I find a trick that seems to help, I'm brought back to the fact that these students need to learn to help themselves, my ability to help them is limited.

This need to learn to help themselves, and the centrality of reading comprehension issues in the difficulties these students face, brings me to the post I made a few days ago. Good teachers, especially early in education, are immeasurably important. While I would love to be able to address these issues, I simply can't given the format of my interaction with these students and the amount of time we have together. Typically I have students either in a one-on-one setting for eight hours or in groups of ten for twenty hours. In that time, I have to teach them material which it takes college professors 45 hours to cover, while also doing a fair number of sample problems together, discussing time management and other test strategies, and covering other logistical issues of the class and of the MCAT. Given these restrictions, how much can I really expect to do in terms of re-teaching these students how to approach a test? More broadly, if we have no restrictions, how do we teach young students or re-teach older students how to solve problems and how to read effectively?

I think the answer is we simply don't know. Good elementary school teachers and good parents teach these things, but we don't know how they do it. More, I've over-generalized in my description of students. I've seen students who come in with an initial 24 and leave scoring in the mid 30's by, among other things, re-teaching themselves how to pay more attention to the wording of questions and re-teaching themselves using the problem-solving techniques I preach that don't reach the other students. I've seen students who come in scoring a 24 and don't improve through the length of the course. I refuse to believe that the 24-to-28 students, who are literally as close as they can be to going to a quality medical school, are beyond hope. If we want to do something that will improve our society more than any scientific advance in the history of the world, all we have to do is answer one simple question: How do we raise children, how do we re-teach older students, so that they are not subject to the Dunning-Kruger effect?

No comments:

Post a Comment