Thursday, January 8, 2015

Salvaging Problems When Students Google the Answers

Questions and problems published in textbooks are often excellent ways for students to learn, provided the student actually carries out the mental process of answering the question or solving the problem. A teacher can cover more and deeper content by using published sources rather than creating all new questions and problems from scratch.

When students have technology, however, they can, and will, google the textbook answer to textbook problems. They will copy down the search result and turn it in without going through the mental processing that causes learning. Worse, many of them will believe they now understand the concept because they have read the answer their own mind had nothing to do with creating—they don't even realize they haven't grasped the essentials.

Here is a way I came up with, out of my own frustration, to salvage problems when students google the answers, so that I can still use them to stimulate real learning...

An example question I used this week from a popular physics textbook says,
A clothesline is under tension when you hang from it. Why is the tension greater when the clothesline is strung horizontally than when it hangs vertically?
This question is ideal for stimulating the thinking a student needs to go through to understand the generation of large, potentially hazardous, tensions when a load is hung from a horizontal rope.

A student promptly presented me with a googled answer, which was word for word the same as the textbook answer given by the publisher. When I questioned the student, it was eminently clear that she had no idea what she was talking about even though she had given me the perfect answer. I went home troubled that day, but I came back the next day with a solution.

I wrote the textbook answer on the board, and I underlined key terms or phrases that are essential to a good answer:
The vertical components of the tension vector must add up to the weight, so the vectors along the rope will be very large.
Along with this, I wrote the following directions:
Directions: For the six terms or phrases underlined in the textbook answer, write a sentence or two explaining why each is essential for a good answer, and why the answer would be incomplete or wrong without it.
The learning that happened was probably better than if they had answered the question on their own in the first place. Explaining the six underlined terms and phrases created six new mental engagements with the concepts at a deeper level of thinking than the original question itself. It was actually fun to walk around the room from team to team and engage in authentic discussions of the concepts. This exercise stimulated very focused questions from my students. I found myself being called over by one student after another truly seeking to comprehend the concepts they had so easily glossed over the day before.

If you are a teacher who wants to try this, be aware of a few things that will help. The students most likely have never done anything like it before. More than a few thought I was asking them to write down definitions of the terms. Several began searching in the glossary of the textbook for the terms. I had to explain to them that they would not find these terms in the glossary, and that I was not looking for definitions. I explained that what I am looking for is an explanation of how the terms are important for the role they play in the answer in relation to the other terms, not definitions of the terms in isolation.

When they understand what the assignment actually is, they will realize how difficult it is. Be up front with them that, yes, this is a difficult assignment. In my case, I explained to them that I know it is difficult, that the value of it is for them to puzzle over the answer—I would help them get started and I would help them get unstuck and direct their thinking toward the right answer, but for me to tell them the answers outright would deprive them of the learning.

Because of the difficulty and unfamiliarity, students will be anxious about producing acceptable explanations of the terms. I reminded them that I know the assignment is difficult, and that I would not be looking for perfect explanations. I told them that when I look at their answers I will be reading what they wrote and making a judgment, "Oh yes! This student does understand the issues even though he is not able at this time to give a refined explanation of it." This put them at ease and enabled them to focus on and engage with the assignment. For my part, I am looking for evidence of genuine engagement with the material, not necessarily correct answers—if they engage with the material I can correct and direct their thinking to arrive at the right answers.

The in-class discussions with students, and the written answers I received, were mixed insofar as student comprehension of the material was concerned. What was true across the board was that students were engaged and learning at their own level of ability—differentiation (if you are a teacher you know what I'm talking about) is built right into the assignment.

I would love to see comments from other teachers about ways you have handled the problem of googling answers to problems.

Wednesday, February 6, 2013

The Scientific Method, De-Jargonized

JargonizedDe-Jargonized
  1. Identify a problem to solve or a question to answer.
  2. State a hypothesis about the problem.
  3. From the hypothesis, develop a prediction or a set of predictions.
  4. Set up and perform an experiment or make systematic observations to establish or refute the predictions.
  5. Duplicate the results in a variety of different contexts to establish the hypothesis as a law of nature.
  6. Likewise, state related hypotheses about other aspects of the problem and test their predictions.
  7. Rigorously verify the predictions under a wide variety of contexts and conditions to firmly establish the set of hypotheses collectively as a theory.
  1. Do you wonder about something?
  2. Think of an idea about how it might work – be creative!
  3. If your idea is right, what things would happen?
  4. Check to see if they really happen.
  5. Check to see if they happen all the time in different situations – then you know you can rely on your idea.
  6. What other ideas do you have about how the thing might work? Check them out, just like before.
  7. Check to see if these things also happen in other situations your ideas apply to, that are kind of different from the thing you wondered about at first. If they do, then you can be sure that your ideas make a good explanation of the thing you wondered about.

Friday, September 14, 2012

Problem-Solving Sessions with my Physics Classes

Here is a mash-up of the problem-solving sessions I had with my physics classes yesterday and today. The conversation was remarkably similar with each class, so there really isn't much mash-up here — actually, the conversation that follows is more like a generic version of the individual conversations that took place.

Enjoy...


In my physics classroom...

TEACHER: Do you know where the elevator is?

CLASS: Yes.

TEACHER: Do you know where the science department's glass display window is near the elevator?

CLASS: Yes.

TEACHER: Go sit in a circle on the floor in the hallway in front of that display window. I'll meet you there.


Sitting in a circle on the floor in the hallway with my students...

TEACHER: Physics is about problem-solving. We – have – a – problem. Let's solve it. You already know what the problem is. Can you tell me what it is I have in mind?

CLASS: (Blank looks...) Uh, we talk too much?

TEACHER: I want you to talk! Talking is part of the curriculum!

CLASS: Uh, we don't work enough?

TEACHER: You work very well! Why are students so eager to take the blame for a problem in class? Tell me, what do you do in class?

CLASS: We talk.

TEACHER: What else?

CLASS: We work.

TEACHER: What else?

CLASS: (Blank looks)

TEACHER: Do you ever wait in class?

CLASS: Yes.

TEACHER: What do you wait on?

CLASS: You!

TEACHER: Yes! That's the problem!

A CLASS SMART ALECK: (Light-hearted) You're the problem, Dr. Buckner!

TEACHER: (Smiling) Yes! Yes, I'm the problem. When I tried out the Japanese steakhouse style of teaching at the end of the year last year, this wasn't a problem. Students loved it, and I loved it. So, this year I've switched over entirely to the Japanese steakhouse style of teaching — but I never anticipated that you would go so fast I wouldn't be able to keep up with you! This is the problem we need to solve.

ANOTHER CLASS SMART ALECK: (Grinning) We'll be happy to slow down for you, Dr. Buckner.

TEACHER: (Wryly and playfully) Thank you for your willingness to sacrifice for my sake, but I don't think that will be necessary. (Pause) One way to solve the problem would be to go back to traditional lecture-based teaching...

CLASS: (Unanimously) No, no, no!

TEACHER: Can't we at least consider going back to lecture-based teaching?

CLASS: (Adamantly) No! We love coming to this class! We love how you run it!

TEACHER: Well, let me hear some ideas, then.

CLASS: (A mixture of blank looks and thoughtful looks.)

TEACHER: No ideas? Well, I have an idea: Instead of covering new material with each learning team individually, your teams could each send a representative to me — I could cover the new material with them, and they could bring it back to you.

CLASS: (A few weak nods, but mostly troubled faces) We don't like that idea. How can we be sure we're getting the right information? It's like playing "telephone."

TEACHER: But I would circulate team-to-team to correct misinformation and fill in the gaps.

CLASS: No. We don't want to do it that way. (Pause) When we finish learning one skill, we have to wait on you to circulate around to our team to check us off and give us the packet for the next skill. Why not lay out the packet for the next skill on the front table instead. Then we could come get it and start working on it without waiting for you to come to us.

TEACHER: I like it! Why didn't I think of that! It will take me one or two days to prep for that, but I'll do it!

CLASS: And if you could tell the whole class about the learning packet when we first get it, we wouldn't have to wait for you to circulate from team to team to get us started.

TEACHER: That sounds a lot like a lecture. Is that what you want?

CLASS: (Troubled looks) Hmmmm.......no.

TEACHER: How about this... Instead of a lecture, I could give the whole class a very short introduction — just enough to get you started, not a full lecture with all the information. Then I could circulate from team to team and fill in the gaps while you are working on the packet.

CLASS: (Happy faces all around) Yes! That would be great! Then we could get started right away!

CLASS: (Pause, with thoughtful faces all around) But different teams are on different skills. How can you introduce a new skill to the whole class when we are on different skills. Why don't you just keep the whole class together on the same skill?

TEACHER: I really want to keep the teams self-paced. Last year I kept all the students in a class on the same pace, but here's what happens... I HATE, HATE, HATE to leave anyone behind. If I leave someone behind on one skill, they will not be able to pick up the next skill either. Soon they have dropped by the wayside with no hope of catching up. Since I can't stand to see that happen, I keep the class pace slow enough so that everyone can keep up. (Pause) Since I also can't stand to hold students back who could move faster, I experimented last year with letting teams move ahead of the class pace. It worked very well. There are some teams in this class who can complete two years of physics in this one year. There are other teams who will need to go much slower to get a good understanding of the material — that's just the way it is. Whatever adjustments we make this year, I really want to keep it so that students who can go fast are not slowed down, and students who need more time don't get left behind. (Pregnant pause) Here's an idea... We already have a class pace, the pace most students can keep. I can introduce new skills at the class pace even though some teams are ahead of it and other teams are behind it, if I make the introductions optional instead of whole-class — think of it as optional lectures. If your team wants the introductory mini-lecture, come up front and get it. If your team doesn't want it, stay in the back with your team and keep working together.

CLASS: (Enlightened looks) Optional lectures are a great idea! The teams ahead of the class pace don't need it, and the teams behind the class pace aren't ready for it and they can get it later when your circulate from team to team.

A TROUBLED STUDENT: But while you are circulating around the room from team to team, when we have a question we have to wait a long time for you to get back around to our team. Couldn't you stay up front and be available to answer our questions as they come up?

TEACHER: I really enjoy the interactions I have with you in small teams and I don't want to give that up.

CLASS: (Pleased looks on faces all around) Aw!

TEACHER: How about this... I give a short optional mini-lecture to introduce a new skill, and then I circulate from team to team to fill in the gaps. After two or three circuits around the classroom, I park myself up front to take your questions as they come up.

CLASS: (Excited faces) Yeah! That's perfect. (Quiet conversations all around)

TEACHER: I sense that we are ready to wrap up. Before we do, I'd like to make sure we all agree on the steps we are going to take. I understand the steps to be... 1) I will lay out learning packets for your teams' next skills so that you can begin them when you are ready, without waiting for me to come around and hand one to you. 2) I will introduce new skills at the class pace by using optional mini-lectures, just enough to get you started but not with all the information you would get in a full lecture. 3) After introducing a new skill, I will circulate team-to-team to fill in gaps and work with you at your team's pace. 4) After two or three circuits around the room, I will park myself up front and take your questions as they come up. Do I have it right?

CLASS: (Smiling faces and nods all around) Yes!

TEACHER: Okay. Let's try this and we'll see how it works. If it doesn't work out so well, what shall we do? Go back to traditional lectures?

CLASS: No! If today's plan doesn't work we'll meet together like this again and come up with something new to try.

TEACHER: (Pleased) Good! I'm with you! (Brief pause) For the rest of this class period, would you rather go back to class and get to work on physics right away, or go out to the parking lot to look at my motorcyle first?

CLASS: Motorcycle! Motorcycle!

TEACHER: Okay! QUIETLY go out to the flagpole, and I'll meet you there.


At my motorcycle...

A PERCEPTIVE STUDENT: Dr. Buckner, you must feel awesome. You're sitting on your motorcycle surrounded by teenagers who think you're cool!

TEACHER: Yes, indeed!


Saturday, April 14, 2012

Quiz and Test Generator

I'm transitioning to Standards Based Grading (SBG) this year. One essential element of SBG is allowing students to reassess on any of the standards. I tried SBG last year, but the reassessments were unmanageable.

Over the summer I wrote software to automatically make quizzes and tests for me simply by clicking links on my class webpages. The links are set up with parameters specifying what kind of assessment it is, the title of the assessment, the skill or skills to be assessed, and the number of freeform and multiple-choice questions for each skill.

The software reads the parameters, selects skills from a test bank, selects random questions for each skill, and selects random variants of each question. It formats the assessment to be displayed on a screen, so that I can give a randomized quiz to a class on a whim. When I print an assessment, the software formats it differently, optimized for taking the test on paper instead of from a screen. The software will also display and print the answer key for me.

The random selection of questions and the randomization of variants gives me a countless variety of assessments. Even if a test gets out in the public, students who would cheat will see random variations on the questions. They will soon figure out that they must actually learn how to do the problems because the answers on their test will be different from the answers on the test from their friend's class.

You can see the links in the Assessment sections of my lesson plans. My test bank is hidden behind passwords, so you won't be able to see actual assessments by clicking on the links there.

But I have put up a publicly accessible sample so that you can play with it. Try these links to see samples:

I'm writing the test bank as I go this year. Since I'm writing the questions, they correspond exactly to the specific skills I'm teaching. If I don't happen to like the mix of questions on an assessment, I simply reload the page to get a new randomization.

Monday, April 2, 2012

For One Who is Grieving

You're safe in my arms, daughter — safe to cry.
Cry, daughter. Crying is good. Crying is your love for her.
One day you'll finish crying, but not today. Today, let your love for her cry.

You're safe in my arms, daughter — safe to grieve.
Grieve, daughter. Grieving is good. Grieving is your love for her.
One day you'll finish grieving, but not today. Today, let your love for her grieve.

You're safe in my arms, daughter, — safe to feel the emptiness.
Feel the emptiness, daughter. Feeling the emptiness is good. The emptiness is her love for you.
How she must have loved you to leave such emptiness behind!

One day you'll finish crying.
One day you'll finish grieving.
But you'll always feel the emptiness.
When you feel the emptiness, know that it is her love for you.
The emptiness will remind you that her touch on your life is forevermore.
And the emptiness will remind you that your touch on her life is forevermore,
for how she must have loved you to leave such emptiness behind.

It Wasn't Very Long Ago

For my children on their coming of age

It wasn't very long ago I used to set you in my lap
and read you picture books.

It wasn't very long ago you needed me to hold your hand
to take you to new places.

I wasn't very long ago you needed me to teach you how
to understand the world.

Now look at you.
Now look at you!

A little bit of time went by and now
you stand here facing me, a young adult!

I'm not sure I'm ready.

You're not sure you're ready.

But here we stand together side by side,
a single path behind us,
a double path before us.

Let us reminisce upon the single path
we trod together to this place.
And let us contemplate the double path
we've yet to take into uncertain futures.

May we tarry here a moment — a moment more.

May we tarry here a moment more.

For though we hand-in-hand resume our walk from here,
the windings of our separate paths must
draw and break our grasp.

And from afar I'll watch you tread alone
the way to your success.

And I'll recall the time,
and I'll recall the place,
where our one path became two.

And I'll feel the sadness,
and I'll feel the happiness,
of my love for you.

But I'll be satisfied I knew you when you were a child,
and I'll be proud to know you as adult,
off on your own.

Saturday, March 17, 2012

Motivation Research



Ah-hah! This is the first time I've seen results of motivation research. For rote tasks, use the carrot-and-stick approach. For complex tasks, pay enough to take money off the table as an issue, then promote autonomy, mastery, and purpose.

How does this translate to education? Here's how I translate it...

For trainers: Link compensation to trainee performance on a paced, standardized curriculum.

For trainees: Link compensation to good output measured against quotas.

For teachers: Unlink compensation from student performance on a paced, standardized curriculum, then promote teacher autonomy in the classroom, self-directed development of mastery for teachers, and autonomous, self-directed learners as the goal of teaching.

For students: Provide enough success to take grades off the table as an issue, then promote autonomy in learning, self-directed development in the student's desired area of mastery, and learning to learn as the goal.

It's no wonder we're not seeing the results we want from education reform. We've set up the incentives to motivate rote learning and to reward drudgery, not to develop lifelong learners.