If You Already Know “The Answer,” Don’t Pretend You’ve a Problem

Yesterday, I was catching up on the journal articles, reports, white papers, and the other stuff that’d piled up in my analog “read later” stack.1 One article, which I quickly skimmed and then returned to my shelf of back issues, bugged me a bit.

Not the article itself. It was a research summary of some work done to promote technology use with practicing teachers. The professional development project was similar to some of our Digital Learning Collaborative work, and appeared to validate some of our decisions. But one of the appendices – there are four, if I recall correctly – has returned to my front brain a few times since yesterday’s scan.

The appendix was a template for creating problem-based STEM exercises for students. And an offhand comment in the thing has really, really bugged me. I don’t have access to the document right now, so I’m working from memory, but in the section of the document labeled “Solution,” which came after “Problem,” was the statement, “If more than one solution seems possible, then likely the problem was poorly constructed.”

What terrible advice.

Better advice would be the opposite. Something like “If only one solution seems possible, then likely you’re working with a really uninteresting problem, and should scrap the entire activity.” Or maybe, “If you believe you have every possible answer to this problem worked out, you should stop lying to yourself.” Or, “Just go ahead and give them a worksheet. It’d be faster.”

Seems to me that whenever you’re actually asking students to contemplate real, authentic problems and scenarios2, then it’ll be pretty difficult to know the “answer” to them. And if you do know the answer, then perhaps you should just tell the students what you know, quickly, and move on to the next problem.

And you certainly shouldn’t be in the business of only offering problems to students that you’ve already decided don’t need further attention.

Right?

  1. I caught up rather quickly, as I’ve discovered that my past self isn’t always the best at determining what my then future and current present self is going to want to spend time with. []
  2. And we should really, really be doing that. []
Google+EvernoteEmailWordPressRead It LaterInstapaperShare

Data Dashboards

In a district meeting I’m a participant in, we’re reading the book The 4 Disciplines of Execution.  It’s an interesting book, and the main thesis is that change isn’t about doing everything, it’s about breaking the essential stuff you want to get done into bites that people can handle, then building structures and cultures around those bite-sized pieces, helping the folks you work with understand how to measure and take score of their efforts and how they contribute to a larger goal.  It’s not a radical idea, but it does make sense, and the execution is the hardest part.  I like the book and am looking forward to our continuing conversations (and hopefully action) about the text.

One of the biggest and most interesting elements of the book, to me at least, is the idea that you must trust the people in your organization to be able to track their own progress in what they do.  Specifically, the authors suggest that while leadership should set the large goal (the “wildly important goal” in the language of the book), the participants in the work should be tracking and measuring their own small pieces of that goal.  And, I’m sorry, but let’s dig into the weeds of how the book says to do that, because it’s going to be helpful.

The authors argue that there are two types of measures that folks can use to assess their progress.  They call them “lag measures” and “lead measures.”  Lag measures are the ones that we often think about when we’re talking about goals:

A lag measure is the measurement of a result you are trying to achieve.  We call them lag measures because by the time you get the data the result has already happened, they are always lagging. . . . Lead measures are different; they foretell the result.  They have two primary characteristics.  First, a lead measure is predictive, meaning that if the lead measure changes, you can predict that the lag measure will also change.  Second, a lead measure is influenceable; it can be directly influenced by the team.  That is, the team can make a lead measure happen without a significant dependence on another team. (pp. 64-65)

In school terms, a lag measure is a state test score, or an end of year report card.  But a lead measure might be a habit or practice that you implement or work on throughout the year, taking score every now and again.  More on this in a minute.  The book specifically mentions schools and schooling, and I thought this was a good way to say it:

For example, it’s easy for schoolteachers to measure the reading levels of students with a standardized test.  Often, they obsess over these lag measures.  However, it’s harder to come up with lead measures that predict how students will do on the text.  The school might hire tutors or reserve more time for uninterrupted reading.  In any case, the school is likely to do better if it tracks data on time spent reading or in tutoring (lead measures) rather than hope and pray that the reading scores (lag measures) will rise of their own accord. (p. 66)

The tracking of lead measures is so important, the authors argue, because they’re how you move in a new direction.  Figure out what to observe, and the observation and tracking of it can change a course, or improve a result down the road.  That’s, again, pretty basic thinking, but it’s right, and the hard part is building the habits and the follow through to do that.  In fact, it’s so hard, that the authors argue that one of the four disciplines is to “keep a compelling scoreboard” of those lead measures so that folks can pay attention to their change process.  They phrase it this way:

The third discipline is to make sure everyone knows the score at all times, so that they can tell whether or not they are winning. (p. 80)

The scoreboard is a tool for engagement:

Simply put, people disengage when they don’t know the score.  When they can see at a glance whether or not they are winning they become profoundly engaged. (p. 80)

More important than having the scoreboard, though, is that the people playing the game1 need to be in charge of that scoreboard.  They need to be trusted to use it.  And the trust is sometimes hard to build from manager to employee, or teacher to student.  Or district person to school person:

“So, how can I tell if they’re doing these things?” the manager asked.

“You won’t.  Your people will track themselves.” 

“How do I know it’s accurate?” the manager asked. “What if they lie?”

We bet he could trust them.  (p.71-72)

As I read about these measures, and started to think about what lead measures we might want to focus on, which is tricky, because we’re still, as a team, trying to determine our wildly important goal2, I realized that we don’t, in general, give our students much trust when it comes to how we ask them to pay attention to their learning.

We collect an awful lot of data about our students.  The third party tools that we buy for them to use as intervention, remediation, and sometimes textbook, collect lots of information about them, too.  But when do they get that information back in a way that could help them to manage their own learning better?

Could we build some tools that would help to foster metacognition and habits of attention that would help our students learn better?  Could we build them some compelling scoreboards and tools that they might use to get better at learning?  Can we help them build their own?

That’s a powerful idea for me right now.  And there are certainly others thinking about this.  Audrey Watters has written multiple thoughtful posts about the intersection of the Quantified Self movement and learning, and I’d encourage you to read her work.  And, as I asked in a post a short while back, I’d encourage you to be thinking about how your students interact with the data you collect with and about them.

Maybe, too, you should be helping them to determine their own data dashboards to help them reach their own “wildly important goals.”

Right?

  1. A metaphor that might be a bit stressed here, but stay with me []
  2. “Do learning better,” isn’t terribly specific. Nor is my current favorite: “Learn more better.”  Teacher version: “Teach more better.” []
Google+EvernoteEmailWordPressRead It LaterInstapaperShare

So Why the End Comments After Two Weeks, Then?

I’ve often read that endnotey and heavily annotated papers, returned to students after a week or two, aren’t terribly useful for improving student writing, and yet I see that that’s how many teachers seem to “grade” papers. That annotation work that the teacher “has” to do also is given as a reason why more writing doesn’t happen at school. It takes hours of time, time that’s often stolen not from the schedule of the school day, but the teacher’s family or home life.

I don’t get why we continue to think that’s the way it has to be.

In this morning’s WSJ, Doug Lemov has a piece on practice, plugging his new book, and he writes this:

The anecdote suggests the many ways that instructors, in talking about practice, are just as likely to get things wrong as to get them right. Here, social science can help. Research has established that fast, simple feedback is almost always more effective at shaping behavior than is a more comprehensive response well after the fact. Better to whisper “Please use a more formal tone with clients, Steven” right away than to lecture Steven at length on the wherefores and whys the next morning.

I wonder how we might create structures for writing with students that are more about whispering alongside them rather than authoritatively annotating their written work after the fact. The more I use Google Docs for commenting and collaborative writing, the more I feel like that’s on the right track – but how do we change the perception that the teacher’s job is to scribble all over work after the student’s on to the next thing?

Google+EvernoteEmailWordPressRead It LaterInstapaperShare

Let’s Skip the Salad Dressing

When I was a kid, I didn’t do too well with eating my vegetables. My mom, wanting to see some eaten, offered me plenty of salad dressing to eat with the vegetables I wouldn’t, and I got awfully fond of salad dressing.

But not so much the vegetables. I was in my twenties before I discovered that broccoli actually tastes pretty good. All by itself. No sauce necessary.

I wonder some days if the “innovations” folks fawn so much over in the educational technology space are actually helping us to eat our academic vegetables, or if they’re really just helping us to develop a taste for the thing that these innovations use as a distraction from the essential work of learning.

We need our schools to develop strong readers and writers and thinkers, folks who aren’t led along the road of citizenship by badges or points or a snazzy UI. It might be that many of the “innovations” steering students into devices and apps and gamified almost-learning experiences are nothing more than Thousand Island or Ranch in shiny packages.

When someone comes to you and says “Here’s a better way to teach reading,” look carefully. If the “better way” doesn’t actually involve any time spent reading, then that’s not innovation. It’s salad dressing.

Reading and writing are learned through doing them. Just as I learned, over a long time, to like and to choose the broccoli that wasn’t slathered in sauce, children can learn, and often do, that books and reading and the written word are choices that are worth choosing. But only if they actually experience them.

So let’s minimize the salad dressing, okay?

Google+EvernoteEmailWordPressRead It LaterInstapaperShare

The Podcast: On Sunsets and Arguments

In today’s podcast, actually recorded yesterday, I respond to a response to a response to a piece in The Atlantic that is about writing in school.

Basically, I try to explain that we’ve got some silly false binaries in our heads when it comes to writing instruction.  At the heart of it, writing is about learning how to pay attention.  (At least sometimes.)

Pay attention during the podcast and tell me what you think.

Direct Link to Audio

Google+EvernoteEmailWordPressRead It LaterInstapaperShare

You Should Probably Just Grade Less

I have the pleasure of getting to pop in to the 2012 CSUWP Summer Institute this week and next, helping in a variety of small roles. Yesterday, I was present for a discussion of Because Digital Writing Matters, a common text for the SI that I think is worth your time to read if you’ve not yet had the opportunity.

I was there as someone who knows a bit about digital writing, and so a question was posed to me by a teacher in the group. She’s working on an inquiry project about how technology can be useful to streamline grading. I believe her question was something like “How can I streamline my grading practice using technology.” She was hoping I could suggest some things she might try.

I don’t think she liked my answer.

I suggested that she might want to remove the words “using technology” from the question, as most of the things that I think would streamline a teacher’s practice when it comes to grading are things that have very little to do with technology.

For starters, I think teachers, in general, grade too many things. So one way to streamline would be to “grade” less. And that doesn’t mean that teachers shouldn’t ask students to write, and write often. But we don’t need to grade everything that comes to us. In fact, we should grade very little of it. Heck, and I know this’ll sound a bit weird, but we shouldn’t even read all the writing we ask students to do.

One of the choices that a writer makes, and that a student writer should get to make, too, is when and how and where and with whom we share our writing. Reading and grading everything doesn’t help there. Nor is it manageable for the teacher. I find that we’ve built an expectation into school that teachers are there to write lots of notes in margins and markup student writing.

We’ve built the wrong expectations.

In an #engchat conversation a couple of weeks ago, I suggested that we should take Peter Elbow’s suggestion to read and respond less like evaluators and more like interested readers. I suggested that a copy of Elbow’s Writing Without Teachers would be worth reading.

Another thing that I suggested, before thinking about technology options, is that we need to make sure the assignments we are asking of students are the right things to be asking them to do. And, we need to build structures that support our students reading and writing and making things in partnership with each other.

Then I think I did suggest that many tools of the Web can help to make the work of putting writing in to each others’ hands and eyeballs easier than ever. But that only matters if you’re thinking about how you want students to spend their time. I’m eager to help this teacher in her inquiry work – the question, with or without the last two words, is a good one and worth her time.

Were I thinking about it, I probably would’ve recommended Dave’s recent posts about contract grading. While he’s teaching at the university level, I think they provide some useful ideas for thinking about assessment.

Too often, when we reach for technology, we do so in the service of something that isn’t just a technology issue. When a grading load is unreasonable. that’s likely not a technology problem. Taking a look at the whole picture is sometimes necessary before moving to suggestions of new tools or platforms. Then we can look for tools or apps or whatever that will help us do what needs doing. The problem is, taking that look takes longer than handing out a list of apps or websites.

So guess which thing happens?

Google+EvernoteEmailWordPressRead It LaterInstapaperShare

What Automated Essay Grading Says To Children

“Your thoughts and ideas and writing are so important that, rather than investing in other people to mentor you and nurture your abilities, I’m going to have you put your words into a machine so I don’t have to be bothered to look at them.”

It’s a mixed message.

I’m all for students writing more. There is not enough writing occurring in schools. But someone should be reading the precious texts we ask of our students. They are too important to be left to machines.

Or, perhaps, we should be rethinking what we ask students to write. And when. And why.

Google+EvernoteEmailWordPressRead It LaterInstapaperShare

Schooling That Isn’t School-y

I sat in on a meeting today of the organizers of our school district’s Innovation Academy, a summer STEM enrichment program that’s a partnership between the district and IBM.1

The DLC will be embedding a teacher research group within the Innovation Academy and its planning in order to see if the work they’re doing, and that students and district staff are enthusiastic about, has something to teach us about how we can make positive change in the classroom.

During the meeting, two statements really caught my ear and got me thinking about the work ahead.

The first was a statement, made during the meeting and repeated by several folks in the conversation, that the goal of Innovation Academy was to create an environment that didn’t feel anything like school.  Both our district staff and our business partners felt this was important.  I find that both makes sense to me and is, well, rather odd.  That we’ve a shared understanding of school as something that isn’t conducive to learning is troubling, but I get where they’re coming from.

The other thing that caught my ear was a mention, in passing, by one of the IBM partners that during last year’s camp, he noticed that the younger students involved in the camp, Kindergarteners, were plenty able to think in creative and nontraditional ways.  That’s not quite how he said it, though.  He actually said that sometimes, the youngest students were the best able to be engaged in the work of the camp2.

If, of course, we are trying to build learning experiences that are not at all like school, then it makes sense that our least schooled students would be the best at them.  Of course, it’s also possible that the Kindergartners at Camp Innovation are students who’ve not yet had their imaginations stamped out by school.

I’m eager to begin the observational work of documenting what makes the Innovation Academy exciting and engaging for students and staff.  And also I’m looking forward to teacher researchers teasing out if they can fiddle with their classrooms in ways that make school less school-y.

There is something worth going after in the space between the school-y and the not so school-y.  I hope it’s a piece of the possible future of public schools.

 

  1. Last year, the project was called Camp Innovation.  Names change.  I like the camp metaphor, but it wasn’t my call. []
  2. And now academy. []
Google+EvernoteEmailWordPressRead It LaterInstapaperShare

On Skinned Knees & Lessons Learned

It’s skinned knee season in our home, with two girls riding bikes of the two and four-wheeled variety, and a third toddling along just behind – ready for far more than she’s capable of.

And I’m not one to stop someone who’s trying to make progress, even if that progress might be dangerous.

So we’ve been through lots and lots of boxes of Band-Aids for hurts both real and imagined. And we’re quick to wash out wounds and make sure that we keep them looked after.

But no matter how well we wash and watch, some of them are going to leave permanent marks. Like the time Ani discovered that you can’t make a ninety-degree turn on a bike. Or the time that Teagan realized, in a most unfortunate way, that you cannot stop a tricycle like Fred Flintstone could stop his car.1 Quinn forgets, sometimes, about “down.” She’s still kind of new.

Each of those moments hurts. But hurt can have an upside. In fact, some would tell you that hurt, or pain, has an evolutionary advantage. It tells us when we hit a limit of some kind.

And those marks will help them remember the stories of the injuries one day. They’ll proudly show the little scars and blemishes that never quite go back to normal and explain that they rode a bike early, or took a chance on a curb or wrestled with a cat or went head over handlebars in a moment of panic.

But hurt, like fear, well, it just hurts. And to know someone you love is hurting is the worst kind of pain, a pain of helplessness and empathy and doubt.

Oh, how I wish I had a suit of Nerf and armor that I could force my children to wear when they go out into the world, or want to wrestle that cat. To be able to ensure the safety of my children, be they walking to school or traversing a steep hiking trail along the edge of a narrow cliff, would make my sleep come much easier.

But I don’t. And the marks and memories would be hard to accumulate from inside an impenetrable shell of foam. I also suspect it’d be mighty difficult to hear with all that Nerf so close to one’s ears.

There are plenty of days I want to say “Today, let’s stay here, where cars and cats and cliffs and sticks and stones and words can’t hurt us.” But I can’t. Because that’d be parental malpractice. As a dad, it’s my job to listen and bandage and help my children to be brave, to not stop when it’d be a whole lot easier and may well hurt a great deal less and be more safe to just stay still. Being brave? It’s important. And I hate it. Oh, there are days I very much dislike that job.

As a teacher, that’s my job, too.

I hope you’ve got a kit full of peroxide and Band-Aids with you as you take your charges out into the world. I hope you, and they, are being very brave.

  1. Of course, Teagan would have no clue who Fred Flintstone is. Or was. Whatever. But I do find it interesting that “Flintstone” is in my Web browser’s dictionary. []
Google+EvernoteEmailWordPressRead It LaterInstapaperShare

On Being Afraid

On Friday, Converge did a quite nice write up of some of our district’s work with technology. I found it to be a splendid piece. Specifically, a large portion of the article featured some of the work we’ve been doing with the Digital Learning Collaborative. If you need a one sentence summary of that work, well, Paige does a fine job:

It was awesome and scary for some to be in charge of their learning.

I think that pretty much sums up what I’m seeing with regards to the way that we’re asking teachers in the DLC to take control of their own learning. It is scary for many of our teachers to take control. And it is awesome, delightful even, when it happens.

More often than I’d like in the DLC, the teachers that we’re working with, and we work with the leaders of the teams, folks identified as teacher leaders in their schools, so chew on that a bit, are afraid, or unwilling, or unable, to take control of their own learning. These teachers, quite fine and thoughtful people, are often waiting for Michelle or I to tell them what’s worth learning and/or doing. That’s troublesome1.

This is mostly a rhetorical question, but I’d encourage you to consider it anyway – what’s happened to teachers and teaching that it’s so difficult for teachers to feel they have agency enough to follow their own lines of inquiry and learning?

And why in the world is that okay?

  1. And the word “troublesome” is quite the understatement, I think. []
Google+EvernoteEmailWordPressRead It LaterInstapaperShare