Analogies Are Like a Thing That Can't be Stretched Too Far

Inside Higher Ed today offers a column by Daniel Chambliss of Hamilton College, taking issue with the Spellings commission report on higher education, and its analogies comparinf education to manufacturing:

By the conclusion of Secretary of Education Margaret Spellings' recently-convened Test of Leadership Summit on Higher Education, I finally understood why her proposals are so ... well, so ill-conceived. They rest on a faulty metaphor: the belief that education is essentially like manufacturing. High school students are "your raw material," as Rhode Island Gov. Donald Carcieri told us. We need "more productive delivery models," economies of scale, even something called "process redesign strategies." Underlying everything is the belief that business does things right, higher education does things wrong, and a crisis is almost upon us, best symbolized by that coming tsunami of Chinese and Indian scientists we hear so much about. Time for higher ed to shape up and adopt the wisdom of business.

As regular readers know, this is very much in line with my own opinions, so you might expect that I'd be thrilled with the op-ed. Unfortunately, Chambliss goes a little too far in the other direction.

He chooses three ideas from the Spellings report to object to in detail:

  • "If it isn't measured, it isn't happening."
  • Motivation is simple
  • Clearly stated goals at the outset are a prerequisite for success.

He ridicules each in turn by saying that these may well apply to steel girders, but students are not steel girders. Which is all well and good, except that the propositions represented by those phrases are, for the most part, fairly unobjectionable.

Take, for example, his comment on the first point, which he summarizes as "Without formal assessment... nobody learns anything.":

But for human beings, it's obviously wrong, unmeasured good things happen all the time. Left alone, a 5-year old will explore, discover, and learn. So will a 20-year-old. They get up in the morning and do things, for at least a good part of the day, whether anyone watches and measures them or not. Many people read even if they aren't forced to. The professor does nothing; the student learns anyway.

That's a lovely thought, and I'm sure it's true to some degree, but it completely misses the point. The idea, as I understand it, is not that we need to give lots of tests in order to force students to learn, it's that we need to give tests so we can know what they've learned.

And, you know, I don'thave a problem with that. I'm a scientist, so I like data, and collecting data is generally a good thing. The mere fact that learning can happy outside a formal classroom context is no reason not to try to collect data about what's going on.

Now, it's also true that data collection can be overdone, particularly when talking about "high-stakes testing" and the like. It's important that whatever means you choose to assess student progress be minimally burdensome for the people doing the ground-level work, and that you don't try to fool yourself into thinking that you're measuring finer distinctions than your tools allow, and there are solid arguments to be made against the Spellings commission and other educational reports on those grounds. That's not what I get from this op-ed, though, and I'm not comfortable with what this does say.

There are similar problems with the objections raised to the other two points. The argument is strongest on the motivation issue, where he correctly notes that trying to push basic incentives too far can lead to perverse results, but again, the fact that dramatic actions can have unexpected consequences doesn't mean that more moderate actions can't work as planned. The final point is just bizarre, though-- the need for clear goals seems to me to be completely obvious and reasonable. You can disagree about what the goals should be, or what tolerance you'll allow for implementations that come up just short of those goals, but you need to have goals, and the clearer the better.

So, once again, I find myself in the squishy middle. I find most advocates of "assessment" based reform in education to be excessively technocratic, but Chambliss comes off as the prototypical fuzzy-headed humanist trying to deny the very existence of any objective reality, and I'm not comfortable with that, either. (The great irony here is that his byline lists him as "director of the Project for Assessment of Liberal Arts Education.")

On some level, they each have the same problem with analogies: groups like the Spellings commission take the analogy between education and business farther than I think is productive, but Chambliss is taking it even farther in insisting that they're trying to treat students like steel girders. Neither view is particularly accurate, and the analogy has become a real barrier to communication.

Tags

More like this

Assessment doesn't just tell us whether or not the students have learnt; it's also an essential tool for the students themselves, who otherwise can find it hard to judge their own achievement.

Chad: You can disagree about what the goals should be, or what tolerance you'll allow for implementations that come up just short of those goals, but you need to have goals, and the clearer the better.

I don't think it is very useful to try to establish goals at the university level, let alone, across the entire U.S. higher education system. Ultimately, these goals will be so broad that they are rendered useless. I think setting goals within departments or within classes at specific universities is more appropriate. Although, these goals at the departmental and class level should be made public so that students can choose classes and majors accordingly.

Higher education is (and should be) a marketplace where each student has specific goals and chooses institutions, majors, and classes accordingly. For most, the ultimate goal is landing a specific job and they choose classes accordingly. There are plenty of students, however, who simply enjoy learning and select what many percieve as a useless combination of classes. It would be huge mistake to limit these students' choices because they don't coincide with ED's larger goal of helping our economy through the creation of a one-size-fits-all educational pipeline.

I had Chambliss as a professor at Hamilton. He is easily one of the best professors I have ever had. He is a tough grader who does not use any formal assessments. Instead, all assessments are done via one-on-one somewhat structured conversations with Chambliss. I am pretty sure that his class grades, on average, are some of the lowest of all professors at Hamilton. However, students flock to his classes. Their "goal" isn't to learn sociology, to acquire a credit toward a major, or to get a grade in the class. Instead, they take his classes simply for the educational experience of having him as a professor (by default, they learn a hell of a lot about sociology). Spellings' vision for higher education would destroy the dynamic displayed in his classes. I hope this provides a bit of insight regarding the perpsective from which Chambliss is writing.

Public education is continuous disimprovement - progressively more ponderous, more inclusive, more expensive means to increasingly undesirable ends. We are succeeding mightily. Managerial performance bonuses and student psychopharmaceutical costs validate this. We look forward to that bright, bright future when a full scholarship diversity admission is intensively counseled on how to find its dorm room number (compassionately posted in Arabic, Chinese, and Quechua khipu; plus an RFID chip).

Has education considered addressing market needs? Hunter College disgorges wonderfully degreed waitresses.