The X Factor of School Reform

Assessment, Learning, Organizational Change

In case you missed it, there was a great piece in yesterday’s New York Times, the core message of which has a lot of relevance for those of us who, barely a week removed from not one but two major reports of misleading test data being used to evaluate schools and school districts, continue to search for the simplest way of evaluating what may be the most complex undertaking in the professional world — creating a challenging, engaging, relevant, supportive and experiential learning environment in which all children can learn.
The Times article had nothing to say about school reform — it was about the Fed’s inability to decide whether to stimulate the economy now or later. And it was about how even in a social science flush with quantitative data, the “social” aspect of the science — i.e., human behavior — is sufficiently complex and nonlinear to make certainty a chimera. “One point I always make to my graduate students,” said Robert Solow, a Noel Prize winner and MIT professor, “is never sound more certain than you are.”
Would that such caution were commonplace in our current conversations about education reform!
Of course, the message is not that economics is a boundless free-for-all discipline that uses numbers to hide its own guesswork — charges that are sometimes made to rebut the growing push in education circles to embrace a greater use of student information to guide adult decision-making — but one message seems clear: beware the worship of “data” in your search for certainty, as long as human beings are part of the equation. “The entire question of how emotion will change people’s behavior is pretty much outside the standard model of economics,” said Dan Ariely, a professor at Duke. “Pride is not in the model. Fear is not in the model. Revenge is not in the model. Even simple things like disenchantment of people who are fired from their jobs — the model doesn’t account for how devastating that experience can be.”
Reform leaders, are you listening?