Show Us the Evidence

To each his own evidence. Those seem to be words to live by at the Washington Post and the New York Times.
Let's start with the Post. A Post editorial cites DC's impressive gains in NAEP mathematics results and chalks them up to Michelle Rhee's reforms:
Those seeking to block the changes being pursued by Ms. Rhee...might want to think again.
The evidence is in, they imply. The Chancellor's reform program works. But is that really what the evidence tells us? The NAEP gains began before Rhee took the reins, so her all-but-forgotten predecessor Clifford Janey should share in the glory. And what reforms, exactly, deserve the credit? The much better standards and curricula Janey put in place? Rhee's changes to central office structure? The new principals she has hired? It's hard to say.
How about Rhee's signature reform, which would tie teacher pay to test scores? Well, that reform doesn't deserve the credit because it is not yet in place. But that didn't stop the Post.
Now for the Times. Nicholas Kristof urges teacher groups to "cooperate with evidence-based reforms." Among these reforms: charter schools and performance pay. It troubles Kristof not a whit that the evidence for both of these reforms is thin.
Take performance pay, for example. The National Research Council just warned the administration not to rush states into performance evaluation schemes. Such schemes aren't yet ready for prime time, the NRC's assessment experts wrote. The research just isn't there yet, though there is ample evidence that hastily-designed performance pay systems can do more harm than good..
Of course, neither the Times nor the Post saw fit to report on that bit of news. Instead, their editorial staff and columnists behave as if the choices were clear and the only barriers to success were moral, not technical.
I don't mean to knock charter schools or performance evaluation. We can learn a great deal from the best charter schools, and experiments in performance pay can yield very important knowledge. And reformers are right to argue that we can't wait for ironclad evidence before making changes in our schools.
But we still have to balance urgency and caution. The fate of most school reforms depends on our ability to strike the right balance. Barnett Berry puts it well: "If the new tools to measure teaching effectiveness are implemented poorly...I am afraid the baby will be thrown out with the bath water."
Sign up
Sign up for our e-newsletter on public school success.
Become a Facebook fan.
H1N1 FLU RESOURCES
Click here for resources to help the public education community prepare for the unlikely case of a flu pandemic.
Emerging Vision
On this website, educators, parents and policymakers from coast to coast are sharing what's already working in public schools--and sparking a national conversation about how to make it work for children in every school. Join the conversation! Learn more.
Visionaries
Click here to browse dozens of Public School Insights interviews with extraordinary education advocates, including:
New Stories
Featured Story

A Village Route to Early Childhood Education
In the 1990s, we at Davenport Community Schools noticed a trend: Children were coming to kindergarten unprepared to learn. A troublingly low number of our district’s children (more than half of whom receive free or reduced price lunch) had preschool experience. Recognizing the importance of early childhood education in ensuring students are ready to succeed in school and life, we developed the Children’s Village, which includes formal preschool classes and all-day, year-round programming serving children from six weeks to five years old. Today, when a Children’s Village student arrives for the first day of kindergarten, the teacher can say, “This child is ready to learn.”
With early childhood education, students learn more, teachers accomplish more and taxpayers get more for their education tax dollar. But it takes all our students, teachers, staff, administrators, parents and partners to make the Children’s Villages a success. Indeed, it really does take a village to ensure quality early childhood education. Read more
School/District Characteristics
Hot Topics
Blog Roll
- Boardbuzz
- Edwize
- NSDC Reflections
- Advancing the Teaching Profession
- Principals' Office
- Principal's Policy Blog
- ASCA Scene
- The Leading Source
- PDK Blog
- ASBO Intl.'s Economic Recovery Blog
- Always Something
- U.S. Department of Education Blog
- The Core Knowledge Blog
- This Week in Education
- PTA Blog
- Such a Smart Mom
- Eduwonkette
- Teacher Leadership Today
- On the Shoulders of Giants
- Relentless Pursuit of Acronyms
- Teacher in a Strange Land
- Teach Moore
- The Tempered Radical
- TLN Teacher Voices
- The Educated Reporter
- Center for Public Education
- Connect for Kids
- Once Upon a School

How many urban areas have had
How many urban areas have had an economic boom since 9/11 as much as DC and NYC? DC had "more money than god" and then they got more money. Schools like Shaw not only get to recruit nationwide in an environment where money has been no object, but they get funding for socio-emotional supports beyond the dreams of most Bolder Broader advocates. In NYC the INCREASES in per student funding under Klein are greater are greater than the total per capita spending on my students.
Let's see how they do in an economic downturn before proclaiming victory.
I'd like to challenge Kristof the way I challenge my students and ask him to "self-assess." How much time did he spend reading, listening, and evaluating before he reached his conclusion that the union's proposals were inadequate. I wonder how many footnotes from the New Yorkers source, the TNTP, did he check. By my count, the Widget Effect had ONE footnote backing its claims on VAMs and they actually contradicted the report's claims.
I've been reading Kristof for years. Does that qualify me to pontificate in the NYT on Sudan? Would he just accept the words of his one or two favorites sources when writing on foreign affairs? Would editors allow such shoddy research on presidential politics, covering the Suprme Court, or on the economy.
This is just another example where education is a second class topic. Outsiders can ignore generationals of social science in our field, repeat the soundbites of their friends, and editor don't ask for evidence.
Thanks for your comment,
Thanks for your comment, John.
My biggest beef has been with the media's take on performance evaluation based on measures of student growth. People like Kristof, Brooks, Alter and countless others fail to address the strong methodological concerns associated with many approaches at this time. They write as if teachers squeamish about pay for performance based on value-added measures wanted to avoid accountability. As Tom Toch noted in a recent article, there are many legitimate reasons for being squeamish. So why not admit the difficulties and pour our energies into working with educators, researchers and other stakeholders to get it right? That will take time we feel we can ill afford, but the alternative is to do the reforms long-term damage by killing their credibility.
And here's another thought. Perhaps we can pay newspaper pundits for their performance. Pay them only for what they get right--for predictions that pan out, for example, or for judgments based on strong evidence. I suspect the incomes of many would drop dramatically.
"pay newspaper pundits for
"pay newspaper pundits for their performance."
i've got to steal that. Thanks
Did you know I used to be a
Did you know I used to be a hard-news reporter for a daily? I'm sure you've noticed my extreme liberal bias on several occasions. :]
The more I read about the NAEP, the more it gets me nervous. Imagine, a national test that could track progress and compare apples to apples. "Child as widget" thinking is bad enough now.
I am saddened to hear about my nephew's struggles in an Ohio Title I school. They're deemed in need of improvement so they're cracking the whip on these kids all the time. I keep telling the grandma who has custody to advise the child and his friends to fail. If they keep failing, the school will have to provide school choice and tutoring. It's what's best for the children! Don't let the school people bully you! Failure is your ticket out of there!!
Sigh.
But they're old folks. They think doing well on a test is a matter of pride. The children lose and are hounded to perform, perform, perform. The entire school day is structured around the test. Grandma doesn't understand how our "special needs" kid could be going into fifth grade math at age 8 when we only work a few hours a day. I'm trying to tell her it's BECAUSE we work only a few hours a day that my children don't dread the work.
Such a hard system for teachers and children alike!
Hi, Mrs. C. As you know, you
Hi, Mrs. C.
As you know, you and I disagree about NAEP and its effects, so insert debate here. :)
As for hoping a school fails as a means of triggering choice and tutoring provisions.... Unfortunately, experience so far has demonstrated that the choice and tutoring provisions haven't been very successful. In many communities where parents would most need other choices, choices are limited. The quality of tutoring--when people actually demand it--has often been very low. So, be careful what you wish for!
LOL Claus... insert debate
LOL Claus... insert debate here about what constitutes "success" in education. :]
If I were a parent in the district, I'd do whatever is in the best interests of my child (statistics may show a general trend, but don't necessarily show me what is best for my particular child). You're probably right that their publicly-funded "choices" are going to range from horrible to poor.
I mean, that's why I'm homeschooling. I've made a choice. I had to choose between a public school that probably does a WAY better job in subjects like Spanish, but didn't treat my child with dignity and respect... and teaching him at home. Would the statistics show I am doing a poor job?
We'll never know because I like hanging up on people who ask survey questions and am not known for my honest responses anyway. I like to do things like mark my race down as "Displaced Edenic Peoples" or my occupation as "Do I need one?" for fun on official forms. :P
Post new comment