Bad Political Science

Daniel Engber should become a full time science critic.* Over at Slate, he eviscerates the latest sloppy fMRI study of the political brain, which was published in the Times on Sunday:

To liken these neurological pundits to snake-oil salesmen would be far too generous. Their imaging study has not been published in any science journal, nor has it been vetted by experts in the field; it can't rightly be called an "experiment," since the authors weren't testing any particular hypothesis; and the arbitrary conclusions they draw from the data aren't even consistent with their own previous research.

He goes on to point out all the internal contradictions in this latest batch of experiments. The basic moral is that our political beliefs are a complicated psychological phenomenon, and are very difficult to reduce into a set of reliable cortical causes. I think the other element at work here is the allure of neuroscientific explanations, regardless of their validity. The only reason this middling science was featured in the NY Times was because they had pretty pictures of the brain that somehow justified their banal political explanations. Brain imaging is an essential scientific tool, but, like all tools, it only works under specific conditions. When the technology is used to answer the wrong kind of questions, what you end up getting is lots of sloppy experimental interpretation dressed up as rigorous science.

*Why don't we have science critics? We have music critics and literary critics and dance critics and architecture critics...Wouldn't it be great to also have knowledgeable people point out the flaws and achievements of the latest scientific papers? And yes, I did write an article on this idea a few years ago in Seed, although it seems to have been lost by Google.

More like this

My latest article for the Boston Globe Ideas section looks at some recent criticisms of fMRI, at least when it's misused: The brain scan image - a silhouette of the skull, highlighted with bright splotches of primary color - has also become a staple of popular culture, a symbol of how scientific…
There is a must-read paper in Nature about the limits of functional MRI as an experimental tool by one of its pioneers, Nikos Logothetis. (Also discussed by Jonah and Vaughan.) This paper is pretty technical, but Logothetis hits the important points of what it is we think we are actually…
Over at Mixing Memory, there's an excellent and fierce critique of a recent fMRI paper on linguistic relativity. Although the post is shot through with overly broad insults - he or she complains about "how much cognitive neuroscience sucks" - it still manages to carefully dissect the data. In short…
Reductionism is seductive, especially when it comes attached with a nifty sounding brain region: Explanations of psychological phenomena seem to generate more public interest when they contain neuroscientific information. Even irrelevant neuroscience information in an explanation of a psychological…

Why don't we have science critics?

...because science is the unquestionable word of God?

"Why don't we have science critics?"

We do. It's called peer review.

even most fMRI studies in real journals are pretty terrible

I think most scientific studies would benefit from the involvement of a sociologist. Sort of a bee-watcher-watcher.

The Gaurdian has this wonderful series called Bad Science written by Ben Goldacre which seems to fit the bill. In his most recent article he does a quite through fisking of homeopathy.