links for 2009-03-04

Tags

More like this

It occurs to me that I still haven't scored and posted the winners of the BoF 2008 Election Prediction Contest. Formally I still can't, because the Minnesota senate race has not legally been resolved. For all practical purposes it has, but I like to be sure about things before I go and award the…
Vice President Dick Cheney was recently invited to be the commencement speaker at Brigham Young University, but this invitation has triggered a protest at the ultra-conservative Mormon university. It seems that some of the faculty and students -- who are devoutly Republican -- are offended by…
I've been having fun lately watching this guy struggle with the 21st century realities of scientific publishing which has a lot of parallels with the struggle that journalistic curmudgeons have - too steeped in the 20th century model to have the courage to think in a new way: Socialism in science,…
Ringing in Kepler's Year : Built on Facts "Happy new year! While we're thinking about years, why don't we think about one of the first guys to explore the physical reason behind the year?" (tags: science astronomy planets education math blogs built-on-facts) The Universe within 12.5 Light Years…

Cameron at Science in the Open is worried about the possibility that the present peer review system is in danger of breaking down. That is a concern I have also had: refereeing is something that by its nature cannot be explicitly rewarded, and it takes time away from other duties like research and teaching.

He also touches on an important point in the passage you quoted: A significant proportion of published papers are never cited. To me it follows from this that there is no point in peer reviewing them. If anything, he is understating the problem: across all disciplines, the median number of citations of any scholarly work within five years of publication is zero. But I am reluctant to draw the conclusion he draws. My objection is that it is not always possible to know in advance which papers will be dead ends. Perhaps he favors making something like the arXiv more prevalent, but he doesn't explicitly make that argument.

Peer review originally developed because the ever expanding frontiers of knowledge made it impossible for a journal editor to be an expert on everything published in the journal. The alternative, in effect, is that everybody doing science has to become an editor, deciding which papers are worth reading more thoroughly and which are not. There are problems with that solution, too. I'm not sure which is better, but I do suspect that a hybrid system (some journals refereed, others not) is likely to be unstable.

By Eric Lund (not verified) on 04 Mar 2009 #permalink