links for 2009-03-04

Tags

More like this

Photo credit: Margaret C. Hardy
Alfred Russel Wallace collected this specimen of an adult male Red Bird of Paradise, Paradisea rubra.
Books off the queue and lodge securely somewhere behind my eyes: "A Mathematician's Apology" by G.H. Hardy and "A Demon of Our Own Design: Markets, Hedge Funds, and the Perils of Financial Innovation" by Richard Bookstaber
"I remember once going to see him when he was lying ill at Putney. I had ridden in taxi cab number 1729 and remarked that the number seemed to me rather a dull one, and that I hoped it was not an unfavorable omen.

Cameron at Science in the Open is worried about the possibility that the present peer review system is in danger of breaking down. That is a concern I have also had: refereeing is something that by its nature cannot be explicitly rewarded, and it takes time away from other duties like research and teaching.

He also touches on an important point in the passage you quoted: A significant proportion of published papers are never cited. To me it follows from this that there is no point in peer reviewing them. If anything, he is understating the problem: across all disciplines, the median number of citations of any scholarly work within five years of publication is zero. But I am reluctant to draw the conclusion he draws. My objection is that it is not always possible to know in advance which papers will be dead ends. Perhaps he favors making something like the arXiv more prevalent, but he doesn't explicitly make that argument.

Peer review originally developed because the ever expanding frontiers of knowledge made it impossible for a journal editor to be an expert on everything published in the journal. The alternative, in effect, is that everybody doing science has to become an editor, deciding which papers are worth reading more thoroughly and which are not. There are problems with that solution, too. I'm not sure which is better, but I do suspect that a hybrid system (some journals refereed, others not) is likely to be unstable.

By Eric Lund (not verified) on 04 Mar 2009 #permalink