1. clock
  2. The promise of peer review

The promise of peer review

By clock on November 20, 2008.

An interesting and insightful article by Vivian Siegel:

It is ironic that, in an era known for the great speed and availability of information - where we could choose to blog our results rather than submit them to journals - publishing papers seems slower and more painful than ever before.

------------------------------

I believe our best hope for fair and constructive decisions is to relieve reviewers of the responsibility to make recommendations for or against publication and to maintain a separate, much smaller pool of editors who can be dedicated to the journal and to its standards, and who can discuss the decision with full knowledge of other papers being considered by the journal. This would of course require editors to take responsibility for their decisions and not to hide behind the recommendations of anonymous reviewers.

If we ask reviewers to concentrate on the research, I think it will make the review itself more constructive. When we launched PLoS Biology, I noticed that reviewers often wrote that they were unable to make recommendations because they didn't know what we wanted to publish, so they had to stick to the strengths and weaknesses of the paper, leaving the editors to decide whether to accept it. Interestingly, authors told us that the reviews from PLoS Biology were among the most constructive they had ever received, even if we decided against publishing the paper. I've heard this phenomenon echoed by editors at other new journals, leading me to imagine a day when peer review is uncoupled from journal selection, making the process essentially 'journal blind'.

Tags
open science

More like this

Open peer review: an idea whose time has come?
Over at the Nature blogs, they're soliciting comments and opinions about open peer review: The goal of any change in the peer review system must be to improve the quality of review, where quality is determined by two distinct functions: filtering manuscripts for publication in a given journal; and…
It's that time again: "Broken" peer review
Having spent the last couple of days dealing with pure woo, such as germ theory denialism and naturopathic quackery, I think now's as good a time as any to move on to a more serious topic. One of the most important aspects of science is the publication of scientific results in peer-reviewed…
CloudGate: Denialism Gets Dirty, Reputations Are At Stake
There has been a major dust-up in the climate denialist world. A study published in late July made false claims and was methodologically flawed, but still managed to get published in a peer reviewed journal. The Editor-in-Chief of that journal has resigned to symbolically take responsibility for…
"I do not think that phrase means what you think it does." (NYT on peer review)
There's an article in yesterday's New York Times about doubts the public is having about the goodness of scientific publications as they learn more about what the peer-review system does, and does not, involve. It's worth a read, if only to illuminate what non-scientists seem to have assumed went…