The Impact Factor Folly

The latest issue of Epidemiology features a (only somewhat tongue-in-cheek) article by Miguel A. Hernan: Epidemiologists (of All People) Should Question Journal Impact Factors. Well worth reading and thinking about:

Developing a good impact factor is a nontrivial methodologic undertaking that depends on the intended goal of the rankings. Hence, a scientific discussion about any impact factor requires that its goal is made explicit and its methodology is described in enough detail to make the calculations reproducible. Paradoxically, the methodology of the impact factor that is used to evaluate peer-review journals cannot be fully evaluated in a peer-reviewed journal. As illustrated above, a manuscript describing the Thomson Scientific impact factor would be a hard sell for most journals, and hardly acceptable for the American Journal of Epidemiology, the International Journal of Epidemiology, or Epidemiology.

The same issue also features several interesting responses:

Impact Factor: Good Reasons for Concern
How Come Scientists Uncritically Adopt and Embody Thomson's Bibliographic Impact Factor?
Rise and Fall of the Thomson Impact Factor
The Impact Factor Follies

More like this

It's been a while since I came back from Boston, but the big dinosaur story kept me busy all last week so I never managed to find time and energy to write my own recap of the Harvard Conference. Anna Kushnir, Corie Lok, Evie Brown, Kaitlin Thaney (Part 2 and Part 3) and Alex Palazzo have written…
Well, that was quick. Yesterday's post highlighting a really terrible paper in BMC's Virology Journal drew a lot of comments here and at Pharyngula, and attention at the journal (where it currently stands as the 5th most-accessed article in the last 30 days). The journal's Editor-in-Chief, Dr.…
These last couple of days were very exciting here at PLoS. After months of preparation and hard work, PLoS presents the latest addition to its collection of top-notch scientific journals. PLoS Neglected Tropical Diseases went live yesterday at 6:42pm EDT. This journal will be ...the first open-…
There's an article in yesterday's New York Times about doubts the public is having about the goodness of scientific publications as they learn more about what the peer-review system does, and does not, involve. It's worth a read, if only to illuminate what non-scientists seem to have assumed went…