The Problem with Publication-Driven Science

Now, I realize with this title, lots of people are thinking that I'm trying to do away with scientific articles. Far from it. But the use of published articles as 'scientific currency' can retard the adoption of new breakthroughs. A recent personal experience is in order.

I recently heard an invited speaker give a talk about a new way of handling DNA sequence data*. After the talk, in a private meeting, I asked the speaker if this software was available for implementation, and said speaker looked horrified. "We haven't submitted for publication yet." It turns out that no one will have access to this method for a year or so.

Now, I'm not a political novice, so I moved on**. But a year in my field (and many others, of course) might as well be the 22nd century. Keep in mind that this method is the result of federally-funded research. Yet this existing, functional breakthrough will be unilaterally embargoed to meet the demands of publication.

I don't blame said speaker: the academic career system uses 'pubs' as primary currency. But there is a serious problem when breakthroughs are delayed in being tested in the ultimate crucible of science--which is not journal peer review--but use by and utility to other scientists.

Within the current constraints of our scientific system, I don't know how we improve this. This is one more reason why I find various white papers put together by prestigious panels of academic scientists who shockingly discover that the current model of independent academic lab scientists is... the bestest model EVAH!! to be incredibly frustrating. There are other models, which, of course, have their own problems, but we seem to be far too sanguine about the current problems.

*I'm keeping the science vague for my own nefarious purposes.

**With the advances in data generation, sending small pieces of data to this person really isn't an option.

More like this

ScienceBlogling Revere calls for an open data policy for federally-funded research (italics mine): We've inveighed often here about the shameful practice that many senior and well-respected flu scientists have of keeping their sequences private until they publish -- if they publish using them. If…
A little over 300 years ago, Antonie van Leeuwenhoek, a dry goods seller from Delft in Holland, learned to grind glass into lenses and fashion the best microscopes the world had ever seen. In those days, the idea of being a "scientist" as a profession was ludicrous. Natural philosophy was pastime…
I spend a lot of time thinking about the scientific method. I don't mean that thing you learned in high school, where you make an observation, form a hypothesis, design an experiment etc etc. That's certainly part of the scientific method, but the linear formula that freshmen are typically forced…
Vacation time! While Orac is gone recharging his circuits and contemplating the linguistic tricks of limericks and jokes or the glory of black holes, he's rerunning some old stuff from his original Blogspot blog. This particular post first appeared on January 16, 2006. Enjoy! During my usual weekly…

Can a collaboration be worked out where sharing can be done in advance of publication. I do this all the time- it doesn't fix the larger problem- but ... I don't see a way to fix the larger problem...

drdrA,

There will always be some larger problem since every solution creates new problems. Personally, I'll take the problems of publication driven science over the problems of profit driven science. Perhaps the best solution is to have a mixed system where science is being driven on several fronts.

Can a collaboration be worked out where sharing can be done in advance of publication. I do this all the time- it doesn't fix the larger problem- but ... I don't see a way to fix the larger problem...

SciencePundit,

Just for the record, I don't work in industry, but for a non-profit institute. I do agree that other models need to be adopted that don't resemble academic departments.

Honestly, people can simply forget the pubs - People in my field have done it. Ty Hedrick developed a widely used digitizing tool and simply turned it loose to the world, which made his name. One of the faculty in my department is working on a high-speed 3-D x-ray system, specifically with the intent on making it free for all (equipment cost aside).

I've actually been considering another problem - the publication of crap. Everyone wants a pub, especially after investing the time and effort, even if it's crap. If they get turned down and told the experimental is fundamentally flawed, they'll just submit to other journals with lower standards, over and over until it *finally* gets out. So a pub count is a poor metric, even with impact factors.

Honestly, people can simply forget the pubs ...

LOL. Yah, sure. Sorry, in my job I'm literally evaluated on how many pubs I put out a year. I need -- at a minimum -- 2. Anything lower than that magic number and my job is placed in jeopardy.

Publication being of course the worst system ever devised, except for all of the others...

At least under this system there is an incentive to get important things published quickly. The alternative is hard money or gentlemen scientists putting the manuscript in a draw for a few decades ala Darwin.

Hola, soy de México, me encanta el nuevo proyecto, soy súper fan de XTC. Me gustarÃa saber como puedo conseguir algunos albumes. Lo amo Sr. Partridge!!

Hola, soy de México, me encanta el nuevo proyecto, soy súper fan de XTC. Me gustarÃa saber como puedo conseguir algunos albumes. Lo amo Sr. Partridge!

If you are willing to buy a house, you would have to receive the mortgage loans. Moreover, my father commonly takes a credit loan, which supposes to be the most firm.