Reproducible Research

Our friend Victoria Stodden is the lead author on a paper published today in Computing in Science and Engineering summarizing the recommendations of a roundtable we participated in at Yale on data (and code) sharing in (computational) science. Seed's Joy Moore is an additional author on the paper.

To adhere to the scientific method in the face of the transformations arising from changes in technology and the Internet, we must be able to reproduce computational results. Reproducibility will let each generation of scientists build on the previous generations' achievements.... Reproducible research is best facilitated through interlocking efforts in scientific practice, publication mechanisms, and university and funding agency policies occurring across the spectrum of computational scientific research. To ultimately succeed, however, reproducibility must be embraced at the cultural level within the computational science community. Envisioning and developing tools and policies that encourage and facilitate code and data release among individuals is a crucial step in that direction.

"Reproducible Research," Computing in Science and Engineering, vol. 12, no. 5, pp. 8-13, Sep./Oct. 2010, doi:10.1109/MCSE.2010.113

Categories

More like this

GrrlScientist Note: Tomorrow is PZ's birthday so I thought I would share this paper with him and all of you, just as a reminder of the time when he ranted about his family cat's bad behavior. I think Midnight's bad manners are the result of PZ's beard. Don't believe me? Here's proof! Feline…
Finally, the Canadian government's Tri-Agency funding councils (SSHRC, NSERC, CIHR) have released the consolidated final version of it's open access policy. The draft version came out some time ago. The consultation process garnered quite a few responses, which the Tri-Agencies were kind enough to…
You can always tell it's Nobel season -- because that's when the Ig Nobel prizes are announced! The 2010 laureates have been announced. Here are some "highlights:" ENGINEERING PRIZE: Karina Acevedo-Whitehouse and Agnes Rocha-Gosselin of the Zoological Society of London, UK, and Diane Gendron of…
Over the past three years (and indeed, for 10 of the past 14 years) California has experienced a particularly deep drought. How bad is the drought? Is it the worst in the instrumental record? The worst in over a century? The worst in 1200 years? The worst “ever”? And why has it been so bad? There…

But... but... but... I thought all the fun of the computational sciences was spending months trying to translate a set of abstract formula and a poorly described algorithm into something that may or may not reproduce the figures in the paper!!!

I used to think that reproducibility is the necessity for any non-theoretic work to get published. But apparently this is far from being the common consensus in the research community. I can only predict that as time goes by, reproducible research will have a longer life expectation and everything will just follow the great law of evolution. Reproducibility will become a key attribute of not only genes but also memes - maybe it will take years or even decades for humans to recognize this. We will be there eventually!

Ãngören ve araçları ve kod ve veri kolaylaÅtırmak ve teÅvik politikaları geliÅtirilmesi, bireyler arasında bu yönde önemli bir adım sürümüdür.