Pharyngula

Last year, the Elsevier journal Food and Chemical Toxicology by Gilles Seralini and others that purported to show that rats fed genetically modified corn were more prone to get cancer. The cranks loved it; Mike Adams thought it was great, it was touted on the Dr Oz show (I don’t know why they were concerned; these are the people who think cancer can be cured with herbs, urine, and drinking hydrogen peroxide).

But right from the beginning, scientists were appalled — not by the conclusion, but by the incredibly shoddy protocol used by the researchers. Biofortified went through the paper, step by step; would you believe that in a study with a control group and multiple experimental groups fed on GMO corn, the authors did not use any statistical tests to tell if there was a significant difference between any of the groups?

Let that sink in.

Here’s the first figure from the paper, and Ashley Ng’s breakdown of the data.

Created with GIMP

In the study, Figure 1 shows Kaplan Meier plots the number of rat deaths by “control group” and other “treatment groups”.

What do these mean? Well, not much because the authors failed to use a statistical test to tell if there was a difference between the control groups and treatment groups.

This is important, as all their claims relate to the incidence of cancers (and other “diseases”) in the “treatment group” compared to the “control group”. These comparisons can only be made if a statistical test shows that what you observe is not happening by chance.

Still on Figure 1, we see that several “treatment groups” of male rats receiving GM NK603 corn (the 22% group and 33% group) actually had fewer cancers than the male control group.

Similarly, a treatment group of male rats receiving 33% GM corn and Roundup had no difference to the control group, and two treatment groups receiving Roundup (A and C) had the same or less incidence of cancer compared with the control group.

I just eyeball the data, and what I see is typical noisy cancer mortality data (these are rats with a genetic predisposition to get cancer: 70% of males and 87% of females get it.) The one thing that would have looked significant to me is the higher likelihood of females coming down with cancer…but that’s a predilection already built into the strain. The problem is compounded by very small ns — there were only 20 rats in each group. I wouldn’t be surprised if the researchers had done some statistical analysis, but didn’t report it because the paltry statistical power of their study meant nothing was significant.

At the time the paper came out, Carl Zimmer also raised holy hell because it was another case of science by press conference. There were all kinds of complaints by scientists about the study, but journalists who got the paper in advance had to sign confidentiality agreements that prohibited them from consulting with experts — they were expected to flounder about in the dark and simply accept what they were told.

Here’s a little good news, though: the paper is being retracted. The editor-in-chief of the journal has made a rather weasely statement denying any wrong-doing by the authors, but that the paper is being retracted solely because of the ambiguity of the results.

Unequivocally, the Editor-in-Chief found no evidence of fraud or intentional misrepresentation of the data. However, there is legitimate cause for concern regarding both the number of animals in each study group and the particular strain selected. The low number of animals had been identified as a cause for concern during the initial review process, but the peer-review decision ultimately weighed that the work still had merit despite this limitation. A more in-depth look at the raw data revealed that no definitive conclusions can be reached with this small sample size regarding the role of either NK603 or glyphosate in regards to overall mortality or tumor incidence. Given the known high incidence of tumors in the Sprague-Dawley rat, normal variability cannot be excluded as the cause of the higher mortality and incidence observed in the treated groups.

He then goes on to praise the peer-review system, which is weird, because here’s a paper with huge obvious holes that fell right through the system. And furthermore, it’s a paper with gigantic political implications — right now, it is the linchpin of anti-GMO movements around the world — and should have gotten extra-careful scrutiny.

Jon Entine at Forbes has an especially thorough dissection of the implications of the paper. It reveals that other problems have emerged.

“The study appeared to sweep aside all known benchmarks of scientific good practice and, more importantly, to ignore the minimal standards of scientific and ethical conduct in particular concerning the humane treatment of experimental animals,” concluded a prominent group of scientists in Transgenic Review. They noted the rats in the study were exposed to extreme and unnecessary cruelty. None of the results depended on the size of their tumors or how long they lived after the tumor appeared. This unethical treatment of animals was a direct violation of accepted research protocol and was by itself grounds for the article being rejected initially or withdrawn.

It was rather peculiar that the paper reported only on mortality. They were studying the appearance of cancer, so a more relevant and direct measure would have been to assess by the appearance of tumors of a particular size, and then to humanely euthanize severely affected animals. This study had them languish in a cage until they died and could be scored. There was no description of the cancers in the control group! They did seem to have a number of rats with huge, grossly disfiguring tumors that were handy for photo ops, though.

So it was a terrible, sloppy paper with gaping deficiencies that somehow slipped past peer review but made scientists gape in surprise when they finally saw it published, and it’s finally being retracted. But too late: anti-GMO propagandists are now seeing the retraction as a sign that there is a conspiracy to Hide the Truth™, and are using the efforts to apply standards of evidence to the work as proof that Big Science is out to give everyone cancer.

Comments

  1. […] stands firm as journal moves to retract GM rat studyFoodNavigator.comToronto Star -ScienceBlogs (blog)all 33 news […]

  2. […] Belated retraction of Seralini’s bad anti-GMO paper […]

  3. […] Belated retraction of Seralini’s bad anti-GMO paper (scienceblogs.com) […]

  4. #5 G
    California USA
    November 30, 2013

    Oh boy, here we go again, just call this one Wakefield II (anti-vaccination paper, retracted, but fed global vaccine paranoia to this day, with results that include outbreaks of measles and whooping cough).

    One of the worst impacts of this sort of crap is that by fueling the cranks, it also discourages or digresses any well-reasoned skepticism or criticism of (whatever) that may occur in the future.

    If it ever occurs that a new vaccine or new GMO does have a real public health problem, at that point reasonable people need to be able to raise the issue without being lumped in with cranks. False alarms impair the effectiveness of alarms in general.

  5. #6 Roger Pelizzari
    November 30, 2013

    No surprise that Monsanto was behind the journal retracting the published study.

    Journal retraction of Séralini study is illicit, unscientific, and unethical
    http://gmoseralini.org/journal-retraction-of-seralini-study-is-illicit-unscientific-and-unethical/

  6. #7 LillieSmith0
    December 1, 2013

    My Uncle Caleb got a very cool Audi S4 by working parttime from a macbook air… go to the website all29com

  7. #8 A H
    December 2, 2013

    It’s really to bad that the anti GMO movement promotes such a shoddy research, because are real reasons to be skeptical about the benefits of GMO crops like round up. Besides increasing the monopoly power of seed companies, there is evidence that they lead to high use of pesticides that have negative environmental impacts. This study suggests a link between roundup, milkweed death and Monarch Butterfly decline.

    http://onlinelibrary.wiley.com/doi/10.1111/j.1752-4598.2012.00196.x/abstract

    However these real problems with GMO crops are overshadowed by the quest of GMO protesters to prove that any GMO food is poison despite what the evidence says.

  8. […] A more in-depth review of the raw data revealed that no definitive conclusions could be drawn from the small sample size, the publisher said. In addition, the breed of rat used in the study is known to have a high incidence of tumors, to the point that natural variability could explain the higher numbers of tumors among the GMO-fed group. (As many as 70 percent of males and 87 percent of female rats get cancer naturally, according to evolutionary biologist and blogger PZ Myers.) […]

  9. #10 Loren E
    December 2, 2013

    The problem, Dr. Myers, is that you can’t unring the bell. I agree, this is crappy research that should NEVER have been published, but according to #6 Roger, now we’re picking on him…and its all a big conspriacy to silence independent research. Given this and Kevin Folta’s hammering of Don Huber, I would prepare for a whopping dollop of the Galileo Argument over the next few weeks.

  10. #11 David Marjanović
    Museum für Naturkunde, Berlin
    December 3, 2013

    No surprise that Monsanto was behind the journal retracting the published study.

    Uh. Elsevier isn’t Monsanto, you know. It has its own problems, but it’s not affiliated with Monsanto.

    Journal retraction of Séralini study is illicit, unscientific, and unethical

    Says Séralini’s own website, clearly not understanding what “scientific” and “ethical” mean. *yawn*

  11. […] | Skeptico The Seralini GMO Study – Retraction and Response to Critics | Science-Based Medicine Belated retraction of Seralini’s bad anti-GMO paper – […]

  12. #13 Sylak
    December 5, 2013

    Independent researchers? Seralini had no independence, That study was financed totally by anti-GMO group, and made by a anti-gmo crank. you really think that him or who financed him will have accept a answer like :”well you know, it seem we are wrong, the fact just demonstrate that we must humbly change our opinion. because that what scientific and rational people do” of course not those group wallet depend on them keeping their believers in the clouded vision so they continue to ship them money. if they become reasonable they will lose that money. and Seralini got a ego the size on a zeppelin, not the type of man who admit he was wrong. They probably Hid the truth. ( yes they also can conspire to hide it) the real data probably demonstrate no danger. and they also let the rats die cruelly just to make horrible front page image. The media love that. they just manipulate people with that.
    Funny those double standards, if a bad study like that would have been made by people finance by GMO maker, they will have been relentless about that. But when they do it, it still true. Double standards are lies. That,s a good new for Science, reality and rationality.