ResearchBlogging.orgHere’s a question for you: is there, or should there be, any difference between studies of “alternative” and non-alternative medicine? I’ve argued before that there is no such thing as alternative medicine. So why do we need a separate agency to study “alternative” medicine? The National Center for Complementary and Alternative Medicine seems to be just such an agency. For example, the latest study of Gingko biloba for the prevention of dementia could have been funded by other agencies, such as NIMH. Why NCCAM?


First a glance at the study in question. In the introduction, the authors make their case for doing the study in the first place. They write of some in vitro studies of Gingko that show a possible justification, and mention the popularity of the substance. They also quote a number of studies that have looked at Gingko in people who already have dementia, the results of which were not good.

I have a bit of trouble with this. They admit that there is no real evidence that Gingko does anything. Scientifically, there isn’t very good justification to study the issue. But economically, there may be. If it is true that (in their confusing phrase), “In the United States, worldwide sales of G biloba exceed $249 million annually,” then it may be worth doing a study simply to debunk the myth that Gingko is anything other than a scam. The study was what I would characterize as an unqualified success. Gingko showed no efficacy in preventing Alzheimer’s-type dementia.

This seems to be a pattern at NCCAM, which on the outside seems to promote CAM, but ends up acting as a de facto “debunking” agency.

A quick glance at NCCAM’s front page:

    “Ginkgo Evaluation of Memory (GEM) Study Fails To Show Benefit in Preventing Dementia in the Elderly”
    “CAM and Hepatitis C: A Focus on Herbal Supplements ‘No CAM treatment has yet been proven effective for treating hepatitis C or its complications.'”
    Selenium and Vitamin E in Prostate Cancer Prevention Study, ‘selenium and vitamin E supplements, taken either alone or together, did not prevent prostate cancer.'”

Get the picture? It turns out that when you fund a government agency to look at the benefits of snake oil, the stuff is still snake oil.

i-55807ed94dc4a25adc79aa769160453a-551px-Gingko2_phixr.jpgNow, I’ve always thought negative studies were useful; they show the success of the scientific method, and it is too easy for publication bias to make them invisible. But it seems like we have a whole agency devoted to the investigation of improbable medical claims—and all the studies are negative.

NCCAM would seem to be a “Tooth Fairy” agency—to quote Dr. Harriet Hall:

You could measure how much money the Tooth Fairy leaves under the pillow, whether she leaves more cash for the first or last tooth, whether the payoff is greater if you leave the tooth in a plastic baggie versus wrapped in Kleenex. You can get all kinds of good data that is reproducible and statistically significant. Yes, you have learned something. But you haven’t learned what you think you’ve learned, because you haven’t bothered to establish whether the Tooth Fairy really exists.

Here’s NCCAM’s stated mission:

    Explore complementary and alternative healing practices in the context of rigorous science.
    Train complementary and alternative medicine researchers.
    Disseminate authoritative information to the public and professionals.

Number one seems fine, but why a separate agency? Number two seems non-sensical—why would researchers need specific training in CAM? Number three is admirable.

How are they doing? If their headlines are any indication, they’ve figured out what we already knew—the tooth fairy may not exist, but you can still design a study to find her favorite color.

References

Steven T. DeKosky, MD; Jeff D. Williamson, MD, MHS; Annette L. Fitzpatrick, PhD; Richard A. Kronmal, PhD; Diane G. Ives, MPH; Judith A. Saxton, MD; Oscar L. Lopez, MD; Gregory Burke, MD; Michelle C. Carlson, PhD; Linda P. Fried, MD, MPH; Lewis H. Kuller (2008). Ginkgo biloba for Prevention of Dementia The Journal of the American Medical Association, 300 (19), 2253-2262

Comments

  1. #1 Cabalamat
    November 21, 2008

    there is no such thing as alternative medicine

    Sure there is, it’s an alternative to medicine.

  2. #2 daijiyobu
    November 21, 2008

    The less compelling / plausible supplementation becomes in terms of treating pathology & prophylaxis, whether it be vitamins or herbs or such whatnot, then a very important ‘foot in the door’ for alternative medicine is weakened.

    And that’s to me good news.

    -r.c.

  3. #3 Pierce R. Butler
    November 21, 2008

    … a whole agency devoted to the investigation of improbable medical claims—and all the studies are negative.

    And you consider this a bad thing?

    We need a Cabinet-level Department of Debunking!

  4. #4 minimalist
    November 21, 2008

    Yeah, I’ve said it before and I’ll say it again: for an agency that shouldn’t exist, and only exists thanks to the whim of an influential but crankish Senator, NCCAM is actually doing pretty well, all things considered.

    At least NCCAM is holding to some standard of scientific rigor, and hasn’t fallen prey to the sort of meddling that other science-related agencies have suffered under the current administration.

    On the other hand, I’m frankly surprised to see much of any sort of research coming out of NCCAM. Every time I pass one of their labs, it’s desolate, clean and well-organized: not a single pipetman out of place. Which, of course, is a sure sign to any practicing scientist that nobody’s doing a damn thing in there.

    Also, every year the NIH research festival invites everyone, from every institute, to present their work and compete for awards to travel to international conferences. Number of abstracts from NCCAM this year: zero.

  5. #5 Ropty
    November 21, 2008

    For what it is worth, I think the Tooth Fairy does indeed exist.

    Look at the evidence: When I was a child, I left my teeth under my pillow, and the next morning there was money. The same for my brother. I spoken to my wife and many others who have had the same experience.

    Further, I can guarantee that when my kids leave a tooth under the pillow, they will wake to find the tooth gone, replaced with money (maybe a nice shiny gold dollar).

    The tooth fairy exists.

    The question is, what is the nature of the tooth fairy. And I think everyone here (or at least above the age of, what, 3?) knows the nature of the tooth fairy. And how the tooth get turned to money.

    The metaphor can be applied to CAM as you see fit.

  6. #6 The Blind Watchmaker
    November 21, 2008

    I’m encouraged that they published a negative study instead of burying or rationalizing it.

  7. #7 Joe
    November 22, 2008

    minimalist | November 21, 2008 9:11 PM wrote “… for an agency that shouldn’t exist, and only exists thanks to the whim of an influential but crankish Senator, NCCAM is actually doing pretty well, all things considered.”

    I enjoyed your post, your comment about pipette-people stored in-place brought me back many years, I know the feeling. While I can agree that NCCAM researchers are doing well by publishing negative results, I cannot agree that the Center is doing a good job. As I recall, they spent $30M on a study of chelation for heart disease, currently suspended http://www.sciencebasedmedicine.org/?p=217 that goes against clinical experience and theory. Before mounting a full-on study, they should have done a pilot-study.

    They also gave Nicholas Gonzalez millions to pursue a project that was, initially, rejected by their “scientific” advisers http://www.sciencebasedmedicine.org/?p=104 How bad does a proposal have to be in order to be rejected by NCCAM? In addition to the crankish Senator (Tom Harken, D, IA), there is Rep. Dan “The Loose Cannon” Burton (R, IN) who leaned on the head of NCCAM to give Gonzo his millions.

    No, I cannot cut NCCAM any slack, it should be eliminated http://www.quackwatch.org/01QuackeryRelatedTopics/nccam.html

The site is currently under maintenance and will be back shortly. New comments have been disabled during this time, please check back soon.