Yawn, still one more overhyped acupuncture study: Does acupuncture help infertile women conceive?

Oops, they did it again.

You think the media would learn after the last time, but no....

There it was on Friday greeting me on the ABC News website: "Study: Acupuncture May Boost Pregnancy" in bold blue letters, with the title of the webpage being "Needles Help You Become Pregnant." Wow, what a claim! Naturally, I had to know more. Fortunately (or unfortunately, depending on your point of view) The story began:

It sounds far-fetched sticking needles in women to help them become pregnant but a scientific review suggests that acupuncture might improve the odds of conceiving if done right before or after embryos are placed in the womb.

The surprising finding is far from proven, and there are only theories for how and why acupuncture might work. However, some fertility specialists say they are hopeful that this relatively inexpensive and simple treatment might ultimately prove to be a useful add-on to traditional methods.

It wasn't long before multiple media outlets, blogs, and websites were trumpeting the message that a real, honest-to-goodness scientific study has shown that acupuncture really can help infertile couples conceive. This was big, and nary a skeptical word seemed to be found. Knowing all too well just how far parents will go to conceive, I had to know: Did this study actually say what the media says it said? What was so new and radical about it that it rated so much promotion on a Friday?? Should I start to rethink my extreme skepticism about whether acupuncture is anything more than a placebo, given the poor quality evidence generally used to support its supposed efficacy in all sorts of pathphysiologically related unrelated conditions and the lack of even a glimmer of a convincing physiologic mechanism to explain its supposed activities?

Here's what ABC said about it:

The analysis was led by Eric Manheimer, a researcher at the University of Maryland School of Medicine, and paid for by a federal agency, the National Center for Complementary and Alternative Medicine. Results were published Friday in the British medical journal, BMJ.

Acupuncture involves placing very thin needles at specific points on the body to try to control pain and reduce stress. In fertility treatment, it is thought to increase blood flow to the uterus, relax the cervix and inhibit "fight or flight" stress hormones that can make it tougher for an embryo to implant, Manheimer said.

The analysis pools results from seven studies on 1,366 women in the United States, Germany, Australia and Denmark who are having in vitro fertilization, or IVF. It involves mixing sperm and eggs in a lab dish to create embryos that are placed in the womb.

Right away, I knew that the study is not an original study at all. Instead, it's a meta-analysis of existing studies. Dr. Kimball Atwood IV has made a strong case that evidence-based medicine (EBM) was never designed to deal with so-called complementary and alternative medicine (CAM) because EBM< does not take into account scientific prior probability. Consequently, it may never have occurred to the originators of the concept of the "hierarchy of evidence" that basic science evidence should rate higher than level 5, one of the lower levels. Sadly, this meta-analysis seems almsot custom-made to illustrate his point. Before I examine the study itself, I'll tell you what I mean.

Consider the use of acupuncture in the situation of infertility. Why would anyone think that it would do anything at all to aid acupuncture? Let's see what the study authors themselves say:

Acupuncture has been used in China for centuries to regulate the female reproductive system. Three potential mechanisms for its effects on fertility have been postulated. Firstly, acupuncture may mediate the release of neurotransmitters, which may in turn stimulate secretion of gonadotrophin releasing hormone, thereby influencing the menstrual cycle, ovulation, and fertility. Secondly, acupuncture may stimulate blood flow to the uterus by inhibiting uterine central sympathetic nerve activity. Thirdly, acupuncture may stimulate the production of endogenous opioids, which may inhibit the central nervous system outflow and the biological stress response.

I really hate it when people claiming to be scientists appeal ancient knowledge in this manner. It's a particularly annoying fallacy. Yes, it might mean that there's something to acupuncture, but it's even more likely to be meaningless. After all, bloodletting and purging with toxic metals were also used for centuries as remedies; that does not mean that they actually did anything therapeutic. The rest is mostly speculation. For instance, the reference supporting the claim that acupuncture may stimulate bloodflow to the uterus was not looking at acupuncture but electroacupuncture, which is most definitely not acupuncture. They didn't have electricity (at least as far as we know) in ancient China. Including electricity, particularly in acupuncture studies looking at pain relief, merely mimics transcutaneous electrical stimulation (TENS), which is not an "alternative" therapy at all, but an accepted "conventional" therapy supported by EBM. Moreover the reference was a small study (ten women). Worse, it was not randomized and had no control group. Even so, given that electric current was passed through the lumbosacral area, it may well have stimulated nerves leading to the uterus. In other words, this study does not show that acupuncture itself does anything to uterine blood flow. If its results are correct, it shows that passing an electric current through L4-S3 levels may stimulate uterine blood flow. (Indeed, it states in the paper itself that acupuncture points were chosen for innervation of the uterus.) Moreover, the reference used to justify the claim that endogenous opiods may be the mechanism behind an acupuncture effect is not even an acupuncture study. The bottom line, is that no plausible physiologic mechanism has been shown or proposed. As we now know, when clinical studies are done about a hypothesis with a very low prior plausibility, noise predominates, producing a disturbingly high proportion of seemingly "positive" studies.

Doing a meta-analysis of such studies can be a a spectacular method of amplifying that noise. So what about the meta-analysis itself? Does it deserve a dose of Respectful Insolence� I thinkl you know the answer to that one.

Perhaps the most unusual thing about studies of acupuncture for IVF is that, unlike most conditions for which acupuncture is claimed to work, the outcomes are not subjective. They are not shades of gray, but yes-no outcomes. These include pregnancy, continued pregnancy (more than 12 weeks), and live births. Not present are the usual sorts of subjective measures of pain or other measures that make the placebo effect such a concern in most acupunctures studies. That at least makes data comparison between studies easier. Basically, the authors scanned multiple databases for articles, including Medline, Embase, Cochrane Central, and the Chinese Biomedical Database. They also searched the proceedings of three major annual conferences on assisted reproduction for abstracts. Selection criteria were fairly stringent. A total of 108 initial studies were identified and then ultimately whittled down to only 7, with a total of 1,366 patients. Because the authors were looking at acupuncture as an adjuvant to embryo transfer, only trials in which acupuncture was administered within one day of the procedure. Outcomes on clinical pregnancy, ongoing pregnancy, or live birth had to be extractable. Unfortunately, no data regarding a number of factors that affect the chance of successful IVF were included, such as age, duration of infertility, number of previous attempts at IVF). So what did the authors find? Overall, three studies reported a benefit, three reported a statistically not significant trend towards a benefit, and one showed no benefit. In essence, the authors determined that, according to these studies, women undergoing acupuncture before IVF had a "relative risk" of pregnancy of 1.65 (95% confidence interval 1.24 to 2.14) compared to those who did not, 1.87 (95% confidence interval 1.40 to 2.49), and 1.91 (95% confidence interval 1.39 to 2.64).

Looking at the actual seven studies themselves, I can't help but note that three of them were not blinded. In other words, no sham acupuncture was administered to the control group. The authors twist themselves into pretzels in the discussion, going through multiple contortions and excuses to justify including studies that were not blinded, much less double-blinded on the basis that the placebo effect is much less likely to affect objective outcomes. I do not accept this as a valid argument for two reasons. First, if nervousness during implantation of the embryo has any role in inhibiting successful implantation, a woman who believes she is getting an effective adjuvant may be more relaxed during the procedure and thus more likely to conceive. Indeed, there is some suggestive evidence, albeit weak, that acupuncture may indeed produce relaxation, and there's even an anecdote from the ABC News article:

Dr. Ann Trevino, a 37-year-old family physician who recently moved to Houston, is pregnant, and a believer. She had three unsuccessful pregnancy attempts with intrauterine insemination before trying acupuncture with IVF at a fertility clinic in San Antonio where she used to live.

"I had been reading about acupuncture, probably like every other patient on the Internet. I was just willing to do anything possible to improve our chances," she said. With acupuncture, "I just felt very warm and relaxed" when the embryos were placed.

As an aside, there is one thing really annoying about this anecdote that makes me fear for the critical thinking skills among my fellow physicians, and that's the fact that Dr. Trevino is comparing apples and oranges, namely intrauterine insemination (which is basically the same thing as artificial insemination) with IVF. If she has something wrong that makes conception via sperm and egg meeting in the Fallopian tube impossible or very unlikely, then of course IVF would be more likely to work. In either case, the two are different procedures, and often the reason fertility specialists proceed to IVF is because artificial insemination has been tried multiple times and has failed. Be that as it may, if it is true that either relaxation promotes implantation or nervousness inhibits it, then anything that results in relaxation during embryo placement would result in higher fertility rates. No needles would be required, just an effective strategy to induce relaxation in the woman before she undergoes embryo transfer.

What's worse about the inclusion of studies that were not double-blinded, however, is that in such studies not only does the patient know whether she got acupuncture or not but the OB/GYN implanting the embryos also knows. He or she knows who is and is not getting acupuncture beforehand. There's no way of knowing whether such knowledge might affect how the procedure is done or the decision regarding the numbers of embryos to be implanted in each woman. The authors try unsuccessfully to sidestep this crucially important issue thusly:

Blinding of physicians performing the embryo transfer is another potential source of bias (performance bias), and three of the seven included trials did not blind the physicians.w1 w6 w7 Considering the cost of embryo transfer and the importance of successful transfers to maintaining high pregnancy rates at clinics, we think that physicians would be motivated primarily to perform a successful procedure for all patients, rather than to show that acupuncture, a non-proprietary treatment, is an effective adjuvant procedure. In subfertility trials in general, where outcomes are entirely objective, blinding of either patients or physicians is "infrequently attempted,"17 and such blinding components are not always considered as critical elements related to the evaluation of risk of bias.35

It is correct that reference 17 states that blinding is infrequently attempted. However, this is also what was said in the very same article the authors cite as evidence that blinding of the health care team is not that important:

Blinding is important because trial personnel are naturally susceptible to hunches about the effectiveness of one or both trial treatments and only if they are blinded can anyone be confident that decisions and assessments are not affected by such intuitive influences. Double-blinding in assisted reproductive technology trials is infrequently attempted, and most gonadotrophin trials are either not blinded, or the outcome assessors are blinded to allocation as a reasonable compromise. It is logical to assume that double-blinding would bring about an increased confidence in clinical trial results and in theory this is simply a matter of making equivalent preparations for each drug. However, in reality the investigational drug would need to have indistinguishable primary packaging material compared to the approved comparator. This is very difficult to arrange and most likely would require new qualification studies. True double-blinding would be optimal, but in practice it remains very difficult.

Funny, but in oncology somehow we manage to produce placebos that have packaging indistinguishable from that of the drug being studied. True, it's not always easy to accomplish, but still we manage it pretty well. I wonder why this is so much more of a problem in studies of IVF. In any case, this reference does not support the contention that blinding of the treatment team to experimental group is not important in IVF> Moreover, reference 35, although its title states that it's about design and statistics, in reality seems to be mainly about statistics and reporting rather than overall trial design. It, too, mentioned double-blinding, but under the term "concealment of allocation":

Concealment of allocation has received increased attention since an empirical study by Schulz et al. (1995) found it to be one of the quality criteria for randomized trials most strongly associated with bias. Their study of 250 trials in the field of pregnancy and childbirth found 32% to be adequately concealed and 18% stating a specific method of randomization. Our figures of 34 and 64% respectively suggest an improvement in reporting of randomization over recent years, but demonstrate that there is still a widespread lack of appreciation of the importance of reporting allocation concealment.

You guessed it. This reference does not support the authors' claim that double blinding is unimportant in IVF trials either. In fact, what it does suggest is that far too many studies of IVF, not just those looking at IVF and acupuncture, are poorly designed and/or poorly reported. Remember, when it comes to double blinding it is not an issue of whether or not the physicians are sufficiently motivated to want to do their best for their infertile patients. It's about unconscious changes in procedure or clinical decision-making that can result from a failure to be blinded to the intervention.

One of the most telling conclusions of the study comes from the subgroup analyses. The authors found that out of nine predefined subgroups examined, only one grouping mattered. When the analysis was restricted to three studies in which a higher rate of pregnancy was noted in the control group than the other studies, the "effect" of acupuncture virtually evaporated, and the relative risk fell to 1.24 (95% confidence range 0.86 to 1.77). This could suggest one of at least two things: either the "effect" (if effect there is) is greater in groups with lower success rates, or it could mean that noise and/or standardization in these groups is greater or more prone to bias.

Finally, we haven't even considered the issue of publication bias, which was recently discussed in the context of trials of antidepressant drugs. One of the biggest problems in both conventional medicine, and probably even more so in "CAM," is that positive studies that show a result are more likely to be published. They're more interesting, and investigators (not to mention reviewers) are more excited about them. Negative studies are less likely to be submitted for publication or published. Moreover, if published, they tend to show up in lesser journals than they might otherwise have if positive. The authors of the study under discussion even admit this as a possibility, although they try very hard poo-poo it away.

I suppose it is possible that acupunture might increase IVF success rates, although there is no physiologically plausible reason for it to do so other than possibly the ability of acupuncturists to soothe and relax their patients prior to and during the procedure. Given its shortcomings, this study does not provide particularly compelling evidence to support the use of acupuncture as an adjunct to embryo transfer during IVF to increase success rates. Certainly, it does not provide evidence worthy of the hype that it received shortly after its release. A combination of failure to blind in most of the studies included coupled with the likelihood of publication bias serve to cast extreme doubt on the conclusion of this study.

Another disturbing aspect of this study is that it also shows the peril of applying meta-analysis to CAM modalities. Here we have researchers going to huge effort to apply the scientific method and rigorous statistical analysis to a hypothesis for which there is no plausible mechanism, which is based on a concept that has never been detected or measured (meridians through which life force, or qi, flows), and studies that are most likely dominated by noise and false positives of the type Dr. John Ioannidis warned us about. In other words, trying to do a meta-analysis on woo is most definitely a long run for a really short slide.

Categories

More like this

One of the problems with denialists is that they simply can't accept that science doesn't conform to their ideology. For instance, it's not enough to just be morally opposed to abortion, the anti-choice organizations have to misrepresent risks of the procedure, including promoting the false link…
There are 35 new articles in PLoS ONE today. As always, you should rate the articles, post notes and comments and send trackbacks when you blog about the papers. You can now also easily place articles on various social services (CiteULike, Mendeley, Connotea, Stumbleupon, Facebook and Digg) with…
There are 7 new articles in PLoS ONE today. As always, you should rate the articles, post notes and comments and send trackbacks when you blog about the papers. Here are my own picks for the week - you go and look for your own favourites: Bioactive Endophytes Warrant Intensified Exploration and…
There are new articles published tonight in PLoS Biology, PLoS Medicine, PLoS ONE and PLoS Neglected Tropical Diseases - here are my picks: A Social Amoeba Discriminates in Favor of Kin: Though seemingly simple life forms, microorganisms can display surprisingly complex behaviors, such as altruism…

An excellent deconstruction as always, Orac -- detailed, illuminating, and professional. There's a time for being simply snarky (and the woomeisters furnish plenty of them), but there is also a time for the hard work of line-by-line critical analysis, and you do it better than any other blogger I read.

I would like to point out what appears to be a minor incident of "misspeaking" on your part, however:

Consider the use of acupuncture in the situation of infertility. Why would anyone think that it would do anything at all to aid acupuncture?

I gather that you meant to say "pregnancy" or "fertility" rather than "acupuncture" in that last sentence.

Otherwise, as I said, this is a model post. Nice work!

~David D.G.

By David D.G. (not verified) on 12 Feb 2008 #permalink

Sure, a model post on how to be informative whilst being snarky and demeaning.

I visited to find out about the study, which is interesting, but had to filter out all of Orac's usual crap to get to the information. Say what you want, but Orac is far from 'professional'. That's he's right about this is beside the point.

By curlyfries (not verified) on 12 Feb 2008 #permalink

curlyfries:

I think you must be reading an entirely different article from the one I see here. This particular post is probably the straightest one of Orac's that I've ever seen dealing with woo-woo; there's not really any serious snarkiness or demeaning language in the whole thing that I can see. He registers disagreement and disapproval, and he explains why, but I saw neither snarkiness nor a demeaning tone in the whole thing -- on the contrary, I thought he showed admirable restraint, with only a touch of a reprimand for the general news media. His criticisms with regard to the meta-analysis are well taken, and he is very matter-of-fact in raising them, with no insults added. Just because he may have deflated a cherished belief of yours with facts and logic is no reason to read derision into the manner of his doing so.

~David D.G.

By David D.G. (not verified) on 12 Feb 2008 #permalink

I was also disgusted at how easy journalists throw out big articles and I also wrote about it when I saw a Metro article and then I saw a Guardian article as well! But I didn't publish it today because I decided that a small post on Darwin's Birthday was more suitable for the day.

I have to be faster next time :-) For now I will just link back to yours. Of course I could never elaborate as you Orac! I am merely a computer scientist not a medical expert.

You clearly didn't read my message carefully enough, David: Orac is quite right about the meta-analysis - that's not my point. He didn't touch any of my cherished beliefs - I have few, but I appreciate your concern.

Your use of the term 'woo-woo' loses you any concern I might have had for your opinion, and I can frankly see why you don't think that Orac's article had a demeaning tone.

I should say that this was better than most of his posts - I picked a poor target. This one just happened to be the place where I chose to register my annoyance.

By curlyfries (not verified) on 12 Feb 2008 #permalink

Doggerel #44.
I quote:
"Often, skeptics are accused of being rude by woos (if you'll forgive some of the inherent rudeness of that term), and it's not uncommon for the woos to be right about that. We can be very harsh in our tone, and I think it's understandable: We often have to deal with people who won't address fundamental questions. We often have to reply to cookie-cutter responses that don't address the issue. We have to spend time pointing out logical fallacies that are commonly presented in all caps. We're often aware of the various problems that arise from the lack of critical thinking. It can really wear you down at times.
Woos are often rude and don't seem to be aware of it. They commonly throw out insinuations of sinister motives, attempts to claim inherent moral high ground, straw men, etcetera.
And all of that is irrelevant. Sometimes a forum thread needs a call for everyone to cool down, but pointing out the rudeness of others seldom does anything to contribute to the argument. In fact, it often serves as a red herring to distract people from the argument, rather than promote it. If someone's claiming to levitate, I'd rather argue about the validity of test protocols than the rudeness of a word like "woo.""

By Laser Potato (not verified) on 12 Feb 2008 #permalink

Strange that you'd mention bloodletting and purging with toxic metals as other examples of "useless" therapies. Bloodletting is entirely appropriate in hemochromatosis, and in cases of severe infection (though in this case the use of leeches is superior to just quills). Much chemotherapy can be considered analogous to purging with toxic metals, and mercury was a treatment for syphilis until quite recently (on a historical scale).

In traditional accupuncture the doctor twists the needles back and forth. Electroacupuncture is used to recreate that effect. Yes, it might be the same as using a TENS unit, but so might be twisting the needles...

I can't speak to experimental design in the cited studies (I would have to see the entire paper). From personal experience, acupuncture is very good at addressing inflammation issues, and does produce endorphins. Depending on what the basis of the infertility is, this might be enough.

Ringo
Is your personal experience from a properly designed experiment or from letting someone poke you with needles.
If it is the second case, would this not be classed as an anecdote? Are anecdotes evidence of effective treatments?

Your use of the term 'woo-woo' loses you any concern I might have had for your opinion, and I can frankly see why you don't think that Orac's article had a demeaning tone.

Concern troll.

Your use of the term 'woo-woo' loses you any concern I might have had for your opinion, and I can frankly see why you don't think that Orac's article had a demeaning tone.

Oh, well, if you want "demeaning" can I just cut to the chase and mention that you sound like one of those fucking mushbrains who hasn't got a single argument against the content of what Orac is saying, and had to resort to bitch-snivelling about the details of how he said it?

Now you can go feel sorry for yourself.

@Ringo: You've got a minor point in mentioning the usefulness of bloodletting in hemochromatosis, but I think Orac's overall categorization of bloodletting and purging with toxic metals as "useless" is otherwise accurate. I'm not sure where you heard that bloodletting was useful for treating certain kinds of infection, but I cannot easily conceive of a situation where it would. The point is that these therapies are useless in a modern context.

According to several anecdotes conception is sometimes preceded by a doctor saying "you may feel a small prick".

Sorry

By Chris Noble (not verified) on 12 Feb 2008 #permalink

In traditional accupuncture the doctor twists the needles back and forth. Electroacupuncture is used to recreate that effect. Yes, it might be the same as using a TENS unit, but so might be twisting the needles...

Uh, it's been a while since I took physics, but I don't remember twisting needles in flesh ever generating electricity. Furthermore, it is an easily testable theory, and being so easily testable (and energy flow being so central chinese medicine -- I mean Jesus, these people claim to be able to generate electricty (Big Trouble in Little China-style)) I would assume it would have been tested, and if it were true, I would have heard a lot about it. Instead, I have heard nothing about it.

Let's see, an easily testable, yet implausible theory, central to a million-dollar industry... why wouldn't I have heard about that yet? Hm. Must be the man keeping us down.

Marcus - "bitch snivelling" is a beautiful phrase. I'm adding it to my lexicon, right next to, "that made me want to punch infants."

Excellent work once again, Orac.

I've already cut back from saying "woo-woo" to just plan "woo".

More succinct and respectful, plus it apparently still stimulates the same meridians.

Yours in allopathy,

DB

By Dangerous Bacon (not verified) on 13 Feb 2008 #permalink

Uh, it's been a while since I took physics, but I don't remember twisting needles in flesh ever generating electricity. Furthermore, it is an easily testable theory, and being so easily testable (and energy flow being so central chinese medicine -- I mean Jesus, these people claim to be able to generate electricty (Big Trouble in Little China-style)) I would assume it would have been tested, and if it were true, I would have heard a lot about it. Instead, I have heard nothing about it.

You've utterly missed the point here. Twisting needles stimulates the meridian. Electricity also stimulates the meridian. B is emulating A, not the other way around. As for reading about it, do you read Chinese?

As for the anecdote, consider it a within-subject experiment. Acupuncture worked better to address my issue than prescribed anti-inflammatories. Sorry, I'm not willing to recreate the injury on the other side so I can try acupuncture first and then steroids.

What is considered relevant evidence in mainstream Western science isn't the same as what is considered evidence in alternative treatments. If a Western treatment elicits a 1% difference, 100% of the time, it's considered publishable. Alternative and Eastern practices care more about the treatment that creates a 50% difference, 10% of the time. As such, you are more likely to find anecdotal evidence than published papers. This may not pass peer review, but which is more important to an actual patient?

Here's a lovely article about leeches, etc.: http://www.medscape.com/viewarticle/563656 (login required).

Ringo
What is important to the patient is what works.
If you can sell the patient a load of nonsence and it works this is generally refered to as a placebo effect.
As long as we are just making up numbers here, placebos create a difference of 46% in 32% of the anecdotes.

You've utterly missed the point here. Twisting needles stimulates the meridian. Electricity also stimulates the meridian.

Someone certainly is missing the point, and it's not inkadu. Electricity stimulates nerves. The mechanism for this is known, and the existence of nerves is not in dispute. Where is the evidence that "meridians" even exist, let alone can be stimulated by twisting and/or electricity?

What is considered relevant evidence in mainstream Western science isn't the same as what is considered evidence in alternative treatments. Alternative and Eastern practices care more about the treatment that creates a 50% difference, 10% of the time.

What is this "Western science" of which you speak? Last I checked, Japan, China, and the rest of the modern world uses the same science we do. And you're flat-out making up your numbers -- where I come from, we call that "bullshitting", and people who base arguments on it are not taken seriously.

Maybe acupuncture is like Sex Panther. 60% of the time, it works every time.

Ad hominem attacks aside, there are sufficient double-blind, well designed, studies to support the value of acupuncture, some even published in English. When needles in the wrong place don't have the same effect, you can't claim placebo effect, sorry.

Here:
http://users.med.auth.gr/~karanik/english/articles/lowback.html
http://www.ncbi.nlm.nih.gov/pubmed/15520102
http://www.heilpflanzen-welt.de/science/1983/6320400.htm

A bigger issue here is scientific arrogance. AT BEST you can claim to be treatment agnostic, not knowing if it works or not. Failure to disprove the null hypothesis is just that - failure to disprove the null hypothesis. That's not the same thing as *proving* non-effect.

A bigger issue here is scientific arrogance. AT BEST you can claim to be treatment agnostic, not knowing if it works or not. Failure to disprove the null hypothesis is just that - failure to disprove the null hypothesis. That's not the same thing as *proving* non-effect.

Spare me the "arrogance" crap. It's not "arrogance" to point out the flaws in the scientific data that is routinely marshaled in support of acupuncture. Moreover, you're attacking an obvious straw man. Did I say that "non-effect" was proven? No. What I said was that this meta-analysis was not good evidence in support of the efficacy of acupuncture to help IVF patients conceive. That's not the same thing as claiming it shows non-effect.

As for your claim that there are sufficient well-designed studies to support the value of acupuncture, that's dubious in the extreme. Steve Novella has discussed this in detail.

I read Novella's piece up to "Acupuncture is based upon the ancient and superstitious pre-scientific notion that there are lines of mysterious life energy (chi) flowing through our bodies, and that the flow of this energy is responsible for health and illness," at which point my confidence in his objectivity was substantially compromised.

By all means, point out the flaws in individual studies and surveys. Even in surveys of the literature. Glad you acknowledge that this isn't the same as rejecting the issue out of hand.

WRT to meridians, consider this analogy - neurology and psychology students study something called a "sensory homonculus" (or at least they did when I was a student) that supposedly exists in conjunction with the human brain. If you open up a human skull you wont see one, or anything resembling one. So why do professors persist in referring to this mythological entity? Because it's a convenient cognitive shorthand for a much more complex set of events.

Ringo - "Twisting needles stimulates the meridian."

The meridians do not exist - Studies using sham acupuncture where the needles are stuck in randomly indicate no difference between such sham acupuncture and placing needles on the meridians.

Studies using sham acupuncture with retracting needles also show no difference from "real acupuncture".

Everything points to a strong placebo effect - all that is important is the ritual.

By Freddy the Pig (not verified) on 14 Feb 2008 #permalink

Pig - please read my previous responses. See "loop, infinite"

Pig - please read my previous responses. See "loop, infinite"

Your previous responses answer none of our objections. You are making a positive claim: meridians (whatever those are) exist, and perform certain functions. Since you are making a positive claim, the burden of proof falls on you. Neither you (nor anyone else that I am aware of) has provided evidence for this claim -- suppositions, appeal to old texts, and personal anecdotes are not evidence.

Your "analogy" claim also fails. Science does use analogies, as they help provide an intuitive grasp on complex systems. At the same time, it's made clear exactly what the underlying complex system is. What is "meridian" supposed to be an analogy for? What does it mean to "stimulate" a meridian, if you remove the analogy?

Davis - I provided links to several studies. Not to a meta-analysis that may or may not be flawed. To several individual studies. I also know people who have personally performed such studies, but of course if I recount their findings it will be considered an anecdote.

From your previous response it seemed that you thought a "meridian" was some sort of physical entity, and that your inability to see or touch it was proof of its non-existence. (Sort of like a primitive tribesman not believing in the equator). Was that not the case?

Davis - I provided links to several studies.

None of which have anything to do with your claims regarding meridians.

From your previous response it seemed that you thought a "meridian" was some sort of physical entity, and that your inability to see or touch it was proof of its non-existence.

No, because you have as yet failed to provide any explanation as to what the heck a meridian is. If I give a definition of the equator, it's clear that I can talk about it meaningfully, since that definition is something we can all understand. If you are claiming meridian means something, you need to say what it means. Your talk of meridians being stimulated is just gobbledygook without a definition.

What we have here is a language problem. If I say that a meridian is a line of most-effective stimulation points, you'll deny there is any effective stimulation at all. If I use the Chinese terminology (badly translated) and say they're the chi circulation lines, you'll say there's no circulation system for "chi" known to medicine.

How would you explain the equator to someone who has never studied geography, and never seen a globe?

How would you explain the equator to someone who has never studied geography, and never seen a globe?

I'd show them a globe.

If I say that a meridian is a line of most-effective stimulation points, you'll deny there is any effective stimulation at all.

No, I'll ask you to show evidence (a) that there is effective stimulation, (b) that there are points that are more effective than others, and (c) for other claims you've made (such as your claim that twisting needles has some effect, and that electricity has the same effect). Even if I'm willing to grant you (a), you're nowhere near (b), let alone (c).

Great. Why don't you grant me that there is effective stimulation.

Now, can you agree that practitioners of this particular form of voodoo would seek to maximize this stimulation? If so, can you agree that they would do so by a process of trial and error, and that needle placement would be one of their variables?

If there *is* optimal placement to maximize stimulation, would you consider it sufficient evidence if more than one practitioner came up with the same optimal placement, in a situation where they were working in isolation from each other?

Ringo you are making an assumption that the points were determined by trial and error experimentation. In fact there is no gaurantee that such expermeintation in a pre-shcientific culture would produce meaningful results. It would be heavily affected by confirmation basis.

Inf fact, studies using sham acupuncture in the placebo arm have shown that it does not matter where they put the needles. This indicates that the meridians are imaginary and arbitrary.

By Freddy the Pig (not verified) on 15 Feb 2008 #permalink

If so, can you agree that they would do so by a process of trial and error, and that needle placement would be one of their variables?

All you have is supposition? I'll take that as an acknowledgment that you have no evidence for your claims.

Pig - I'll restate the question: "If there *is* optimal placement to maximize stimulation, would you consider it sufficient evidence if more than one practitioner came up with the same optimal placement, in a situation where they were working in isolation from each other?"

Davis - You hand them a globe, and they admire the pretty ball. You tell them that this is the earth, and they tell you you're nuts, since the earth is underfoot. You clarify that this a a *representation* of the earth, and they tell you you're lieing, since everyone knows the earth is flat. May you never have intractable back pain.