| Complementary Medicine | ||
| Although based on lies, it can work for you if you're conscious ie. it never works if you're in a coma. | ||
|
So should we stop criticising it, and accept it as effective 'placebo medicine'? |
||
| It is unscientific to pour wholesale
scorn on complementary medicine Alarmist condemnation of all alternative therapies ignores the crucial role some could play in the human healing process Madeleine Bunting The Guardian Monday March 24 2008 Suckers: How Alternative Medicine Makes Fools of Us All; Snake Oil Science; and next month sees another, Trick or Treatment: what these new books have in common is varying degrees of frustration at the seemingly inexorable rise of complementary medicine. It seems the aim of some of these authors is to finish off a burgeoning health industry that they believe is based on charlatans and quacks preying on the gullible and desperate. The books reflect the growing exasperation in some quarters that public opinion is not as amenable to persuasion and scientific evidence as they would hope. The language gets lurid; the mood music to pronouncements on complementary medicine is increasingly alarmist - we are living in dangerous times, an unEnlightenment looms as tides of irrationality threaten to overwhelm the palisades erected by science. "Reason is a precious but fragile thing," declared Richard Dawkins in his series, The Enemies of Reason, last autumn. "Reason has liberated us from superstition and given us centuries of progress. We abandon it at our peril." What so troubles these science warriors is that it is estimated a third of people in the UK now use complementary medicine, at a cost of £1.5bn a year. In the US, the figures are substantially higher; it has been calculated that more visits are made to healing therapists than to doctors. There is an extraordinary paradox here: a half-century of astonishing conventional medical advances has not succeeded in eliminating complementary medicine. Quite the reverse: the breakthroughs in conventional medicine have been accompanied by the proliferation of other forms of healing - many of which have little or no evidence base to prove their efficacy. Indeed, it only takes a short surf on the web to discover that the wilder shores of this burgeoning industry are, well, pretty wild. To the science warriors, this bizarre state of affairs can only be explained by irrationality. They bemoan the state of science education and lament how, contrary to expectation, literacy and access to information have failed to eradicate superstition. Meanwhile, in this increasingly sharply polarised debate, complementary medicine practitioners are equally exasperated by what they see as blinkered scientific reductionism. So it takes a brave scientist to launch into this territory and risk getting attacked from both camps by daring to ask a simple question: is there anything science can learn from complementary medicine? That is precisely what Kathy Sykes is doing in her current television series, Alternative Therapies (the second programme is on BBC2 tonight). As Bristol University's professor of public engagement in science and the director of the Cheltenham Festival of Science, no one can challenge her credentials as a scientist, yet her scrutiny of particular therapies throws up serious challenges to conventional medicine. Sykes is too good a scientist to give complementary medicine an easy run. Tonight she examines reflexology, and gives it pretty short shrift. There are 30,000 reflexologists working on a million British feet a year. They base their work on a theory that parts of the sole of the foot correlate to organs in the body. The only problem is that Sykes could find no one, reflexologist or scientist, who could explain how these correlations might work. Furthermore, it turned out that this "ancient" healing system seems to have originated with an imaginative American woman in the 1930s. But patients swear by it. One reflexologist points Sykes to her annual garden party full of babies and children as evidence of the success she has had with infertility problems. This is the point where most scientists snort with derision at the use of personal anecdote as evidence, but Sykes presses on and it takes her into two areas of scientific research. First, she digs up new research on the importance of touch, which can have a profound impact on the brain. Even the hand of a stranger reduces anxiety and that of someone with whom one has a close relationship is even more significant. In fact, Sykes finds some scientific underpinning which goes beyond placebo in many of the therapies she looks at. But it is placebo which emerges as a recurrent and crucially important thread in her quest, and it leads her to the work of several American scientists who are trying to identify what placebo is, who it works for, and why it works. This is one of the most common charges made against complementary medicine - that most of it is no better than placebo. But there is a way of turning that accusation around: perhaps complementary medicine is an effective way to harness placebo as one of the most powerful - and cheapest - of healing processes. Rather than being derogatory about the phenomenon as "just" placebo, perhaps we should see it as one of the most remarkable and little understood aspects of the human body. That line of inquiry has taken Sykes to the US several times over the course of the two series she has made. There placebo has become a new frontier in medicine. In a range of studies with startling results - even sham knee surgery can be as effective as the real thing - many factors contribute to placebo: the confidence of the doctor; the social, cultural expectations around the procedure; the empathy and warmth of the patient-doctor relationship; the patient's degree of faith. Get all these right, and the outcome can be remarkable. Harvard professor Ted Kaptchuk is publishing a study this week which shows that placebo is as good as any conventional treatment available for irritable bowel syndrome. Given that the eight most industrialised nations spend $40bn a year on medication for this condition, that's revolutionary stuff. This kind of research into placebo gives some insight into why complementary medicine has boomed and why there are so many people who cite their own experience to passionately defend it. The average consultation with a GP is 4.6 minutes, while the complementary therapist can devote an hour to taking detailed personal histories. That time and relationship provide a context and an opportunity for the ritual and recasting of personal experience which Kaptchuk believes are the crucial elements of placebo. Complementary medicine is most popular where conventional medicine fails, such as with musculoskeletal conditions and mental health - stress, depression, anxiety (the recent revelations about the inefficacy of Prozac were another reminder of how shaky the science is in a large area of conventional medicine). Several complementary therapies are particularly effective at pain relief - you had to see Sykes's footage of hypnotism helping a woman to have teeth extracted without anaesthetic to believe it. Kaptchuk argues that pain is not a static given but can be experienced dramatically differently. Conventional medicine prolongs life but is less successful in prolonging good health - we can expect to spend more years of our life in poor health, as a government report showed last week - and in producing wellbeing. So people are voting with their feet, trying to find other ways to fill the gaps left by conventional medicine. We need scientists to help to identify what they are looking for and why, rather than pouring scorn indiscriminately on the whole field and on the relations between belief, mind and body, of which science still has such a fragmentary understanding. |
||
| Snake Oil Science by R. Barker Bausell Book review by Harriet Hall, M.D. I could condense this review into three words: “read this book!” The term “complementary and alternative medicine” (CAM) is relatively new, but the treatments it encompasses are not. Before we had science, all we had to rely on was testimonials and beliefs. And even today, for most people who believe CAM works, belief is enough. But at some level, the public has now recognized that science matters and people are looking for evidence to support those beliefs. Advocates claim that recent research validates CAM therapies. Does it really? Does the evidence show that any CAM therapy actually works better than placebos? R. Barker Bausell asks that question, does a compellingly thorough investigation, and comes up with a resounding “NO” for an answer. |
 |
|
| Bausell is the ideal person to ask such a question. He
is a research methodologist: he designs and analyzes research studies
for a living. Not only that: he was intimately involved with acupuncture
research for the National Center for Complementary and Alternative
Medicine (NCCAM). So when he talks about what can go wrong in research
and why much of the research on CAM is suspect, he is well worth
listening to. He describes his acupuncture research in great detail. It involved patients with pain from dental surgery. Before designing the experiments, he searched the literature and found an article that reviewed 16 previous trials of acupuncture for dental pain and concluded that it was probably effective. But on the Jadad scale, a simple 5-point measure of quality, none of those 16 studies scored higher than 3 (which is considered barely adequate) and 5 of them incredibly scored zero. Bausell’s group set out to resolve the question with research of much higher quality. For instance, a low dropout rate is one measure of quality; they only had 3 subjects drop out during the course of the study, and those 3 were people the researchers sent home because of a snow storm! They compared “true” acupuncture to the most credible “sham” acupuncture they could devise. There was no difference in outcome: both were equally effective in relieving pain. When they looked more closely at their data, they found some surprises. The placebo control was not perfect, and some subjects had been able to guess which group they were in. Knowing you really got acupuncture should have increased the placebo response, and knowing you didn’t should have decreased it — yet even so, there was no difference between the groups. So the results were even more negative than they appeared. Even more fascinating, patients who thought they got real acupuncture reported much more pain relief than those who thought they got the sham, regardless of which they actually got! Bausell points out that penicillin cures pneumonia even if you’re in a coma, but alternative medicine only seems to work when you are awake. You have to know (or think) you’re being treated. And penicillin works by well-understood scientific principles, while much of alternative medicine is based on “entire physiologic systems or physical forces that the average high school science teacher already knew didn’t exist.” If any alternative treatment clearly worked as well as penicillin, prior plausibility wouldn’t matter: science would adopt it and worry about how it worked later. Under the circumstances, prior plausibility is an important consideration. He tells his mother-in-law’s story. She had knee pain from osteoarthritis with fluctuating symptoms. Every time the pain increased, she would try something new she had read about in Prevention magazine and every time it would seem to work as the pain naturally decreased again. And eventually it would seem to stop working as the pain naturally increased again. She would phone every couple of months to tell him about the wonderful new treatment she had discovered. She was not ignorant or stupid, but she underestimated the power of the placebo and didn’t realize how the natural fluctuations of her pain led her to false conclusions. She had fallen for the most common human error: the post hoc ergo propter hoc fallacy. The fact that pain relief follows treatment doesn’t necessarily mean that the treatment caused the pain relief. This is only one of the many impediments to correct thinking that plague our fallible human brains. Bausell describes some of those other impediments. He shows how patients, doctors, and researchers are all equally likely to fool themselves, and why the most rigorous science is needed to keep us from reaching false conclusions. Bausell’s thorough discussion of the placebo phenomenon is illuminating and invaluable. He covers the history of research on placebos and tells some fascinating anecdotes. He argues that placebo response is not just imagination. It is a learned phenomenon, a conditioned response. You respond to a placebo pill because you have previous experience of being helped by pills. Morphine injections in dogs cause a side effect of salivation: after a while, you can inject water and they will respond with salivation. Physiologic effects from placebo are always smaller than with the real thing, but apparently they do occur. The evidence for objective physiologic effects may not be entirely convincing, but it is certain that pain and other subjective symptoms respond to placebos. And there is even research suggesting a mechanism: the release of endogenous opioids, pain-relieving chemicals produced by our own brains. If you counteract those chemicals with a narcotic antagonist like Narcan, you can block the placebo response. He shows that the act of taking a pill may really relieve pain, but that the contents of the pill may be irrelevant. Research shows a hierarchy of placebo response: injections work better than capsules and capsules work better than tablets. The color and size of the pill and the frequency of dosing all make a difference. And intriguingly, patients who have responded to a placebo have distortions of memory: they remember the pain relief as greater than it actually was! Bausell points out that …just because someone with a PhD or an MD performs a clinical trial doesn’t mean that the trial possesses any credibility whatsoever. In fact, the vast majority of these efforts are worse than worthless because they produce misleading results. The book includes valuable lessons on how to tell credible research from the other kind. Even the most experienced researchers will find food for thought here, and for the layman it will be a revelation. Research is full of pitfalls. Negative studies tend not to get published (the file drawer effect). Research done by believers and pharmaceutical companies tends to be more positive than research done by others. Studies from non-English speaking countries are notoriously unreliable for various reasons — 98% of the acupuncture studies from Asia are positive, compared to 30% from Canada, Australia, and New Zealand. The researcher may delegate the actual research to others, who may make undetected mistakes or deliberately skew results to please their boss. Double blind studies may not be truly blind: subjects may have been able to guess which group they were in. Subjects who are not responding may drop out. People who believe in homeopathy are more likely to volunteer for homeopathy studies. Researchers may put a positive spin on their findings or reach conclusions that are not justified by the data. Even if the research is impeccable, we arbitrarily use p=.05 as the measure of statistical significance, and this means there is a 5% probability that the results will appear falsely positive just by chance. There are more pitfalls, and Bausell covers them all. When you come right down to it, no experiment is beyond criticism, and most published research is wrong. So how can we decide which studies are credible? We now have published guidelines such as the 22 item Consolidated Standards of Reporting Trials (CONSORT) checklist to assess the quality of randomized controlled trials, but Bausell offers some simpler criteria that can rule out the worst offenders: Subjects are randomly assigned to a CAM therapy or a credible placebo At least 50 subjects per group Less than 25% dropout rate Publication in a high-quality, prestigious, peer-reviewed journal Using this simple 4-item checklist, he reviewed all the CAM studies published in The New England Journal of Medicine and The Journal of the American Medical Association from 2000–2007. 14 met the criteria, and all were negative. When he expanded his search to include the Annals of Internal Medicine and Archives of Internal Medicine, he ended up with 22 studies, only one of which was positive (exactly what you would expect from the 5% rule if none of them worked). Since different studies have conflicting results, we now use meta-analyses or systematic reviews to try to reach a reliable conclusion. In fact, we even have systematic reviews of systematic reviews! After explaining why systematic reviews are subject to several pitfalls of their own, Bausell goes on to examine the high-quality systematic reviews from the Cochrane collection. Cochrane’s independent reviewers take the quality of studies into account and try to evaluate all the published evidence without bias. Of 98 CAM reviews in the Cochrane database, 21 were positive. When he subtracted those that lacked confirmation by studies in English-speaking countries, those with suspect controls, and those that were subsequently trumped by more definitive high-quality studies, the percentage of positive studies dropped to that familiar 5%. A highly touted non-Cochrane review of homeopathy concluded that the clinical effects of homeopathy were not just due to placebo. But strangely they also concluded that there was insufficient evidence to show that any single homeopathic treatment was clearly effective in any one clinical condition. A re-analysis of the studies they had reviewed showed that when only the highest quality studies were considered, the alleged positive effect for homeopathy disappeared. What all this amounts to is that advocates can point to plenty of “snake oil” science that apparently supports various CAM treatments; but when examined critically, the entire body of evidence is compatible with the hypothesis that no CAM method works any better than placebo. True believers will never give up their favorite treatment because of negative evidence; they will always want to try one more study in the hope that it will vindicate their belief. They see science as a method they can take advantage of to convince others that their treatment works. They don’t see it as a method of finding out whether their treatment works. Bausell says CAM therapists simply do not value (and most, in my experience, do not understand) the scientific process. He doesn’t aim to dissuade anyone from using CAM. He just doesn’t want anyone to choose it for the wrong reasons, to be fooled into thinking there is credible evidence where there isn’t. He emphasizes that CAM nourishes hope, and its placebos work, if only for symptoms that would eventually resolve on their own anyway. The comfort CAM brings can be valuable, as long as it is not used in place of effective treatments for serious conditions — and most of the time it isn’t, despite the occasional horror story of a patient who refuses effective cancer treatment and dies using a useless remedy. He even has some advice on how to choose a placebo therapy that works for you. He encourages you to believe because otherwise it won’t work. Bausell writes in an entertaining, accessible style: the book reads almost like a detective story. It should appeal equally to the general reader and to the scientist. The book isn’t perfect, but its minor flaws don’t detract from its message. It is destined to be a classic on the order of Robert Park’s Voodoo Science and Michael Shermer’s Why People Believe Weird Things. If you want to understand how medical research works, if you want to know what can lead patients and scientists to false conclusions, if you have ever used complementary or alternative medicine or have wondered why others do, if you value evidence over belief, if you care about the truth, read this book. |
||
When there's no real alternative
|
||