A general record of my ongoing battle with all forms of nonsense.

Tuesday 7 July 2009

Complaint to Trading Standards over unsubstantiated claims made by Chiropractors

I figure it probably makes more sense to post the letter text here than to link to the Google Document. If you wish to be one of the signatories, please join the Facebook Group.

The letter is quite lengthy, but I think all the points are necessary. They are designed to combat the excuses that various Trading Standards offices have used for inaction.

To Whom it May Concern,

We are writing to complain about [company name].

This company makes the following claims on their web site [web site domain name]:

[copied & pasted claim]

We believe this text clearly implies that the company in question is willing to use chiropractic to treat infant colic. We believe there to be no reliable evidence to support the belief that colic is caused by a problem with the spine, nor that chiropractic is effective in treating it. In addition, results from the only controlled trial to date indicate that it is no more effective than placebo treatment.

Below are listed the studies typically cited by chiropractors to show that chiropractic is an effective treatment for colic. We have included an explanation of the trial and the conclusion that can be drawn from it. The final study in the list is generally ignored by chiropractors making this claim; however, it clearly shows the treatment to be ineffective.

1. Klougart N, Nilsson N and Jacobsen J (1989) Infantile Colic Treated by Chiropractors: A Prospective Study of 316 Cases, J Manip Physiol Ther,12:281-288.

This study tracked 316 children with symptoms of colic during chiropractic treatment and showed that there was improvement in 94% of cases.

However, this study failed to provide any evidence for or against the efficacy of chiropractic in the treatment of colic for the following reason: all children with colic improve over time.

If all children improve from colic anyway, then showing that they improve after a certain treatment is unhelpful unless there is a control group not receiving treatment with which to compare them. This study contained no such group.
This is irrelevant.

It is irrelevant because it cannot demonstrate that treatment improves recovery from the condition.

2. Mercer, C. and Nook, B. in the Proceedings of the 5th Biennial Congress of the World Federation of Chiropractic (1999)This doesn't seem to have been published, so was not peer reviewed. As it seems to be almost impossible to get hold of the paper, there is very little that can be said.

From the summary provided by the BCA, however, it appears that this was a simple observational study like the one above with no control group.
This is irrelevant.

It is irrelevant because it cannot demonstrate that treatment improves recovery from the condition.
3. Wilbery J, Nordsteen J, Nilsson N. The short term effect of spinal manipulation in the treatment of infantile colic. A randomised controlled trial with a blinded observer. J Manipulative Physiol Ther (1999) 22:517-522.This study showed that chiropractic was equally as effective as dimethicone in treating colic.

That could mean that both dimethicone and chiropractic are effective, or it could mean that neither are effective.

There is very little evidence demonstrating dimethicone is an effective treatment. The only evidence we could find was a single, small scale trial involving less than 50 children.

Showing something to be equal in effectiveness to something with unproven effectiveness is unhelpful.

Also, without proper blinding between the two groups, it is likely that the placebo effect could play a major part in the outcome. The placebo effect is likely to be more pronounced with the chiropractic treatment as it is a more dramatic intervention.
This is inconclusive at best, with the conclusion drawn by the chiropractors being dependent on two trials both being properly carried out, both with relatively small sample sizes, neither having been repeated and one lacking adequate controls against placebo effect.
4. Hayden & Mullinger (2006) Complementary Therapies in Clinical Practice (2006) 12, 83–90.This study did not investigate chiropractic, but cranial osteopathy.

Even so, this was a preliminary trial. Preliminary trials are of too small a scale to reach a conclusion. They are used only to see if it might be worth performing a proper trial.
This is irrelevant.

It is irrelevant because it does not study chiropractic.
5. Hipperson AJ (2004) Clinical Chiropractic 11, 122 – 129.This was merely a report of two case studies. This is irrelevant for the same reason as Klougart N, Nilsson N and Jacobsen J, but with only two subjects.This is irrelevant.

It is irrelevant for the same reason as the first study.
6. Browning M. Miller, J. Clinical Chiropractic (2008) 11, 122—129 This study compared two different forms of chiropractic in the treatment of colic. Maybe they both work, maybe neither work. This study did not attempt to answer that question.This is irrelevant.

It is irrelevant because it did not test if the treatment worked. It merely compared two different types of chiropractic treatment that may or may not have worked.
7. Leach RA (2002) J Manip Physiol Ther, 25, 58 -62.Simply another two case studies as Hipperson AJ (2004) above.This is irrelevant.

It is irrelevant for the same reason as the first study.
8. Miller J (2007) Clinical Chiropractic 10, 139—146 Cry babies: A framework for chiropractic care. This is not a study at all, we are not sure why it is quoted.This is irrelevant.
9. Nilsson N. 1985 Eur J Chiropr 33, 264 – 255 Infantile colic and chiropractic.This is merely a survey of parents who have had their child gone through chiropractic treatment for colic. No parents who did not take their children to chiropractors were questioned, making this study even more irrelevant than Klougart N, Nilsson N and Jacobsen J.This is irrelevant.

It is irrelevant for the same reason as the first study.
10. Olafsdottir E, Forshei S, Fluge G, Markestad T (2001) Randomised controlled trial of infantile colic treated with chiropractic spinal manipulation. AIMS: To investigate the efficacy of chiropractic spinal manipulation in the management of infantile colic. METHODS: One hundred infants with typical colicky pain were recruited to a randomised, blinded, placebo controlled clinical trial. RESULTS: Nine infants were excluded because inclusion criteria were not met, and five dropped out, leaving 86 who completed the study. There was no significant effect of chiropractic spinal manipulation. Thirty two of 46 infants in the treatment group (69.9%), and 24 of 40 in the control group (60.0%), showed some degree of improvement. CONCLUSION: Chiropractic spinal manipulation is no more effective than placebo in the treatment of infantile colic. This study emphasises the need for placebo controlled and blinded studies when investigating alternative methods to treat unpredictable conditions such as infantile colic.

This is the only properly conducted trial comparing chiropractic against placebo for the treatment of colic. The conclusion is that it simply does not work.
Chiropractic spinal manipulation is no more effective than placebo in the treatment of infantile colic.

We believe that this trader is operating an unfair commercial practice under the consumer protection regulations. It is Trading Standards' legal responsibility to enforce these regulations. 19.—(1) of the act stated "It shall be the duty of every enforcement authority to enforce these Regulations."

Part 2, Section 5 of the regulations list misleading actions as below. You can see from the text below that a trader is in breech if they present information in a way that is misleading even if it is factually accurate. We believe that a trader presenting a testimonial from a client promoting efficacy or even just stating "some parents have found chiropractic useful in treating colic" is therefore performing a misleading action under the regulations.
Misleading actions
5.—(1) A commercial practice is a misleading action if it satisfies the conditions in either paragraph (2) or paragraph (3).
(2) A commercial practice satisfies the conditions of this paragraph—
(a)if it contains false information and is therefore untruthful in relation to any of the matters in paragraph (4) or if it or its overall presentation in any way deceives or is likely to deceive the average consumer in relation to any of the matters in that paragraph, even if the information is factually correct; and
(b)it causes or is likely to cause the average consumer to take a transactional decision he would not have taken otherwise.

According to The Consumer Protection from Unfair Trading Regulations 2008, the onus of evidence relating to any factual claim is on the company making the claim. So it is not a requirement that a prosecutor proves that the claims are factually incorrect, rather it is a requirement that the company must be able to show that their claims are backed by adequate evidence. Section 27 of the regulations state:

(1) This section applies where an application for an enforcement order or for an interim enforcement order is made in respect of a Community infringement involving a contravention of Directive 2005/29/EC of the European Parliament and of the Council of 11 May 2005 concerning unfair business-to-consumer commercial practices in the internal market.
(2) For the purposes of considering the application the court may require the person named in the application to provide evidence as to the accuracy of any factual claim made as part of a commercial practice of that person if, taking into account the legitimate interests of that person and any other party to the proceedings, it appears appropriate in the circumstances.
(3) If, having been required under subsection (2) to provide evidence as to the accuracy of a factual claim, a person—
(a) fails to provide such evidence, or
(b) provides evidence as to the accuracy of the factual claim that the court considers inadequate,
the court may consider that the factual claim is inaccurate

As an enforcement authority, you also have the right to demand any documentation, such as their evidence for the claim, from the company. Section 21 (b) states "if he has reasonable cause to suspect that a breach of these Regulations has been committed, he may, for the purpose of ascertaining whether it has been committed, require any trader to produce any documents relating to his business and may take copies of, or of any entry in, any such document;"

So, to summarise the points above:
  • The consumer protection regulations cover the overall impression given by the trader and the trader may be in breech even if the actual claims are factually accurate.
  • The consumer protection regulations require the trader to provide evidence for any claims they make, rather than the prosecutor needing to prove those claims to be false.
  • The evidence we have found from chiropractic organisations so far appears not to be relevant to the question of efficacy, and where it is relevant it appears to be inconclusive.
  • The only properly conducted trial of the use of chiropractic in treating colic shows this treatment to be no more effective than placebo.
  • While prosecution can proceed solely on the grounds that the company provides no evidence, or inadequate evidence; your position is much stronger: the best evidence available clearly shows this treatment to be ineffective.

We have only checked the claims on this company's web site. They may also be making similar claims in leaflets within their practice, or their advice to their customers. We hope you will be able to visit the practice to ensure compliance with the law.

While we have focused on colic for the purposes of this letter, we have also found some practices also claiming to treat children for sleeping and feeding problems, ear infections, asthma and prolonged crying. The evidence for chiropractic's efficacy for these treatments is similar to that for colic above. We sincerely hope you will take similar action against any such claims.

Yours faithfully,

[list of names, titles etc]


Andy said...

Considering the oft-repeated defence that chiropractors "don't treat", there's an awful lot of "treat" and "treatment" contained in your table above.

Seek regular chiropractic care, especially during the first four months.


And how useless would our bodily structures have to be if they could be manipulated using the pressure used to test a ripe tomato? Seriously? We'd be like rag dolls falling apart at every touch. Just hugging your baby could be lethal!

I wonder who carries out the spinal manipulation on all those poor creatures born, perfectly naturally, in the wild?

Andy said...

Sorry, scrolled too far and posted in wrong section. Hope you don't mind if I post it in the right place and leave you to trash these two.