Published by Homeopathy Research Institute (HRI), London.
In March 2015, the Australian National Health and Medical Research Council (NHMRC) published an Information Paper on homeopathy, commonly referred to as ‘The Australian Report’.1
This document concluded that “…there are no health conditions for which there is reliable evidence that homeopathy is effective”.2
The report triggered headlines around the world suggesting NHMRC had found that homeopathy does not work for any condition.3
However, on 26 August 2019 NHMRC CEO Prof Anne Kelso provided the following clarification on the findings of the 2015 Homeopathy Review:
“Contrary to some claims, the review did not conclude that homeopathy was ineffective.”4
An extensive investigation by the Australian Homeopathic Association (AHA) into NHMRC’s conduct, combined with an in-depth scientific analysis of the review by HRI, revealed evidence of serious procedural and scientific misconduct, including the fact that the published report was NHMRC’s second attempt – a first report written in 2012 was never disclosed to the public.
Rachel Roberts, HRI Chief Executive says: “The public has a right to know that there are high quality studies showing homeopathy works for some medical conditions, such as hay fever, sinusitis and diarrhoea in children – information that was lost only due to NHMRC’s mishandling of the evidence. If the evidence on conventional medicine was treated this way there would be an outcry – and rightly so. NHMRC’s job was to accurately summarise the body of evidence for homeopathy for the public, a task in which they categorically failed.”
Missing first report finally released
After an ongoing campaign by stakeholders and the general public, in August 2019 NHMRC finally released the draft 2012 report5 in which the author concluded that there is “encouraging evidence for the effectiveness of homeopathy” in five medical conditions.
NHMRC did the homeopathy review twice, producing two reports, one in July 2012 and the one released to the public in March 2015.
The existence of the first report was not disclosed to the public – it was only discovered through Freedom of Information (FOI) requests.
NHMRC say they rejected the first report because it was poor quality despite it being undertaken by a reputable scientist and author of NHMRC’s own guidelines on how to conduct evidence reviews.
FOI requests have revealed that a member of NHMRC’s expert committee overseeing the review process – Professor Fred Mendelsohn – confirmed6 the first review to be high quality saying – “I am impressed by the rigor, thoroughness and systematic approach given to this evaluation [….] Overall, a lot of excellent work has gone into this review and the results are presented in a systematic, unbiased and convincing manner.”
NHMRC said the results of the second report published in 2015 were based on a “rigorous assessment of over 1800 studies”. In fact results were based on only 176 studies.
NHMRC used a method that has never been used in any other review7, before or since. NHMRC decided that for trials to be ‘reliable’ they had to have at least 150 participants and reach an unusually high threshold for quality. This is despite the fact that NHMRC itself routinely conducts studies with less than 150 participants.8
These unprecedented and arbitrary rules meant the results of 171 of the trials were completely disregarded as being ‘unreliable’ leaving only 5 trials NHMRC considered to be ‘reliable’.9 As they assessed all 5 of these trials as negative, this explains how NHMRC could conclude that there was no ‘reliable’ evidence.
Professor Peter Brooks, Chair of the NHMRC committee that conducted the 2015 review, signed conflict of interest form declaring he was not “affiliated or associated with any organisation whose interests are either aligned with or opposed to homeopathy”, despite being a member of anti-homeopathy lobby group ‘Friends of Science in Medicine’
NHMRC’s guidelines state that such committees must include experts on the topic being reviewed, yet there was not one homeopathy expert on this committee.
Complaint submitted to Commonwealth Ombudsman
In August 2016, the Australian Homeopathic Association (AHA) made a formal complaint to the Commonwealth Ombudsman against the National Health and Medical Research Council (NHMRC). The complaint, investigated under the PID (aka ‘Whistle-blower) Act”, aimed to hold NHMRC accountable for bias, misconduct and ultimately misleading the public in their inaccurate 2015 report on homeopathy.
The Homeopathy Research Institute (HRI) provided expert input to the investigation detailing the flawed scientific methods used by NHMRC to produce their homeopathy review.
The Ombudsman’s Office publicly announced on 4 August 2023 that the seven-year investigation had been closed, stating that: “Despite our best efforts, it was not possible to engage an expert (or experts) to provide independent advice to our Office on this subject. In the absence of independent, expert scientific expertise we have not been able to conclusively determine those matters of scientific methodology.”
Rachel Roberts, Chief Executive of HRI, said:
“The use of unprecedented and flawed scientific methods by NHMRC is at the very heart of this case. It is therefore extremely disappointing that the Ombudsman could not find any scientific experts, sufficiently free from bias – either for or against homeopathy – who were willing to take on the role of judging the validity of the methods used by NHMRC.
Since the NHMRC report on homeopathy has been widely quoted, it is profoundly regrettable that, despite a seven-year investigation, the scientific misconduct case against NHMRC remains unanswered.”
Download10 the Executive Summary of the Ombudsman submission.
The HRI Statement on Closure of the Ombudsman Complaint.11
Roberts says,
“NHMRC’s review is a shocking example of misreporting. Decision-makers and the scientific community rely on these kinds of reports and need to trust their accuracy. This is not about anyone’s personal opinion as to whether homeopathy works or not. It is about the importance of evidence being reported objectively, whatever it says, and NHMRC did not do that.”
The complainants are now waiting to hear back from the Ombudsman regarding their submission. As NHMRC’s inaccurate Homeopathy Review has had a significant impact on the field of homeopathy research worldwide, HRI will share any news regarding the complaint as the case progresses.
The missing first report
NHMRC’s investigation into Homeopathy ran from 2010 to 2015. NHMRC initially worked with an external contractor at the University of South Australia (UniSA) – from April 2012-August 2012 – to produce a review of the evidence on Homeopathy to inform the Australian public.
The report produced was called The Effectiveness of Homeopathy: An overview review of secondary evidence.
This review, paid for by Australian tax payers, was never made public and NHMRC refused to release it for over three years, despite repeated Freedom of Information requests.
After terminating the contract with the first review team, a second external contractor – OptumInsight – was hired to do the Homeopathy review again from December 2012-March 2015.
HRI is not alone in criticising the accuracy of NHMRC’s findings
FOI requests have brought to light that two independent experts also raised concerns over the conclusions of the 2015 report during peer review, prior to final publication. The Australasian Cochrane Centre commented that for some conditions, “…. ‘no reliable evidence’ does not seem an accurate reflection of the body of evidence”; a second expert felt “uncertain of the definitive nature of the Report’s conclusions”. NHMRC chose not to act on this feedback and did not amend their conclusions.
The real story behind the headlines
Contrary to NHMRC’s findings, there are ‘good quality, well-designed studies with enough participants for a meaningful result‘12 (to use NHMRC’s description of a reliable study) which show that certain homeopathic treatments are effective for certain conditions such as hay fever, sinusitis, upper respiratory tract infections, diarrhoea in children and lower back pain. The fact that the results of such studies were unjustifiably dismissed means that NHMRC have misled the public by misreporting the evidence for effectiveness of homeopathy.
Document archive
NHMRC publications 2014
Draft Australian Report13
Overview Report14
Overview Report Appendices15
Review of Submitted Literature16
List of Submitted Evidence17
HRI publications 2014-23
HRI Statement 202318
HRI analysis19
HRI response20
HRI submission to public consultation21
National Health and Medical Research Council. 2015. NHMRC Information Paper: Evidence on the effectiveness of homeopathy for treating health conditions. Canberra: National Health and Medical Research Council; 2015. Available from: https://www.hri-research.org/wp-content/uploads/2015/07/NHMRC-Information-Paper-Mar2015.pdf
Optum. 2013. Overview Report: Effectiveness of Homeopathy for Clinical Conditions: Evaluation of the Evidence. Prepared for the NHMRC Homeopathy Working Committee. Available from: https://www.hri-research.org/wp-content/uploads/2014/07/Homeopathy-Overview-Report.pdf
https://www.theguardian.com/world/2014/apr/08/homeopathy-is-bunk-study-says
https://www.nhmrc.gov.au/sites/default/files/documents/attachments/CEO-statement-signed.pdf
https://www.hri-research.org/wp-content/uploads/2019/08/Draft-annotated-2012-homeopathy-report.pdf
https://www.hri-research.org/wp-content/uploads/2019/03/2012.07.12-HWC-Fred-Mendelsohn-feedback-on-first-review-FOI-2016-17-016-12.pdf
https://www.hri-research.org/resources/homeopathy-the-debate/the-australian-report-on-homeopathy/australian-report-faqs/
https://www.hri-research.org/resources/homeopathy-the-debate/the-australian-report-on-homeopathy/australian-report-faqs/
https://www.hri-research.org/resources/homeopathy-the-debate/the-australian-report-on-homeopathy/australian-report-faqs/
https://www.hri-research.org/wp-content/uploads/2017/04/Executive-Summary-to-Ombudsman-Complaint-re-NHMRC-Homeopathy-Review-FINAL.pdf
https://www.hri-research.org/resources/homeopathy-the-debate/the-australian-report-on-homeopathy/australian-report-faqs/
https://www.hri-research.org/wp-content/uploads/2014/07/nhmrcdrafthomeopathyinformationpaper140408.pdf
https://www.hri-research.org/wp-content/uploads/2014/07/Homeopathy-Overview-Report.pdf
https://www.hri-research.org/wp-content/uploads/2014/07/Overview-Report-appendices.pdf
https://www.hri-research.org/wp-content/uploads/2014/07/Review-of-submitted-literature.pdf
https://www.hri-research.org/wp-content/uploads/2014/07/List-of-considered-evidence.pdf
https://www.hri-research.org/wp-content/uploads/2023/08/HRI_CommonwealthOmbudsmanStatement_10August2023.pdf
https://www.hri-research.org/wp-content/uploads/2017/07/HRI-data-analysis-impact-of-NHMRC-definition-of-reliable.pdf
https://www.hri-research.org/wp-content/uploads/2016/02/HRI-Response-to-NHMRC-Information-Paper.pdf
https://www.hri-research.org/wp-content/uploads/2014/07/HRI-Submission-to-NHMRC-public-consultation-draft-Information-Paper-on-homeopathy.pdf