Gideon Meyerowitz-Katz is an epidemiologist and writer based in Sydney, Australia. His work covers chronic disease, the pandemic response, and more recently, error detection in science. In this op-ed, he discusses issues with research that have become increasingly apparent during the pandemic.
There are no two ways about it: Science is flawed. Were not talking about the philosophical leanings of science or the origins of white coats and linoleum-floored laboratories, but about the nuts and bolts of the process by which we determine whether things are true or false.
In the decades before the pandemic, scientists spent endless hours wrestling with the painful fact that much of the knowledge base of science and medicine is reliant on research that is flawed, broken, or potentially never occurred at all.
Science has a gap between its mechanics and outputs. The mechanics of science are fine. The machines always get bigger and more efficient. New tools are always developed. Techniques become more sophisticated over time, and more knowledge is acquired.
The outputs of science are not. The culture of academia demands publication and warrants little retrospection about potential errors this means that mistakes are rarely corrected, and even outright fraud is often left undetected in academic literature.
And then along came a pandemic, and the gaps in science widened to an inescapable chasm. While biomedical research has had obvious and immediate success in COVID-19 mitigation, it has been accompanied by an enormous tidal wave of garbage, which instantly overwhelmed our garbage mitigation mechanisms.
From fraud to wasteful research to papers so error-filled that it is amazing that theyve been published, the pandemic has produced a tidal wave of woeful scientific output that has, nevertheless, had staggering consequences for peoples lives.
Take ivermectin. It is an amazingly successful antiparasitic medication that has treated literally billions of people in the time since it was invented, and it has almost eliminated some parasitic diseases from the world.
It has also been globally promoted as a cure for COVID-19 by a group of passionate fans. It is likely that more ivermectin has been taken to prevent or treat COVID-19 than any other single medication, except perhaps dexamethasone.
And yet, we do not know if ivermectin is actually useful in the treatment of COVID-19 at all.
A recent review from the Cochrane collaboration long considered the gold standard in medical research concluded that ivermectin should not be used for the treatment or prevention of COVID-19 outside of well-conducted clinical trials, which is a stark contrast to the hundreds of millions of doses still being taken for those exact reasons.
In early 2020, people were desperate for any kind of treatment for COVID-19. A melange of partial evidence emerged.
This included: a laboratory study showing that the drug acted as a strong antiviral in a petri dish, a study in a French nursing home where the residents took ivermectin to treat a scabies outbreak and seemed to subsequently enjoy higher survival rates, and preprint reporting that ivermectin reduced the mortality from COVID-19 by 90%.
All three were weak evidence in different ways. Single in vitro studies are very poorly predictive of eventual clinical outcomes, and the nursing home paper was an accidental and uncontrolled observational study what if the residents had never been exposed to SARS-CoV-2 in the first place?
The clinical study was entirely fabricated and later withdrawn from the preprint server, subsequent to great scandal.
The ivermectin story somehow got even worse from there. In late 2020, studies started popping up showing what can only be described as simply incredible results for the medication a 90% mortality benefit or a 100% reduction in cases when used as a prophylactic.
After nearly a year, myself and other data sleuths demonstrated that many of these studies probably never happened, but the damage was well and truly done long before the first fake paper was retracted.
A meta-analysis of ivermectin, which is usually considered the gold standard of research practices, found a huge benefit for the drug. However, the paper has not been corrected, even though the studies underlying its results were found to be likely fraudulent.
In any other discipline media, government, private enterprise such an analysis would be taken down with apologies immediately. Instead, the paper is allowed to stand as a testament to the general disinterest of the scientific world in correcting errors.
This story couldve been told very differently. Imagine a world where the initial laboratory paper came with a disclaimer, where the fraudulent preprint was looked on with skepticism immediately, and where the positive trials were assessed for fraud before they were even published.
Instead, at every stage, the process of highlighting concerns with data is ignored, with peer-review being the only flimsy barrier to publication for terrible research.
When we most needed effective fact-checking, our grand institutions of scientific research instead reviewed studies in a matter of days, if not hours, and posted fraudulent studies online to be shared across the world.
Its tempting to say that research into ivermectin is uniquely flawed, but thats clearly not true realistically, it would be remarkable if a broken system produced only one failure.
Trials of favapiravir, another repurposed COVID-19 medication, have recently been retracted due to data concerns.
There are now nearly a dozen studies looking at whether vitamin D has a benefit in COVID-19 that have been corrected or withdrawn entirely over the last 18 months.
The website Retraction Watch keeps a running tally of the pandemic-related studies that have been retracted. As of publication, the figure is 199 and growing every week.
Even worse, those are just the papers that people have looked into. Errors in science are rarely noticed because there is simply no reward for pointing out other peoples mistakes.
If we were to start looking at all of the useless, wasteful, terribly done research, we might expand that number to thousands, or even tens of thousands of papers.
There are published ecological studies of ivermectin where researchers compare entire countries drug use and COVID-19 mortality. These studies use mass drug administration protocols as their measure of the number of people who received ivermectin during the pandemic. This is despite those protocols mostly being disrupted or canceled early in 2020.
One study of vitamin D was retracted from the SSRN preprint server after it became clear that the authors had incorrectly labeled it as a randomized trial, though they had not randomized the participants at all. It has since been republished largely unchanged, with no mention of the previous retraction at all in the final paper.
None of this is to say that there is no good science. The vaccine trials alone are perhaps the most impressive scientific work that has ever been done, with efficacious immunizations developed, tested, and trialed in under 1 year.
The RECOVERY and SOLIDARITY clinical trials, which looked at repurposed drugs to treat COVID-19, have almost certainly saved millions of lives during the pandemic.
The problem is that large, well-conducted clinical trials are far from the norm. In a recent systematic review of hydroxychloroquine for COVID-19, the median number of people enrolled per arm in clinical trials was 59 one study looked at just two patients.
Without even carefully assessing these studies, we can say that most of them were probably a waste of time.
Indeed, if you look at the meta-analytic model from this review, virtually our entire knowledge of hydroxychloroquine for COVID-19 comes from just two studies, which recruited about 70% of all the people whom this drug had ever been tested on.
This is despite nearly 300 trials of the drug registered on clinicaltrials.gov, and the highest research spend of any single medication in the early pandemic.
If all of those tiny trials had been linked together, they may have achieved something useful, but instead, were left with two good studies and a smattering of largely pointless research.
All of this is, perhaps, the predictable outcome of a system that pushes publication above all else and punishes error-checking with disdain, scorn, and lawsuits. Publishing a terrible study can earn you praise and promotions; at worst, it might end up a line on your CV somewhere.
Checking studies for errors publicly earns you a steady payment of hate mail and death threats, and it nets you none of the citations, publications, and awards that academia regards as important.
Science has some enormous issues. Unless we can find a way to reward error-checking with actual money, we will continue to accept that a worrying proportion of our research output the studies that we use to make life-and-death decisions is either fake or incredibly problematic.
While it is tempting to think of this as a tedious problem among eggheads, that couldnt be further from the truth.
It is not unlikely that you or your family have personally been impacted by bad research during COVID-19 maybe you were given hydroxychloroquine during a hospital stay or took some metformin just in case. Perhaps you live in a place that reopened schools based on a study with mathematical errors or were told that masks constituted child abuse due to a paper that was later withdrawn.
Overall, there is a real impact of bad science in our everyday lives that the pandemic has thrown into stark relief.
Worse still, we know another pandemic is coming eventually. If we dont fix these issues now, the next time a new disease spreads through our world, we will be doomed to repeat the mistakes of COVID-19. And that is perhaps the most worrying thought of all.
See original here:
The perils of flawed research and the ivermectin debacle - Medical News Today
- BENITEC BIOPHARMA INC. Management's Discussion and Analysis of Financial Condition and Results of Operations (form 10-Q) - Marketscreener.com - February 13th, 2023 [February 13th, 2023]
- CENTOGENE to Participate in Upcoming Conferences in February in the Lead Up to Rare Disease Day - Marketscreener.com - February 7th, 2023 [February 7th, 2023]
- Gene | Definition, Structure, Expression, & Facts | Britannica - January 27th, 2023 [January 27th, 2023]
- New gene therapy delivers treatment directly to brain - January 27th, 2023 [January 27th, 2023]
- Indian Pharma Congress: Gene-cell therapy, preventive medicine future of health care, says expert - Economic Times - January 25th, 2023 [January 25th, 2023]
- A blood test that identifies people at higher risk of miscarriage? Thats the goal of this award-winning Rutgers med student. - The Philadelphia... - January 19th, 2023 [January 19th, 2023]
- Gene Therapy: Genes As Medicine | Pfizer - January 6th, 2023 [January 6th, 2023]
- How Genomics will ensure a risk-free and beneficial treatment for good health and well-being - The Financial Express - December 28th, 2022 [December 28th, 2022]
- Regenerative Medicine Advanced Therapy Designation | FDA - December 18th, 2022 [December 18th, 2022]
- 3576 - Gene ResultCXCL8 C-X-C motif chemokine ligand 8 [ (human)] - November 23rd, 2022 [November 23rd, 2022]
- Study identifies new gene that drives colon cancer - EurekAlert - October 17th, 2022 [October 17th, 2022]
- Updated Stroke Gene Panels: Rapid evolution of knowledge on monogenic causes of stroke | European Journal of Human Genetics - Nature.com - October 17th, 2022 [October 17th, 2022]
- The challenges of translating CRISPR to the clinic - Labiotech.eu - October 17th, 2022 [October 17th, 2022]
- Editas Medicine Presents Preclinical Data on EDIT-103 for Rhodopsin-associated Autosomal Dominant Retinitis Pigmentosa at the European Society of Gene... - October 17th, 2022 [October 17th, 2022]
- 'We have to find a way': FDA seeks solutions to aid bespoke gene therapy - BioPharma Dive - October 17th, 2022 [October 17th, 2022]
- Mathematical model could bring us closer to effective stem cell therapies - Michigan Medicine - October 17th, 2022 [October 17th, 2022]
- Approval, Commercialization Highlighted at Cell & Gene Meeting on the Mesa - Genetic Engineering & Biotechnology News - October 17th, 2022 [October 17th, 2022]
- CANbridge-UMass Chan Medical School Gene Therapy Research in Oral Presentation at the European Society of Gene and Cell Therapy (ESGCT) 29th Annual... - October 17th, 2022 [October 17th, 2022]
- Depression Treatment: How Genetic Testing Can Help Find the Right Medication - Dunya News - October 17th, 2022 [October 17th, 2022]
- The Risk-Reward Proposition for CGT Clinical Trials - Applied Clinical Trials Online - October 17th, 2022 [October 17th, 2022]
- Precision Medicine Could Get Even More Precise With Allarity Therapeutics Next-Generation Diagnostics - Benzinga - October 17th, 2022 [October 17th, 2022]
- Decibel Therapeutics Receives FDA Clearance of IND Application for DB-OTO, a Gene Therapy Product Candidate Designed to Provide Hearing to Individuals... - October 17th, 2022 [October 17th, 2022]
- Time for your medicine: unlocking the power of our body clocks - The Guardian - October 17th, 2022 [October 17th, 2022]
- Replay establishes distinguished Scientific Advisory Board of genomic medicine and cell therapy experts - Yahoo Finance - October 17th, 2022 [October 17th, 2022]
- Scientists Reappraise the Role of Zombie Cells That Anti-aging Medicine Has Sought to Eliminate - Neuroscience News - October 17th, 2022 [October 17th, 2022]
- Forge Biologics Announces Updated Positive Clinical Data in RESKUE, a Novel Phase 1/2 Gene Therapy Trial for Patients with Krabbe Disease - Business... - October 17th, 2022 [October 17th, 2022]
- Gene Expression Signatures Are Analyzed for Biomarkers of Response in HCC - Targeted Oncology - October 17th, 2022 [October 17th, 2022]
- NHS England World-first national genetic testing service to deliver rapid life-saving checks for babies and kids - NHS England - October 17th, 2022 [October 17th, 2022]
- The proteinprotein relationship that could mend a broken heart - RegMedNet - October 17th, 2022 [October 17th, 2022]
- Study finds microprotein correlated to Alzheimers risk - Daily Trojan Online - October 11th, 2022 [October 11th, 2022]
- Passage Bio Announces Appointment of William Chou, M.D. as Chief Executive Officer - Yahoo Finance - October 11th, 2022 [October 11th, 2022]
- Gene Therapy Rapidly Improves Night Vision in Adults with Congenital Blindness - Newswise - October 11th, 2022 [October 11th, 2022]
- Scientists Discover Protein Partners that Could Heal Heart Muscle | Newsroom - UNC Health and UNC School of Medicine - October 11th, 2022 [October 11th, 2022]
- The Pros and Cons of Lentiviral and Adeno-Associated Viral Vectors - The Medicine Maker - October 11th, 2022 [October 11th, 2022]
- Insights & Outcomes: Foreign DNA, quantum potholes and relapsing fever - Yale News - October 11th, 2022 [October 11th, 2022]
- Expediting IND applications with drug master files - BioPharma Dive - October 11th, 2022 [October 11th, 2022]
- UNC School of Medicine Awarded $3 Million to Lead Study to Reduce PTSD Frequency, Severity | Newsroom - UNC Health and UNC School of Medicine - October 11th, 2022 [October 11th, 2022]
- Lineage to Present at Alliance for Regenerative Medicine 2022 Cell & Gene Meeting on the Mesa - businesswire.com - October 8th, 2022 [October 8th, 2022]
- The Next Crispr Gene Editing IPO Could Be Near - Henry Herald - October 8th, 2022 [October 8th, 2022]
- 10-year CRISPR anniversary: How gene editing revolutionized medicine, and what lies ahead - Genetic Literacy Project - October 8th, 2022 [October 8th, 2022]
- Blood from a baby at birth can be gene sequenced to prevent diseases - USA TODAY - October 8th, 2022 [October 8th, 2022]
- What doctors wish patients knew about breast-cancer prevention - American Medical Association - October 8th, 2022 [October 8th, 2022]
- Growth in Cell and Gene Therapy Market - Pharmaceutical Technology Magazine - October 8th, 2022 [October 8th, 2022]
- Gene Editing Service Market 2022 : Top Players to Reflect Impressive Growth Rate till 2029: Caribou Biosciences, CRISPR Therapeutics, Merck KGaA,... - October 8th, 2022 [October 8th, 2022]
- Tip Sheet: $78 million to support new precision oncology institute, update on experimental gene therapy for herpes and the launch of Fred Hutch's new... - October 8th, 2022 [October 8th, 2022]
- Cell and Gene Therapy: Rewriting the Future of Medicine - Technology Networks - October 2nd, 2022 [October 2nd, 2022]
- Growth in Cell and Gene Therapy Market - BioPharm International - October 2nd, 2022 [October 2nd, 2022]
- CRISPR Therapeutics Announces FDA Regenerative Medicine Advanced Therapy (RMAT) Designation Granted to CTX130 for the Treatment of Cutaneous T-Cell... - October 2nd, 2022 [October 2nd, 2022]
- BioMarin Resubmits Biologics License Application (BLA) for Valoctocogene Roxaparvovec AAV Gene Therapy for Severe Hemophilia A to the FDA - PR... - October 2nd, 2022 [October 2nd, 2022]
- Fighting Breast and Ovarian Cancer With a Lupus Antibody - Yale School of Medicine - October 2nd, 2022 [October 2nd, 2022]
- This gene therapy company is testing new tech to 'switch off' diabetes and obesity with a pill - Euronews - October 2nd, 2022 [October 2nd, 2022]
- Tenaya Therapeutics to Participate in Inaugural Hypertrophic Cardiomyopathy Medical Societys 2022 Scientific Sessions - Yahoo Finance - October 2nd, 2022 [October 2nd, 2022]
- Risk of Alzheimer's dementia may be predicted with help of new tool Washington University School of Medicine in St. Louis - Washington University... - October 2nd, 2022 [October 2nd, 2022]
- Tiny Sea Creature's Genes Shed Light on Evolution of Immunity - UPMC - October 2nd, 2022 [October 2nd, 2022]
- Who will get the call from Stockholm? It's time for STAT's 2022 Nobel Prize predictions - STAT - October 2nd, 2022 [October 2nd, 2022]
- Excision BioTherapeutics Awarded California Institute for Regenerative Medicine (CIRM) Grant to Support Ongoing Phase 1/2 Trial Evaluating EBT-101 as... - October 2nd, 2022 [October 2nd, 2022]
- NeuroVoices: Emma Ciafaloni, MD, on the Vast Expansion of Innovative Approaches to Duchenne Muscular Dystrophy - Neurology Live - October 2nd, 2022 [October 2nd, 2022]
- COVID mRNA Jabs and Testing Kicked Off This Industry of Drug Development: Here's What You Need to Know - The Epoch Times - October 2nd, 2022 [October 2nd, 2022]
- Kidney resident macrophages have distinct subpopulations and occupy distinct microenvironments - University of Alabama at Birmingham - October 2nd, 2022 [October 2nd, 2022]
- Nobel Prize for medicine: the full list of winners - The National - October 2nd, 2022 [October 2nd, 2022]
- The surprising link between circadian disruption and cancer may have to do with temperature - EurekAlert - October 2nd, 2022 [October 2nd, 2022]
- The global live cell imaging market is expected to grow at a CAGR of 8.44% during 2022-2027 - Yahoo Finance - October 2nd, 2022 [October 2nd, 2022]
- Chroma Medicine Announces Formation of Scientific Advisory Board of Global Experts in Gene Editing and Cell and Gene Therapy - PR Newswire - September 20th, 2022 [September 20th, 2022]
- Ring Therapeutics Announces Issuance of U.S. Patent for its Anellovector Compositions - Yahoo Finance - September 20th, 2022 [September 20th, 2022]
- Cholesterol gene mutation: Why would a healthy 27-year-old have severe heart problems? - 69News WFMZ-TV - September 20th, 2022 [September 20th, 2022]
- Gene Therapy for Severe Hemophilia B Could Be More Cost Effective Than Current Treatments - Managed Healthcare Executive - September 20th, 2022 [September 20th, 2022]
- AVROBIO Receives Rare Pediatric Disease Designation from U.S. Food and Drug Administration (FDA) for First Gene Therapy in Development for Cystinosis... - September 20th, 2022 [September 20th, 2022]
- The Biggest CGT Breakthroughs Through the Eyes of Our 2022 Power List - The Medicine Maker - September 20th, 2022 [September 20th, 2022]
- Leading Virus Researcher to Chair UVA's Department of Microbiology, Immunology and Cancer Biology - UVA Health Newsroom - September 20th, 2022 [September 20th, 2022]
- Work remains on Tay-Sachs and other Ashkenazi genetic disorders J. - The Jewish News of Northern California - September 20th, 2022 [September 20th, 2022]
- Study Shows Genetic Link to Moving to the Beat of Music - Newswise - September 20th, 2022 [September 20th, 2022]
- Viewpoint: In the post Roe v Wade world, what changes should a biology textbook writer make to address the medical repercussions of Dobbs? - Genetic... - September 20th, 2022 [September 20th, 2022]
- Alnylam Receives Approval in Europe for AMVUTTRA (vutrisiran) for the Treatment of Hereditary Transthyretin-mediated (hATTR) Amyloidosis in Adult... - September 20th, 2022 [September 20th, 2022]
- CSL flexes gene therapy muscle with latest drug - Sydney Morning Herald - September 20th, 2022 [September 20th, 2022]
- The MIT Press releases new book on the science of the heart from cardiac expert Dr. Sian Harding - EurekAlert - September 20th, 2022 [September 20th, 2022]
- Global Pharmaceutical Contract Manufacturing Market is projected to reach a market value of US$329.7 Billion in 2032: Visiongain Reports Ltd - Yahoo... - September 20th, 2022 [September 20th, 2022]
- Alzheon Reports Industry-Leading Biomarker, Brain Preservation and Clinical Effects Following 12 Months of Treatment in Phase 2 Trial of Oral ALZ-801... - September 20th, 2022 [September 20th, 2022]
- Do You Have Lung Cancer With An EGFR Mutation? If So, The Drug Tagrisso Might Be Right For You Based On New Results From A 'Practice Changing' Trial -... - September 20th, 2022 [September 20th, 2022]
- Getting rid of unwanted transformed cells: Possible new directions in cancer therapy - EurekAlert - September 20th, 2022 [September 20th, 2022]
- Sven Kili on reconvening with the ISCT - The Medicine Maker - September 14th, 2022 [September 14th, 2022]