How many clinical-trial studies in medical journals are fake or fatally flawed? In October 2020, John Carlisle reported a startling estimate. Carlisle, an anaesthetist who works for England's National Health Service, is renowned for his ability to spot dodgy data in medical trials. He is also an editor at the journal Anaesthesia, and in 2017, he decided to scour all the manuscripts he handled that reported a randomized controlled trial (RCT) " the gold standard of medical research. Over three years, he scrutinized more than 500 studies. For more than 150 trials, Carlisle got access to anonymized individual participant data (IPD). By studying the IPD spreadsheets, he judged that 44% of these trials contained at least some flawed data: impossible statistics, incorrect calculations or duplicated numbers or figures, for instance. And 26% of the papers had problems that were so widespread that the trial was impossible to trust, he judged " either because the authors were incompetent, or because they had faked the data. Carlisle called these 'zombie' trials. Even he was surprised by their prevalence. "I anticipated maybe one in ten," he says. The issue is, in part, a subset of the notorious paper-mill problem: over the past decade, journals in many fields have published tens of thousands of suspected fake papers, some of which are thought to have been produced by third-party firms, termed paper mills. "It ... has the potential to amplify a wrong result, suggesting that treatments work when they don't," he says.
Latest
Latest News
Each news summary is created according to strict standards. Here's how we do it.
Each summary is created using a consistent editorial procedure. The target length is approximately 16 lines of 11-point Arial text in a 650-pixel-wide column. Up to 25% of a summary may be set in bold to emphasize the most important ideas. Summaries are composed of verbatim excerpts presented in the same sequence as they appear in the original news source, with very minor editorial additions. Where material has been omitted between excerpts, the omission is indicated with ellipses (...). Any words added by an editor for clarity or context appear in [brackets]. Our original news editor was Fred Burks. Tod Fletcher edited most summaries from 2007 through 2014, and Mark Bailey has served as news editor since 2014.