If we had a great stroke association with a fully functioning database of all stroke trials and their results we would know immediately when results should be available. Then the president of that great stroke association could do their job and get the results published. THIS IS WHY WE NEED SURVIVORS IN CHARGE. Existing stroke leadership is a complete fucking failure, see here for why I say that; 13 stroke problems with no cure
FDA and NIH let clinical trial sponsors keep results secret and break the law
For 20 years, the U.S. government has urged companies, universities,
and other institutions that conduct clinical trials to record their
results in a federal database, so doctors and patients can see whether
new treatments are safe and effective. Few trial sponsors have
consistently done so, even after a 2007 law made posting mandatory for
many trials registered in the database. In 2017, the National Institutes
of Health (NIH) and the Food and Drug Administration (FDA) tried again,
enacting a long-awaited “final rule” to clarify the law’s expectations
and penalties for failing to disclose trial results. The rule took full
effect 2 years ago, on 18 January 2018, giving trial sponsors ample time
to comply. But a Science investigation shows that many still ignore the requirement, while federal officials do little or nothing to enforce the law.
Science examined more than 4700 trials whose results should
have been posted on the NIH website ClinicalTrials.gov under the 2017
rule. Reporting rates by most large pharmaceutical companies and some
universities have improved sharply, but performance by many other trial
sponsors—including, ironically, NIH itself—was lackluster. Those
sponsors, typically either the institution conducting a trial or its
funder, must deposit results and other data within 1 year of completing a
trial. But of 184 sponsor organizations with at least five trials due
as of 25 September 2019, 30 companies, universities, or medical centers never met a single deadline.
As of that date, those habitual violators had failed to report any
results for 67% of their trials and averaged 268 days late for those and
all trials that missed their deadlines. They included such eminent
institutions as the Harvard University–affiliated Boston Children’s
Hospital, the University of Minnesota, and Baylor College of
Medicine—all among the top 50 recipients of NIH grants in 2019.The violations cover trials in virtually all fields of medicine, and the missing or late results offer potentially vital information for the most desperate patients. For example, in one long-overdue trial, researchers compared the efficacy of different chemotherapy regimens in 200 patients with advanced lymphoma; another—nearly 2 years late—tests immunotherapy against conventional chemotherapy in about 600 people with late-stage lung cancer.
Other leading NIH grantees did only slightly better in Science’s analysis based on data collected from the TrialsTracker website of the University of Oxford, which automatically mines information from ClinicalTrials.gov. The University of Texas MD Anderson Cancer Center and the Mayo Clinic both failed to report results on time, or at all, in about two-thirds of their trials. Yale University failed to do so in 84% of its trials. NIH’s own institutes also had a bad record. They are directly responsible for reporting results when they sponsor studies done by agency staff or some grantees, and the top four NIH institute sponsors, taken together, reported results late or not at all in more than six of every 10 trials Science looked at.
Contacted for comment, none of the institutions disputed the findings of this investigation. In all 4768 trials Science checked, sponsors violated the reporting law more than 55% of the time. And in hundreds of cases where the sponsors got credit for reporting trial results, they have yet to be publicly posted because of quality lapses flagged by ClinicalTrials.gov staff (see sidebar).
Although the 2017 rule, and officials’ statements at the time, promised aggressive enforcement and stiff penalties, neither NIH nor FDA has cracked down. FDA now says it won’t brandish its big stick—penalties of up to $12,103 a day for failing to report a trial’s results—until after the agency issues further “guidance” on how it will exercise that power. It has not set a date. NIH said at a 2016 briefing on the final rule that it would cut off grants to those who ignore the trial reporting requirements, as authorized in the 2007 law, but so far has not done so.
Missed deadlines
(GRAPHIC) N. DESAI/SCIENCE; (DATA) CLINICALTRIALS.GOV, VIA TRIALSTRACKER
Deborah Zarin, a physician at Brigham and Women’s Hospital and Harvard who headed ClinicalTrials.gov between 2005 and 2018, says the Science findings show failures of the research culture, FDA, and NIH. “If this was a priority for the leadership of NIH, then they could ensure that high-quality, timely reporting happened all of the time,” says Zarin, an NIH-paid research consultant for the database. “You can set up processes so trial reporting is an expectation. You can’t pass ‘go’ and collect $200 until this is done.”
Zarin, who works in a program to advance clinical research, adds that the problem persists because “reporting to ClinicalTrials.gov is frequently seen by sponsors, funders, and trialists as an annoying administrative and perhaps legal burden, not a scientific imperative. Human nature being what it is, people follow the requirements when forced to do so.”
NIH and FDA officials do not seem inclined to apply that pressure. Lyric Jorgenson, NIH deputy director for science policy, says her agency has been “trying to change the culture of how clinical trial results are reported and disseminated; not so much on the ‘aha, we caught you,’ as much as getting people to understand the value, and making it as easy as possible to share and disseminate results.” To that end, she says, ClinicalTrials.gov staff have educated researchers about the website and improved its usability.
As for FDA, Patrick McNeilly, an official at the agency who handles trial enforcement matters, recently told an industry conference session on ClinicalTrials.gov that “FDA has limited resources, and we encourage voluntary compliance.” He said the agency also reviews reporting of information on ClinicalTrials.gov as part of inspections of trial sites, or when it receives complaints.
McNeilly declined an interview request, but at the conference he discounted violations of ClinicalTrials.gov reporting requirements found by journalists and watchdog groups. “We’re not going to blanketly accept an entire list of trials that people say are noncompliant,” he said. Such determinations require “nonpublic information” submitted to the agency by trial sponsors. In response to Science’s findings, a spokesperson said an absence of posted results on ClinicalTrials.gov did not mean a trial sponsor has broken the 2007 law.
Yet that law and the 2017 final rule detail only a few exemptions that would allow trial sponsors to withhold results on the basis of nonpublic information. The very few registered trials that qualify for those exemptions are not flagged as violators by TrialsTracker or in Science’s analysis.
Congress approved the creation of ClinicalTrials.gov in 1997, after allegations that patients were harmed because companies withheld evidence showing their medicines were ineffective or hazardous. A widely cited case involved the GlaxoSmithKline antidepressant Paxil (paroxetine). According to legal filings and a report in The BMJ, the firm held secret data showing that in clinical trials the drug was ineffective and caused suicidal thoughts in teenagers, yet encouraged doctors to prescribe it for young people.
Related content
Yet until 2015, even the most active investigators at clinical research institutions treated the law more as a suggestion—not surprising given that the government enforced no penalties and did not publicly identify violators. A report on the news website STAT by this author and Talia Bronshtein first drew significant attention to specific trial sponsors—companies, government agencies, universities, and individuals—that routinely ignored reporting requirements. It sparked immediate improvement, according to NIH. (Those same authors documented some of that improvement in a 2018 STAT article.)
At a 2016 press briefing, NIH and FDA rolled out the final rule, aimed at boosting even greater compliance with the 2007 law. It took effect in January 2017, with first deadlines for results, and ostensibly enforcement, 1 year later. Then–FDA Commissioner Robert Califf said it would thereafter “be pretty hard to hide that you are doing a clinical trial or hide the result.” FDA, he vowed, was finally prepared, if necessary, to enforce the daily $10,000 penalty for noncompliance allowed under the law. (Adjusted for inflation, that figure recently rose above $12,000.)
“I don’t think anybody wants to be on the wall of shame,” NIH Director Francis Collins said at the press event, promising that NIH would publicly flag reporting violations on ClinicalTrials.gov itself.
“We are serious about this,” Collins said, threatening for the first time to enforce provisions of the 2007 law that allow NIH to rescind funding to grantees who violate the statute. “It’s hard to herd cats, but you can … take their food away,” he said. “This is about maintaining the trust that we have with participants in clinical trials. … If we fail to live up to that expectation, then that is an ethical failure.”
Three years later, TrialsTracker conservatively estimates that FDA could have collected more than $6 billion in ClinicalTrials.gov penalties so far. The agency has yet to demand a single dollar. And despite more than 2600 trials for which results are overdue or were filed late, NIH has yet to withhold a single grant as a result or post a single violation notice on ClinicalTrials.gov. No “wall of shame” exists.
“Public-facing websites run by the government should be accurate. That’s not asking much,” Senator Chuck Grassley (R–IA), who advocated for the 2007 law, wrote in an email after reviewing a summary of the Science findings. “It’s a question of basic management and agency competence. The government has a duty to police its work product, especially because the public trusts .gov websites will be accurate and reliable.”
To physician Ben Goldacre, who directs the Oxford program behind TrialsTracker, “The lack of urgency is really troubling.”
Reporting problems
(GRAPHIC) N. DESAI/SCIENCE; (DATA) CLINICALTRIALS.GOV, VIA TRIALSTRACKER
Stephen Hahn, who served as chief medical officer at MD Anderson until last month, when he became the new FDA commissioner, was unavailable for comment. An MD Anderson spokesperson said the center “believes in transparency,” and is making “every effort to comply” with trial reporting rules, but did not respond to a question on the missing cancer trial data.
Mayo, Yale, the University of Minnesota, Baylor, and Boston Children’s, which have similarly poor reporting records, all said via email that they, too, were committed to fulfilling ClinicalTrials.gov requirements. Mayo said it deployed dedicated staff to assist researchers. Yale noted it had registered hundreds of trials exempt from reporting requirements and added a layer of review to help ensure compliance. The University of Minnesota recently created a monitoring system and has made rapid progress on reporting, according to a spokesperson. Baylor said it planned to centralize trial monitoring, as “a top priority.” Boston Children’s said it was “committed to achieving 100% compliance.” It submitted data for one long-overdue study after being contacted by Science, but four others remain in apparent violation as of the end of 2019.
The slow, apparently forgiving regulatory approach favored by NIH and FDA will never force such organizations into full compliance, some advocates of clinical trial transparency say. “In an era when every restaurant is obliged to publish on its front door the hygiene rating in their kitchen, we’re seriously not saying whether a trial that costs millions of dollars has broken the law and its obligation to … patient participants by failing to report its results?” Goldacre asks. “That seems like extraordinary special treatment for clinical trialists.”
Select institutions have made serious efforts to comply. Twenty big pharma companies met all reporting requirements under the 2017 rule and some major academic centers improved sharply compared with data collected in 2017 (as detailed in the second STAT investigation). Memorial Sloan Kettering Cancer Center, Duke University, and Johns Hopkins University—poor performers in 2017—complied with the law in nearly all their registered trials covered by the new rule. Johns Hopkins added staff to track and assist on reporting and to identify “problem records.” And it enlisted university executives to crack down on recalcitrant investigators, according to Anthony Keyes, a clinical research manager there.
But such good performance shouldn’t be an exception, Harvard's Zarin says. “Further public accountability of the trialists, but also our government organizations, has to happen. One possibility is that FDA and NIH will be shamed into enforcing the law. Another possibility is that sponsors will be shamed into doing a better job. A third possibility is that ClinicalTrials.gov will never fully achieve its vital aspirations.”
This story was supported by the Science Fund for Investigative Reporting.
No comments:
Post a Comment