The announcement this week that a cheap, easy-to-make coronavirus vaccine appeared to be up to 90% effective was greeted with jubilation. “Get yourself a vaccaccino,” a British tabloid celebrated, noting that the vaccine, developed by AstraZeneca and the University of Oxford, costs less than a cup of coffee.
But since unveiling the preliminary results, AstraZeneca has acknowledged a key mistake in the vaccine dosage received by some study participants, adding to questions about whether the vaccine’s apparently spectacular efficacy will hold up under additional testing.
Scientists and industry experts said the error and a series of other irregularities and omissions in the way AstraZeneca initially disclosed the data have eroded their confidence in the reliability of the results.
Officials in the United States have noted that the results were not clear. The head of the flagship federal vaccine initiative suggested that the vaccine’s most promising results may not have reflected data from older people.
The upshot, the experts said, is that the odds of regulators in the United States and elsewhere quickly authorizing the emergency use of the AstraZeneca vaccine are declining, an unexpected setback in the global campaign to corral the devastating pandemic.
“I think that they have really damaged confidence in their whole development program,” said Geoffrey Porges, an analyst for the investment bank SVB Leerink.
Michele Meixell, a spokesperson for AstraZeneca, said the trials “were conducted to the highest standards.” After the error in the dosage was discovered, British regulators signed off on the plan to continue testing it in different doses, according to a statement that Meixell attributed to Oxford.
AstraZeneca was the third company this month to report encouraging early results on a coronavirus vaccine candidate. At first glance Monday morning, the results looked promising. Depending on the strength at which the doses were given, the vaccine appeared to be either 90% or 62% effective. The average efficacy, the developers said, was 70%.
Almost immediately, though, there were doubts about the data.
The regimen that appeared to be 90% effective was based on participants receiving a half dose of the vaccine followed a month later by a full dose; the less effective version involved a pair of full doses. AstraZeneca disclosed in its initial announcement that fewer than 2,800 participants received the smaller dosing regimen, compared with nearly 8,900 participants who received two full doses.
The biggest questions were, why was there such a large variation in the effectiveness of the vaccine at different doses, and why did a smaller dose appear to produce much better results? AstraZeneca and Oxford researchers said they did not know.
Crucial information was also missing. The company said that the early analysis was based on 131 symptomatic COVID-19 cases that had turned up in study participants. But it did not break down how many cases were found in each group of participants — those who received the half-strength initial dose, the regular-strength initial dose and the placebo.
“The press release raised more questions than it answered,” said John Moore, a professor of microbiology and immunology at Weill Cornell Medical College.
Adding to the confusion, AstraZeneca pooled the results from two differently designed clinical trials in Britain and Brazil, a break from standard practice in reporting the results of drug and vaccine trials.
“I just can’t figure out where all the information is coming from and how it’s combining together,” said Natalie Dean, a biostatistician and an expert in vaccine trial design at the University of Florida. She wrote on Twitter that AstraZeneca and Oxford “get a poor grade for transparency and rigor when it comes to the vaccine trial results they have reported.”
With AstraZeneca’s shares declining Monday, company executives held several private conference calls with industry analysts in which they disclosed details that were not in the public announcement, including how the COVID-19 cases broke down across different groups. Such disclosures to analysts are not uncommon in the industry, but they often generate criticism about why the details were not shared with the public.
Bigger problems soon surfaced.
An AstraZeneca executive told Reuters on Monday that the company had not intended for any participants to receive the half dose. British researchers running the trial there had meant to give the full dose initially to volunteers, but a miscalculation meant they were mistakenly given only a half dose. The executive, Menelas Pangalos, described the error as “serendipity,” allowing researchers to stumble onto a more promising dosing regimen.
To many outside experts, that undercut the credibility of the results because the closely calibrated clinical trials had not been designed to test how well a half-strength initial dose worked.
The company’s initial announcement didn’t mention the accidental nature of the discovery.
In the statement attributed to Oxford, Meixell, the AstraZeneca spokeswoman, said the error stemmed from an issue, which has since been fixed, with how some of the vaccine doses were manufactured.
Then, on Tuesday, Moncef Slaoui, the head of Operation Warp Speed, the U.S. initiative to fast-track coronavirus vaccines, noted another limitation in AstraZeneca’s data. On a call with reporters, he suggested that the participants who received the half-strength initial dose had been 55 years old or younger. Meixell declined to say whether that was the case, noting that the data would be published soon in a peer-reviewed journal.
If the initial half-strength dose wasn’t tested in older participants, who are especially vulnerable to COVID-19, it would undermine AstraZeneca’s case to regulators that the vaccine should be authorized for emergency use.
Stephanie Caccomo, a spokeswoman for the Food and Drug Administration, declined to comment on whether the dosing error would hurt the vaccine’s chances of being authorized. The FDA has said it expects vaccines to be at least 50% effective in preventing or reducing the severity of the disease, a bar that the vaccine appears to have cleared even in the group that got the two full doses.
AstraZeneca’s shares have fallen about 5% this week, while broader stock indexes have climbed to record highs. Investors seem to be disappointed with the murky results, especially compared with the much clearer data released by two of AstraZeneca’s chief rivals in the race for a coronavirus vaccine.
Pfizer and Moderna said this month that their vaccines, which use a technology known as “messenger RNA,” appear to be about 95% effective. Both offerings seem nearly certain to win emergency authorization from the FDA in the coming weeks.
The AstraZeneca vaccine, which uses a different approach involving a chimpanzee virus to provoke an immune response to the coronavirus, had all the hallmarks of a blockbuster.
It was inexpensive — only a few dollars per dose — and easy to mass-produce. Unlike Pfizer and Moderna’s vaccines, AstraZeneca’s could be stored for months in normal refrigerators. The company has estimated it will be able to produce some 3 billion doses next year, enough to vaccinate nearly one-fifth of the global population.
Compared to most of the other leading COVID-19 vaccine developers, AstraZeneca is inexperienced when it comes to vaccines. And even before the chaotic release of results, the company was under scrutiny for its handling of the testing process.
In September, AstraZeneca paused clinical trials worldwide after a participant fell ill — but the company didn’t promptly announce the decision publicly. AstraZeneca also came under fire for providing details about the nature of the illness on a private conference call with investors hosted by the investment bank J.P. Morgan, rather than disseminating the information to the public. Both of those developments were first reported by STAT, which covers health and science news.
Ever since the Oxford-AstraZeneca team emerged as front-runners in the race to develop a vaccine this spring, Prime Minister Boris Johnson of Britain has embraced the effort. The government preordered 100 million doses and cast the research as one of the country’s most important contributions to fighting the pandemic.
Basking in the results on Monday, Johnson said the vaccine “has the makings of a wonderful British scientific achievement.”
In the United States, which has ordered at least 300 million doses of AstraZeneca’s vaccine, the regulatory path forward is unclear. AstraZeneca was circumspect on Monday about its plans for seeking regulatory approval. The company said it would seek guidance from the Food and Drug Administration on whether it should formally submit its findings to apply for emergency authorization.
AstraZeneca has not been testing the promising half-strength initial dose in its ongoing U.S. trial. The company said it would work with the agency to add it as quickly as possible to that trial.
Scientists are also pressing the Oxford team to start a fresh, large-scale trial focused solely on determining whether the half-dose regimen was indeed more effective than the two standard doses.
“The only way they’re going to find out is by specifically and deliberately testing this serendipitous observation,” Moore said. “The onus is on them to prove the speculation.”
This article originally appeared in The New York Times.