Next Score View the next score

    Medicare considers using stars to rate hospitals

    Critics say the plan will draw distinctions where there are none


    Star wars may be coming to a hospital near you.

    Medicare is considering assigning stars or some other symbol to hospitals so patients can more easily compare the quality of care at various institutions. The ratings would appear on Medicare’s Hospital Compare website and be based on many of the 100 quality measures the agency already publishes.

    The proposal comes as Medicare confronts a paradox: Although the number of ways to measure hospital performance is increasing, those factors are becoming harder for patients to understand. Hospital Compare publishes a wide variety of details about medical centers, including death rates, patient views about how well doctors communicate, infection rates for colon surgery and hysterectomies, emergency room efficiency, and overuse of CT scans.


    In its proposed rules for hospitals in the fiscal year starting Oct. 1, the federal Centers for Medicare & Medicaid Services solicited ideas about “how we may better display this information.” One possibility, the agency said, is to use star ratings, with more stars indicating higher quality.

    Get Talking Points in your inbox:
    An afternoon recap of the day’s most important business news, delivered weekdays.
    Thank you for signing up! Sign up for more newsletters here

    Private groups such as Consumer Reports, the Leapfrog Group, and US News and World Report issue hospital guides that boil down the disparate Medicare scores — along with their own proprietary formulas — to come up with numeric scores, letter grades, or rankings.

    But even before it’s formally proposed, the possibility of the government rating hospitals based on a star system is prompting criticism. In a letter to Medicare, the Association of American Medical Colleges said it “strongly opposes the use of a star rating system, which may make inappropriate distinctions for hospitals whose performance is not statistically different. A star rating system can also exaggerate minor performance differences on measures.”

    In a statement, Medicare defended the idea. “Visual cues can be an important way to help patients understand how their hospital measures up to others,” it said, adding that the government is interested in hearing from people about “user-friendly, creative designs for a rating system to help patients get information so they can take an active role in their care.”

    Peter Slavin, president of Massachusetts General Hospital, said making medical care standards more comprehensible is an admirable pursuit, but a worthwhile hospital ranking system would need to be based on more sophisticated underlying data than what’s now available.


    “The quality information we’re now using in health care is pretty crude and needs to get a lot better,” Slavin said.

    Much of that data is derived from the bills hospitals submit to Medicare, which he said is “a lot like judging the quality of a restaurant from the checks they give to their customers.”

    Slavin questioned whether star ratings would be useful for patients seeking specific services, such as a lung transplant, which Medicare does not evaluate.

    “At some point if you oversimplify things, you’re not providing people with information that is all that meaningful or helpful,” he said.

    Robert Berenson, a health policy researcher at the Urban Institute in Washington, D.C., also wondered whether there is enough solid information about medical care quality available to make a star rating system effective.


    “I recognize the appeal of making things easy for consumers by giving stars, but I don’t think the data is robust enough and valid enough,” Berenson said. “There are important gaps in what’s measurable.”

    Private groups have come up with opposing judgments on the same hospitals.

    But Tanya Alteras, deputy director of the advocacy group Consumer-Purchaser Disclosure Project, was more enthusiastic about a star system. “If it’s tested with consumers and shown to be useful, we are definitely in favor it,” she said.

    Medicare already uses a five-star system to rate the private Medicare Advantage health insurance plans. A quarter of US seniors get their insurance from these private insurers, which Medicare helps fund, instead of through traditional Medicare, which pays hospitals, doctors, and other providers directly for medical services. But applying such a system to hospital quality could be challenging. Private groups have come up with opposing judgments on the same hospitals. For instance, hospitals given an “A” in patient safety by Leapfrog can end up at the bottom of Consumer Reports’ rankings because of differences in their analyses.

    And even Medicare’s current evaluations of hospital care and services don’t always lead to consistent overall conclusions. Medicare rates Beth Israel Deaconess Medical Center in Boston as above average nationally in keeping heart attack, heart failure, and pneumonia patients from dying, but below average in readmissions and the frequency of collapsed lungs and accidental cuts and tears during treatments.

    Beth Israel declined comment for this story.

    Also, Medicare’s current quality evaluations using statistical tests end up concluding most hospitals are indistinguishable from one another on major performance measures such as death rates. On Hospital Compare, 9 out of 10 hospitals’ mortality rates are described as “average.” That kind of narrow range doesn’t lend itself to a star system, said Leapfrog executive director Leah Binder.

    “If their plan is to give the same number of stars to all the hospitals, at best it will be boring,” Binder said. “At worst it will be misleading.”

    Kaiser Health News is an editorially independent program of the Henry J. Kaiser Family Foundation, a nonprofit, nonpartisan health policy research and communication organization not affiliated with Kaiser Permanente.