WASHINGTON — The Census Bureau, the authoritative source of health insurance data for more than three decades, is changing its annual survey so thoroughly that it will be difficult to measure the effects of President Obama’s health care law in the next report, due this fall, Census officials said.
The changes are intended to improve the accuracy of the survey, being conducted this month in interviews with tens of thousands of households around the country. But the new questions are so different that the findings will not be comparable, the officials said.
An internal Census Bureau document said that the new questionnaire included a “total revision to health insurance questions” and, in a test last year, produced lower estimates of the uninsured. Thus, officials said, it will be difficult to say how much of any change is attributable to the Affordable Care Act and how much to the use of a new survey instrument.
“We are expecting much lower numbers just because of the questions and how they are asked,” said Brett J. O’Hara, chief of the health statistics branch at the Census Bureau.
A major goal of the law is to increase the number of people with health insurance. The White House reported that 7.5 million people signed up for private health plans on the new insurance exchanges and that enrollment in Medicaid increased by 3 million since October. But the administration has been unable to say how many of the people gaining coverage were previously uninsured or had policies canceled, so the net increase in coverage is unclear.
Health policy analysts and politicians had been assuming that the Census Bureau would help answer those questions when it issued its report on income, poverty, and health insurance, based on the Current Population Survey. The annual report shows the number of people with various kinds of health insurance and the number of uninsured for the nation and for each state.
Several recent private polls, including one by the Gallup organization, suggest that the number of uninsured is declining, because of the Affordable Care Act and improvements in the economy.
Census officials and researchers have long expressed concerns about the old version of insurance questions in the Current Population Survey.
The questionnaire traditionally used by the Census Bureau provides an “inflated estimate of the uninsured” and is prone to “measurement errors,” said a working paper by statisticians and demographers at the agency.
In the test last year, the percentage of people without health insurance was 10.6 percent when interviewers used the new questionnaire, compared with 12.5 percent using the old version. Researchers said that they had found a similar pattern in the data for different age, race, and ethnic groups.
In addition, “the percentage of people with private coverage was statistically higher” when the bureau tested the new questionnaire, the working paper said. For reasons that are not clear, people were less likely to respond when interviewers used the new questionnaire.
Another Census Bureau paper said “it is coincidental and unfortunate timing” that the survey was overhauled just before major provisions of the health care law took effect. “Ideally,” it said, “the redesign would have had at least a few years to gather base line and trend data.”
The old questionnaire asked consumers if they had various types of coverage at any time in the prior year. The new survey asks if they have insurance at the time of the interview — in February, March, or April — then uses follow-up questions to find out when that coverage began and what months it was in effect. Using this technique, Census officials believe they will be able to reconstruct the history of coverage month by month, over a period of about 15 months, for each person in a household.
However, O’Hara said the agency was not planning to release coverage data from early this year in its next report. Agency officials want to assess the reliability of the monthly data, being collected this year for the first time.
The White House is always looking for evidence to show the benefits of the health law, which is an issue in many of this year’s midterm elections. The Department of Health and Human Services and the White House Council of Economic Advisers requested several of the new questions, and the White House Office of Management and Budget approved the new questionnaire. But the decision to make fundamental changes in the survey was driven by technical experts at the Census Bureau.