Jack Andrews and his wife no longer enjoy date night, their once-a-month outing to the movies and a steak dinner at Logan’s Roadhouse in Augusta, Ga. In Harlem, Eddie Phillips’s life insurance payment will have to wait a few more weeks. And Jessica Price is buying cheaper food near her home in Orlando, though she worries it may not be as healthy.

Like millions of other Americans, they are feeling the bite from the sharp increase in payroll taxes that took effect at the beginning of January. There are growing signs that the broader economy is suffering, too.