scorecardresearch Skip to main content
IDEAS

Please tell us how much you liked this article

Customer service surveys are proliferating. But when anything less than five stars is considered failure, just how fair and meaningful is our feedback?

Adobe

Twenty-two years ago, when Joanne Chang opened Flour Bakery + Cafe in Boston’s South End, she installed a suggestion box, where she collected handwritten feedback. “I had a big bulletin board where I posted the suggestions and my responses,” she says. Today, the bakery has nine locations and Chang has a higher-tech version of her box: Through a third-party payment platform called LevelUp, a random sample of her customers receive a survey immediately after they’ve paid.

“As much as I cringe” when the comments are negative, she says, “I’m also kind of excited because I get to solve something. I get to figure out what the heck is going on.”

Advertisement



I called Chang to talk about feedback because I’ve felt overwhelmed by requests for it. These past few years, but particularly these past few months, I’ve been inundated with texts and emails and pop-ups from stores and gyms and restaurants asking for stars and smiles and upward-pointing thumbs. Surveys are coming to my phone seconds after I finish a workout, to the table while I’m still eating dessert, to my inbox when I’m still in the parking lot. “Overfishing,” says George Loewenstein, a professor of economics and psychology at Carnegie Mellon University, when I ask him about the surge.

But it’s not just the volume of these appeals that’s striking. Brands that once asked us to air our thoughts on social media (“Don’t forget to tag us!”) now assure us that our opinions “will never be shared publicly.” Stores that once wanted you to rate the sweater you bought now prefer that you rate the experience of buying the sweater. And everything, now, is “microfeedback,” a reaction based on a single workout, a single flight, a single mascara purchased online.

Is all of this really helping brands serve us better, as they say? Or is it serving them better — another way to be in constant touch, a way to surveil employees, even a way to capitalize on our loneliness? Where is all of this feedback going?

Advertisement




I like Chang’s story because it illustrates two things. One, it shows how feedback works when it’s working well, especially at a small business. Two, it helps explain why I’ve been asked for so much of it recently.

The LevelUp service that Flour uses is only one of the third-party payment platforms, including Square and Toast, that offer feedback features. As business on these platforms rises, so does the number of surveys sent. Toast, for example, launched Toast Guest Feedback in 2019, and this April roughly 30,000 restaurants used its feedback feature, according to a publicist for the company. All sellers on Square are automatically enrolled in Square Feedback, which sends a survey with every receipt, and “we’ve added a lot more sellers the last couple of years,” says Saumil Mehta, who heads the company’s point-of-sale team.

Mike Brucklier, director of operations at Flour Bakery, points out that COVID drove more businesses to use these kinds of online payment systems. And with more customers ordering online, he says, “we don’t get to see them as much. I’m sure it’s like this with everyone. Now, you have this other opportunity to reach out and get some feedback.”

Joanne Chang at the Flour Bakery on Clarendon Street in January 2020.David L. Ryan/Globe Staff/David L Ryan, Globe Staff

Chang and her team receive anywhere from 500 to 1,000 pieces of direct feedback a month. They read it all and reply to all quibbles, usually the same day. In April, when a woman complained that a cake she ordered didn’t have the same decorations as the one pictured on the ordering app, Chang could look at when and how the order was placed. “I reached out to our visual marketing director and I said, ‘Hey, Kate, you know, this guest was right,’” she says. “So we’re going to take another picture of the cake for when you order it on the app.” She also contacted the woman to give her a refund, something she couldn’t have done if the complaint had been left anonymously on a public forum like Yelp or Tripadvisor, she says.

Advertisement



Recently, Chang received a survey response from a customer who wanted a refund because she didn’t get the heel of bread that sometimes comes as a bonus with a salad order, depending on supply. “I just thought, I’m not going to refund you the whole thing because your free thing wasn’t included,” Chang says. “But then I had a second thought, which is: This guest is very upset.” Her husband and business partner, Christopher Myers, believes that the customer who complains is the best customer, because they’re telling you what they need. “Everybody else, we’re kind of guessing,” Chang says. She refunded the price of the salad.


Last August, Solidcore, a fitness studio with 81 locations nationwide, launched a feedback feature in its booking app. After every class, a pop-up prompt asks clients to rate the visit on a scale of 1 to 5 stars, right below the name and photo of the instructor. A team reviews the data in aggregate, says CEO Bryan Myers. If a class or coach is getting consistently low ratings, the head coach at that studio will sit in and give suggestions, he says.

Advertisement



In theory, aggregate survey scores can be a useful signal to a business that something is awry. “They allow you to see where things are deviating from the norm,” says Leela Srinivasan, chief marketing officer of checkout.com. BluePearl Specialty and Emergency Pet Hospital, a veterinary hospital with more than 100 locations nationwide, is a good example: It aggregates the 8,000 to 9,000 post-visit survey scores it gets every month to evaluate its prices and other aspects of its services, says BluePearl’s chief marketing officer, Joo Sangrene.

But when I’m evaluating a particular employee’s service — versus, say, the price of an X-ray — the precedent set by Uber, which has booted drivers off its platform for having an average of four stars, makes it feel churlish to leave any number that deviates from perfect.

If the score isn’t a five, it’s — “a problem?” Solidcore’s Myers says, finishing my thought.

“I do think it’s like that,” he continues. “Every experience should be five stars. And that’s what we should aim to be providing.” By now, he thinks, it’s become a social norm to say “I’m not gonna give anything less than a five unless something was really bad.” If someone left one of his coaches a four, it probably would signal a significant problem.

Advertisement



Customer feedback requests are commonly generated by payment systems such as Square, seen here in San Francisco in 2018.David Paul Morris/Bloomberg

In 2018, BuzzFeed News published a chilling article about how ratings can put employees at the mercy of fickle or downright hostile members of the public. Many servers said they had shifts cut after receiving low ratings on the survey provided by Ziosk, a pay-at-table tablet used in chain restaurants such as Olive Garden and Red Robin. Customers in many cases may be rating servers poorly because of situations out of their control, like a backed-up kitchen.

Loewenstein, at Carnegie Mellon, worries about feedback blowback. “I think these types of questions generally are for the purpose of improving service,” he says. But in some cases, “it is a little creepy, when you start to think that you’re performing this kind of monitoring, almost spying role.”


It’s also possible that some of these surveys are designed to manipulate us.

Pankaj Aggarwal, a professor of marketing at the University of Toronto, studies brand anthropomorphism, a phenomenon by which people start to see brands as human beings — and sometimes even feel less lonely after an interaction with a brand. (A fast-food brand that tweets as if it’s your funny friend is a good example.) Phrases such as “How’d we do?” are “subtly moving you towards humanizing the company,” Aggarwal says. “So it’s not a store anymore, it’s the people behind it, right?” You feel as if the brand is friendly; maybe you feel better about making another purchase. “Emotional loyalty,” he calls it.

What really matters in the end, says Srinivasan, of checkout.com, is that merchants act on the feedback they receive. “If you’re going to ask for it, it implies that you intend to listen to it and do something about it,” she says. Unfortunately, “the reality is that a lot of folks . . . are not good enough at looking at the feedback granularly enough to take those actions.”

In April, Srinivasan received a feedback email unlike any she had seen before, from Delta Air Lines. “Video feedback is one of the ways that we help to bring the experience of our customers to life,” it read and asked her to push a blue button with a video camera icon and record a few words about the most memorable part of her recent flight, “good or bad” (not to be shared publicly, the text promised her).

“Even for a feedback fan like me,” Srinivasan wrote in a LinkedIn message, “that’s a bit much.”

Marissa Conrad is a freelance journalist based in New York.