Share article
Let me admit something that puzzled me for a long time. I was working on a project where the company was collecting customer feedback systematically. The sample sizes were solid, the surveys were well designed, and the results consistently showed satisfaction above 80%. Yet customers were leaving. Churn was high, and complaints were coming in through other channels. Something didn’t add up.
The problem wasn’t the customers. It was the nature of surveys themselves.
Customers don’t lie on purpose. But they systematically distort reality, and from a CX (customer experience) perspective, that’s almost as dangerous as having no data at all.
Social desirability
Psychologists described this phenomenon decades ago. Social desirability bias is the tendency to answer in a way that feels socially acceptable or desirable, regardless of what we actually think.
In customer satisfaction surveys, it plays out like this: a customer receives a survey from a brand they’ve just bought from or dealt with. What’s the natural reaction? A sense of gratitude, perhaps even implicit pressure. Criticism feels inappropriate. So they tick “satisfied” or leave a neutral comment, even if the interaction was average or downright unpleasant.
Research by Todd Donovan and Tom Smith of the University of Chicago, published in Public Opinion Quarterly in 1992, showed that social desirability systematically skews survey responses even when respondents are guaranteed anonymity. Later work, such as the meta-analysis by Richard Holbrook and colleagues (2003, Public Opinion Quarterly), confirmed that the effect is consistent and hard to eliminate through standard methods.
In a CX context, this means one thing: NPS (Net Promoter Score) and CSAT (Customer Satisfaction Score) are systematically higher than they should be. Customers don’t want to be “the one who gives a low score”. The result is a feedback programme that looks healthy on paper and a company that has no idea where the shoe is actually pinching.
Survey fatigue
The second mechanism is less psychological and more situational. Survey fatigue is a well-documented phenomenon where respondents either ignore surveys altogether or fill them in carelessly.
The data here is consistent across studies. A 2021 study by Medallia found that the average response rate for customer surveys had dropped below 10% on digital channels. SurveyMonkey’s Industry Benchmarks report puts the average completion rate somewhere between 20% and 30%, with every extra question dragging that number down.
Companies that send surveys constantly after every interaction, every purchase, every support call are effectively training their customers to ignore them. And the people who do fill the surveys in are a heavily skewed group: either very happy or very unhappy. The quiet middle stays silent.
Research by Professor Floris Vlietnaj at Erasmus University Rotterdam on nonresponse bias in customer surveys showed that the group of people who complete surveys differs systematically from those who don’t precisely along the dimensions of satisfaction and loyalty. In other words, surveys tell you what the responders think. Not what the people who matter think.
Fear of negative feedback: not wanting to hurt a real person
This mechanism gets the least airtime, yet it fascinates me the most, because it’s the most human of the three.
A customer has just dealt with a specific support agent. They were friendly and tried hard, even if the problem didn’t get solved. Then the survey arrives: “How would you rate this interaction?” The customer senses, or knows outright, that their answer will affect that person’s performance review. So they tick a higher number than they otherwise would.
This isn’t speculation. A study by Matthew Dixon and colleagues from the Corporate Executive Board (now Gartner), published in the Harvard Business Review in 2010, which introduced the Customer Effort Score (CES), also examined how customers think about the consequences of their ratings. Dixon and his co-authors repeatedly point out that customers see feedback as an interpersonal act, not just anonymous data.
In practice, this means CSAT scores in customer service are consistently higher than the actual quality of service would warrant. Companies know this and choose to ignore it, because “the numbers look good”.
So what can you do? Three ways to push back.
This is the part I want to spend the most time on, because anyone can describe the problem. Solving it is harder.
Triangulate your data. The most important lesson I’ve learned over the years is never to trust a single data source. Surveys are useful as one input, alongside behavioural data (clickstream, uplift, churn, repeat purchases), CRM data, customer service contact analysis and, where possible, ethnographic research or in-depth interviews. Behavioural data doesn’t lie, because the customer isn’t filling it in. They’re doing something, or not doing it, and that reveals far more than a questionnaire ever could.
Forrester’s Customer Experience Index report has long shown that the highest-performing CX companies combine quantitative surveys with behavioural data in roughly a 50/50 split.
Anonymity and survey context. The research on social desirability is clear: anonymity reduces bias but doesn’t eliminate it. Context is crucial. A survey sent immediately after an interaction with a specific agent produces very different answers than one sent 48 hours later or in a neutral setting. A small design decision has a big impact on data quality.
The wording of questions matters just as much. Work by Norbert Schwarz at the University of Southern California on the cognitive side of survey response shows that customers answer differently depending on whether questions are framed positively (“How satisfied were you?”) or neutrally (“What aspects could have been better?”). Leaving room for negatives is an underrated technique.
Shorter surveys, selective frequency. The best survey is the one a customer actually completes, and completes thoughtfully. One well-crafted survey with three questions, sent at the right moment in the customer journey, will give you more reliable data than a twenty-question form after every transaction.
Qualtrics, in its 2022 customer feedback benchmark, found that surveys with no more than five questions had 40% higher completion rates than those with ten or more, while producing data of comparable or even higher quality.
In conclusion: the problem isn’t the customer
The data on this is consistent. Customers systematically say one thing in surveys and do another. But the fault isn’t theirs.
The problem is ours, as CX professionals. We design surveys that, by their very nature, invite socially desirable answers. We send too many of them. We ask questions at moments when the customer feels an invisible pressure to say “good”. And then we wonder why the numbers say everything is fine while customers walk out the door.
Feedback is enormously valuable. But only when we know what we’re actually measuring and where the limits of trusting those numbers lie.
