When it comes to employee surveys, many organizations assume anonymous surveys are the best way to get honest, accurate feedback because anonymity feels like the safest option. That’s not always the case. It’s important to know the different types of surveys and what each one communicates to employees. This blog unpacks the reasons why anonymous surveys are not always the best option and how you can use other types of surveys to your advantage.
Three reasons anonymous employee surveys may not deliver accurate insights.
Many organizations like to use anonymous surveys thinking they will get a better response rate and more candid feedback. There are exceptions. Here’s why:
1. Even with anonymous surveys, perceived privacy risks still exist.
Because anonymous surveys aren’t linked to identifiable employee data, employees must self-report demographic information if their employer asks. For example, you’ll likely ask them for their department, job title or age group. Privacy safeguards alone may not ensure an optimal user experience, and some employees may still be reluctant to share personal information, which can reduce survey response rates. In a small department, even this information might be self-identifying. Suppose there are just two members of a group who are under 25—it will be pretty clear who the feedback is coming from. This can scare employees into giving less than candid responses. However, to protect anonymity, some third-party administrators, like TINYpulse, don’t display an individual’s feedback when a team comprises fewer than five members or when fewer than five responses have been recorded.
2. Anonymous responses may lead to more criticism than critiques.
Anonymity often encourages candid feedback, but it can also produce blunt criticism rather than constructive critique. Such comments may feel personal or directed at an individual or team. Constructive critiques that explain the problem and suggest solutions, by contrast, are far more likely to drive meaningful improvements. At the same time, anonymity can surface important concerns that would otherwise go unreported; thoughtful prompts and follow-up (for example, asking for examples, the impact and potential solutions) can help turn those raw concerns into actionable insights.
Here are some sample responses to a survey question about caregiving support:
Criticism: “My supervisor doesn’t know what’s going on, and I feel lost. HR never gives us the right information and none of it makes sense. We need better leadership that understands our needs as parents.”
Critique: “I need better information about the types of leave I can use when I take time off to care for a sick child.”
Critiques reveal the problem and what to change; criticism reveals who’s blamed but not the solution. In this case, both point to parental support as an issue, but only the critique describes the employee’s needs.
3. It’s difficult to follow up with an anonymous survey.
When you receive feedback from an anonymous survey, it’s difficult to follow up with a specific respondent or group of respondents. Unless you’re using a third-party administrator like TINYpulse—which offers private messaging—you don’t get the chance to provide context and seek clarity.
While anonymous surveys involve trade‑offs, they can still be valuable in the right contexts. In low‑trust environments, anonymous surveys can help people feel safe enough to share honest feedback. To make them effective, don’t collect information that could identify respondents, consider using an independent third party to run the survey, only report results when enough people have responded and clearly explain to employees how their anonymity is being protected.
There is one exception to the above reasons for not using anonymous surveys. And that’s if you’re asking personal or sensitive questions—such as those about health or well‑being. In this case, anonymous surveys may be appropriate. Be sure to tell employees that responses are anonymous and cannot be linked to individuals.
Two other types of employee surveys to consider.
In addition to anonymous surveys, confidential employee surveys and visible employee surveys (non-anonymous) are important to consider. I’ll dive into what each of these surveys are, their benefits and how to determine which type of survey to use.
Confidential employee surveys.
Confidential employee surveys offer a degree of privacy because identifying information is accessible only to a small, authorized group within the organization.
Benefits of using confidential employee surveys include:
- More thoughtful, actionable feedback. Because responses are linked to employee records rather than entirely anonymous, employees often feel a greater sense of ownership and take more care with their answers. That typically produces richer, more constructive feedback.
- More accurate demographic and subgroup data. Linking responses to employee data eliminates reliance on self‑reported demographics, improving the completeness and usability of your data. This also reduces time spent on demographic questions and cleaning and reconciling datasets during analysis.
When to use a confidential employee survey.
Use confidential surveys when accuracy is essential, and you need to analyze results by employee group, department or business unit. They’re particularly appropriate for large initiatives, such as annual engagement surveys.
Confidential surveys are also well suited to needs assessments: responses provide richer data for deeper analysis, make it easier to follow up with subgroups for clarification or additional detail, and enable more targeted interventions.
Tips for introducing confidential surveys to your employees.
Trust is key. Here are five tips to get your employees more comfortable with a confidential survey.
- Word questions carefully. Anonymous surveys are useful for sensitive topics, but you can also ask them on confidential surveys if you choose your wording carefully. For example, in a retention survey employees may fear that admitting actions like interviewing elsewhere could harm their standing. Asking about attitudes rather than specific behaviors reduces defensiveness while still revealing useful signals.
Original: In the past two months, have you interviewed for another job?
The response options can include yes, no and prefer not to answer.
Updated: How likely are you to look for a new job in the next 6 months? Or, To what extent have you thought about leaving the organization?
By asking about attitudes instead of specific actions, the revised question feels less risky to respondents and makes them more likely to answer honestly in a confidential setting.
- Communicate how confidential surveys work. Say exactly what “confidential” means here (e.g., responses are linked to employee records but only accessible to a small, authorized group) and how that differs from “anonymous.” Your employees will likely be most concerned with whether their supervisor will be able to see their responses. Reassure employees about who will have access to the information and why.
- Use a third-party survey provider to ensure results remain truly confidential. Employees may be hesitant to take a confidential survey if it’s administered internally. Using a solution from a third-party provider can help put them at ease.
With a third-party provider like TINYpulse, reviewers within the company see only aggregated results, while access to raw, identifiable responses is limited to a small, designated group (for example, agreed‑upon super‑admins such as the CEO or head of HR and the vendor). Clearly communicating who has access, how the data is protected and the reporting thresholds you’ll use (for example, no subgroup reporting for groups smaller than five) will help employees feel more comfortable responding.
- Explain how data is protected. Whether you use a third-party survey provider or administer your own survey, employees need to know their responses are secure. Make sure to explain the mechanisms you’re using to ensure confidentiality.
Visible employee surveys (non-anonymous).
Visible employee surveys aren’t anonymous or confidential. Rather, the survey administrator can see the names associated with the responses.
When to use a visible employee survey.
Visible employee surveys are most effective in high-trust environments and when you need to follow up with individuals for clarification, coaching or participation in non-survey activities (e.g., interviews or focus groups). Even so, avoid using visible employee surveys for sensitive topics—like mental health or personal matters.
Tips for introducing a visible survey to your employees.
- Be explicit about visibility. Clearly state that responses will be identifiable and explain who will see them.
- Offer alternatives. Provide anonymous or confidential options (e.g., an anonymous form, a third‑party survey, or an ombudsperson) for those who do not feel comfortable.
- Provide a “prefer not to answer” option on sensitive items and keep the survey as concise as possible.
Find the right mix of employee surveys.
There is no one “best” type of employee survey. The survey you choose should be based on that matches your objectives, the feedback you need and the action you plan to take. By choosing the right type of survey for each occasion, you make it easier for employees to provide honest feedback. In turn, you’re able to get better insights that can help you understand what employees need to feel seen and valued.
TINYpulse by WebMD Health Services is an innovative employee feedback and engagement software solution that can help you create the right survey strategy. We empower companies globally to not only measure but also enhance company culture, boost employee retention and elevate performance by ensuring you’re listening to your people.
To learn more about how TINYpulse can help your organization increase engagement and prioritize the well-being and success of every individual in your organization, request a demo today.