Statistics Quest

Applied case · HR · about 60 minutes

Can we trust the engagement survey?

Check response rates and response quality, summarise Likert items properly, and correct an engagement headline for nonresponse bias with post-stratification weights.

The brief

Palmstone Group (a fictional services company, 1,400 employees in six departments) runs an annual engagement survey. The executive committee set a target: at least 50% of employees “proud to work here” (agree or strongly agree with item q1). The draft report says 50.5% — target met, and the CEO plans to announce it at the town hall.

The HR director is uneasy: only 56% of staff responded, and response rates differed a lot by department. She asks you to check, before the announcement:

  1. how representative the respondents are, and whether any responses are low quality;
  2. how the Likert items should be summarised;
  3. what the headline would be if each department counted in proportion to its real size;
  4. what the CEO can honestly say.

The data. engagement_survey has one row per respondent (department, tenure band, work mode, six 1–5 Likert items, completion time, date); engagement_population has each department's headcount and number of responses. Both are synthetic: built for teaching, describing no real company.

Stakeholders. The CEO (wants a positive message), the HR director (owns the survey's credibility), and department heads (whose teams may be under-represented).

Dataset

Employee engagement survey

778 rows · one row = one survey response (one employee) · synthetic data

ResponseDepartmentTenureWork arrangementQ1Q2Q3Q4Q5Q6Completion time (seconds)Submitted
R0001Customer Service1-3 yearsOnsite3212122162024-10-07
R0002Customer Service1-3 yearsOnsite3232322992024-10-14
R0003Technology3-5 yearsRemote5344345412024-10-10
R0004Sales1-3 yearsOnsite4344325062024-10-19
R0005Customer Service1-3 yearsOnsite3132133052024-10-06
R0006Sales5-10 yearsHybrid444444632024-10-06

Included with a Formula Quest membership

This case has 4 stages and 10 graded tasks, ending with a written report.

View Formula Quest memberships