“(The SHEU survey) was very, very useful. It gave us reassurance we weren’t missing a trick. For example not many pupils in the sample year groups were taking illegal drugs, which re-enforced our opinions. But the survey also raised issues and flagged some things up. We discovered that some of our girls weren’t eating enough – the percentage of girls in our school not eating lunch the day before the survey was higher than the county average. There were other concerns too, specifically around cigarettes, alcohol and attendance.
The school used this data and took a number of actions to address it. More female peer mentors were put in place and the school asked NEXUS (the Extended Schools service) for help, so they developed a programme for girls which addressed their eating patterns, healthy eating, sex education and self-esteem issues.
We ran an anti-bullying group for Year 9 as a preventative measure, based upon data provided by our current Year 10 students.
The travel data revealed that a high number of pupils took the car to school so we involved the BIKE-IT scheme who ran assemblies, brought in their bikes (including one with a pedal-powered smoothie maker!), and raised awareness of health and green issues.
The information about how happy the students were with their lives raised some concerns as far fewer girls were as happy as the boys, so work was done around developing aspirations, role-models and self-esteem."
SHEU paper and online questionnaires for young people
Paper and online surveys completed by pupils in schools.
Do the same questions perform differently?
![]() |
The Schools Health Education Unit [SHEU] is probably the oldest survey service in England dedicated to collecting data about young people’s healthy lifestyles. Millions of questionnaires have been completed by pupils. |
|
![]() |
SHEU started school-based paper surveys in 1977 and launched its online survey service in 2004. At that time we had the idea that nearly all the survey work would be online within a few years. |
While the proportion of work online has increased, some schools and colleges find that paper surveys are still more convenient for them. We have found that our surveys give robust data via online or paper-based questionnaires. Often the final decision about which survey method to use can depend on the availability and ease of access of computers in schools and colleges
Do the same questions perform differently?
The following is from a small study we carried out some time ago. We had just completed the second wave of survey work in an Authority. The idea was originally that the survey be conducted on our online survey website but in the end about half of the schools preferred to complete the exercise on paper. This arrangement of 17 schools working on paper and 16 online allowed us to perform a ‘natural experiment’ to compare whether the same questions performed differently in the different media. We generated a whole set of tables that showed the paper and online results side by side. The figures showed good agreement, we thought: then, we decided, very good... actually, these are spookily similar!
|
|
Paper |
Online |
All | |
|
No |
72% |
71% |
72% | |
|
Don't know |
3% |
4% |
4% | |
|
Yes |
24% |
25% |
25% |
|
|
Valid Responses |
% |
100% |
100% |
100% |
|
Count |
1720 |
1779 |
3499 | |
|
Total Sample (Count) |
1760 |
1867 |
3627 | |
In 2014 Dr David Regis wrote, “Ten years ago, I thought we would be doing everything online by now! But I fairly often get told something like:
"There's 2 year groups to get through, 6 classes each, so we need to book the IT suite for 12 slots, and it's already booked up, and the classes are 30 but the IT suite has just 25 computers, 24 of which work... Just send us a parcel of questionnaire booklets, and we can do it all in one morning!"
“Also, the best-laid plans of a school can oft gang agley because of power failure, sulky networks, flooding, winter vomiting, or ...”
“SHEU will continue to offer both paper questionnaires and our online survey service, and in case of events will be able to switch to the other approach for a school at short notice.”
One example of research about school-based health questionnaires:
Web-Based Questionnaires and the Mode Effect: An Evaluation Based on Completion Rates and Data Contents of Near-Identical Questionnaires Delivered in Different Modes. Social Science Computer Review Summer 2006 vol. 24 no. 2 246-254
https://jwolf-ra.wdfiles.com/local--files/mode-effects/WebBasesQuestandModeEffect2006.pdf

