With the difficulties we are currently facing in education as a result of the global pandemic, issues of mental health and supporting learners through difficult times has taken on a new significance. In this post from our guest author Chloe Casey, perspectives are provided on the difficulties with measuring student wellbeing. Drawn from her doctoral research, the post highlights concerns regarding inconsistent approaches to measurement; and highlights a call for greater levels of validity and reliability, to improve comparable evidence for action.
Concerns about mental health, suicide rates and demand for counselling in higher education students have increased in recent years. In the UK, many initiatives have been investigating mental health at university and how to improve it, for example, The Student Mental Health Research Network (SMarTeN) and the University Mental Health Charter with Student Minds charity.
In psychological research, literature has shifted from an emphasis on mental health disorders and illness to a focus on wellbeing (Huppert et al, 2009). Also, many of the initiatives and interventions in higher education have focused on wellbeing too. Therefore, funding has been invested in population-based efforts to improve coping and self-care in students, not solely the referral and treatment of those experiencing mental health problems.
However, there is a big problem when it comes to blurring the terminology along the spectrum of mental health and wellbeing (Barkham, et al 2019). The World Health Organisation and prominent wellbeing researchers like Martin Seligman, provide similar definitions of wellbeing: a multi-faceted construct underpinned by a range of psychological dimensions such as positive emotion, engagement, autonomy, healthy relationships, self-acceptance and personal growth. Despite this, clearly defining wellbeing is problematic due to the many, inconsistent concepts like subjective wellbeing, emotional wellbeing, psychological wellbeing etc.
Take the example of measuring the wellbeing of Postgraduate Researchers (PGRs); the problem is similar. To draw clear conclusions and prevalence rates from the literature, wellbeing needs to be clearly conceptualised and measured using the same valid and reliable tools (Scott and Takarangi, 2019). Studies researching the wellbeing PGRs tend to also measure similar constructs, such as anxiety, depression, stress, and emotional exhaustion. In assessing these symptoms there is usually a consensus in the measures used. For example, studies researching anxiety in PGRs tend to use the Generalized Anxiety Disorder 7-item scale (Spitzer et al 2006). However, even within studies that have used the same measure of anxiety, the rates have varied from 18% (Bolotnyy et al, 2020) to as high as 41% (Evans et al 2018) in PGR samples. Similarly, in measuring stress in PGR students, the Perceived Stress Scale (PSS) (Cohen et al 1994) is the consistent form of measurement. However, each author selected a different variation of the PSS (for instance the 10 or 14-item version, or just choosing 4 items from the scale). Therefore, it is impossible to combine the data or to make any assumptions about the prevalence of stress in PGR students.
Yet, the measurement of wellbeing is the most complicated of all. A review of the literature located 16 studies that assess the wellbeing of PGRs using quantitative measures. Within these studies NINE different scales were used to measure wellbeing. These scales include widely used measures such as the Scale of Positive and Negative Experience (Watson et al, 1988), the Warwick-Edinburgh Mental Wellbeing Scale (Tennant et al, 2007), and the Satisfaction with Life Scale (Diener et al, 1985). However, they also include measures that have been recently developed specifically for PGRs such as the Juniper PhD Wellbeing Scale (Juniper et al, 2011) or the Quality in PhD Processes Questionnaire (Herrmann and Winchmann-Hansen, 2017). A research team from Finland also created a called MED NORD, assessing the wellbeing of medical students. This was adapted to measure stress, exhaustion, anxiety, lack of interest and engagement in PGR study (Stubb et al, 2011) and has utilised in several studies since.
As discussed, currently there are a multitude of survey-based studies using different measures, all reporting varying estimates of PGR wellbeing levels. There have been few attempts to combine the existing data. Three recent literature reviews have attempted this, stressing the problem of heterogeneity in PGR wellbeing measurement (Schmidt and Hansson 2018; Scott and Takarangi, 2019), to the extent that usual systematic review analyses cannot be used to combine the results (Hazell et al, 2020). This makes generalising and comparing these kinds of studies complicated, meaning there are no clear prevalence rates.
The imprecise terminology relating to wellbeing has hindered the field of student wellbeing research and may have led universities to implement actions without robust evidence (Barkham, et al 2019), wasting time and resources. Therefore, there is a call for a more comprehensive assessment of the wellbeing of different student groups using consistent, valid and reliable measures. If this were the case, and the data was reported in a consistent manner, data from different researchers could be easily aggregated and compared. From this, universities can implement evidence-based, tailored interventions and support provisions to improve student wellbeing, overall experience, and academic success.
Author Short Biography
Chloe Casey is a PhD student from Bournemouth University, researching the mental health and wellbeing of postgraduate researcher students. She is particularly interested in coping, peer support, positive psychology, and mixed-methods research. You can contact Chloe via email: ; or connect on Twitter: @ChloeCaraCasey.
- Barkham, M., Broglia, E., Dufour, G., Fudge, M., Knowles, L., Percy, A., Turner, A., Williams, C. & SCORE Consortium (2019) ‘Towards an evidence‐base for student wellbeing and mental health: Definitions, developmental transitions and data sets’, Counselling and Psychotherapy Research, 19(4), pp.351-357, [online], DOI: https://doi.org/10.1002/capr.12227.
- Bolotnyy, V., Basilico, M. & Barreira, P. (2020) Graduate Student Mental Health: Lessons from American Economics Departments. [online], Available at: https://scholar.harvard.edu/bolotnyy/publications/graduate-student-mental-health-lessons-american-economics-departments (Accessed: 22nd October 2020).
- Cohen, S., Kamarck, T. & Mermelstein, R. (1994) ‘Perceived stress scale’, in Cohen S., Kessler R.C. & Gordon L.U. (Eds) Measuring stress: A guide for health and social scientists. Oxford: Oxford University Press.
- Diener, E.D., Emmons, R.A., Larsen, R.J. & Griffin, S. (1985) ‘The satisfaction with life scale’, Journal of Personality Assessment, 49(1), pp.71-75, [online], Available at: https://emmons.faculty.ucdavis.edu/wp-content/uploads/sites/90/2015/08/1985_5-SWLS.pdf (Accessed: 22nd October 2020).
- Evans, T.M., Bira, L., Gastelum, J.B., Weiss, L.T. & Vanderford, N.L. (2018) ‘Evidence for a mental health crisis in graduate education’, Nature Biotechnology, 36(3), p.282-284, [online], DOI: https://doi.org/10.1038/nbt.4089.
- Hazell, C.M., Chapman, L., Valeix, S.F., Roberts, P., Niven, J.E. & Berry, C. (2020) ‘Understanding the mental health of doctoral researchers: a mixed methods systematic review with meta-analysis and meta-synthesis’, Systematic Reviews, 9(1), pp.1-30, [online], DOI: https://doi.org/10.1186/s13643-020-01443-1.
- Herrmann, K.J. & Wichmann-Hansen, G. (2017) ‘Validation of the quality in PhD processes questionnaire’, Studies in Graduate and Postdoctoral Education, 8(2), pp.189-204, [online], DOI: https://doi.org/10.1108/SGPE-D-17-00017.
- Huppert, F.A. (2009) ‘Psychological well‐being: Evidence regarding its causes and consequences’, Applied Psychology: Health and Well‐Being, 1(2), pp.137-164, [online], DOI: https://doi.org/10.1111/j.1758-0854.2009.01008.x.
- Juniper, B., Walsh, E., Richardson, A. & Morley, B. (2011) ‘A new approach to evaluating the well-being of PhD research students’, Assessment & Evaluation in Higher Education, 37(5), pp.563-576, [online], DOI: https://doi.org/10.1080/02602938.2011.555816.
- Schmidt, M. & Hansson, E. (2018) ‘Doctoral students’ well-being: a literature review’, International journal of qualitative studies on health and well-being, 13(1), [online], DOI: https://doi.org/10.1080/17482631.2018.1508171.
- Scott, H. & Takarangi, M.K. (2019) ‘Measuring PhD Student’s Psychological Well-being: Are we seeing the whole picture?’, Student Success, 10(3), p.14-24, [online], DOI: https://doi.org/10.5204/ssj.v10i3.1294.
- Spitzer, R.L., Kroenke, K., Williams, J.B. & Löwe, B. (2006) ‘A brief measure for assessing generalized anxiety disorder: the GAD-7’, Archives of Internal Medicine, 166(10), pp.1092-1097, [online], DOI: https://doi.org/10.1001/archinte.166.10.1092.
- Stubb, J., Pyhältö, K. & Lonka, K. (2011) ‘Balancing between inspiration and exhaustion: PhD students’ experienced socio-psychological well-being’, Studies in Continuing Education, 33(1), pp.33-50, [online], DOI: https://doi.org/10.1080/0158037X.2010.515572.
- Tennant, R., Hiller, L., Fishwick, R., Platt, S., Joseph, S., Weich, S., Parkinson, J., Secker, J. & Stewart-Brown, S. (2007) ‘The Warwick-Edinburgh mental well-being scale (WEMWBS): development and UK validation’, Health and Quality of life Outcomes, 5(1), Article Number 63, [online], DOI: https://doi.org/10.1186/1477-7525-5-63.
- Watson, D., Clark, L.A. & Carey, G. (1988) ‘Positive and negative affectivity and their relation to anxiety and depressive disorders’, Journal of Abnormal Psychology, 97(3), p.346-353, [online], DOI: https://doi.org/10.1037//0021-843x.97.3.346.
Disclaimer: The views and opinions expressed in this blog post are solely those of the original author(s) and the inclusion of the blog post on this page does not imply an endorsement of the authors(s) or any entity they represent. These views and opinions do not represent those of the BESA Executive committee and any of the other contributors to the BESA web site