Perhaps the most important development in psychooncology in the past 10 years has been the development and testing of short, user-friendly screening tools for distress. Attempts to validate these tools have helped crystallize the concept of distress, which had previously received little attention compared with depression.1 Distress is a very common complication of cancer at any stage and often occurs when multiple needs are unmet.2,3 The presence of distress is also linked with reduced health-related quality of life,4 poor satisfaction with medical care,5 and possibly reduced survival.6 Early psychometric research focused on diagnostic accuracy (performance against another scale) and diagnostic validity (performance against a true criterion standard) of longer tools involving 10 items or more that typically took at least 5 minutes to administer.7,8 It is now known that fewer than 15% of cancer professionals are prepared to use these questionnaires in clinical practice, with most relying on their own clinical judgement.9,10 It is also known that self-assessed judgement is inaccurate, just as accuracy in vignette studies overestimates clinical performance.11,12 Direct observation of clinicians' habits suggests modest clinical accuracy with a high proportion of both false-negative and -positive errors.13 These errors are seen in several professional groups and in all settings, leading to the interpretation that distress can be difficult to detect in busy clinical settings.
Patient-reported information such as distress and quality of life can be evaluated through interview (verbally), pencil and paper, or computer. Most questionnaires use a multiple-choice format with a Likert scale (e.g., mild, moderate, severe), but some use a visual analog format. This review and brief meta-analysis examines the merits of short tools with 5 to 14 items taking 2 to 5 minutes to complete, and ultra-short screening tools of 1 to 4 items taking less than 2 minutes to complete.14
The first application of a visual analog scale (VAS) was in 1921,15 although it was not used to measure mood until 1969. In 1969, Zealley and Aitken16 compared patient and nurse twice-daily VAS ratings. A high correlation was found between the patients' self-rated VAS score and their Hamilton score, although interestingly nurses' VAS ratings tended to cluster centrally and lag behind patient-reported change.
In the 1970s, several independent groups experimented with VAS ratings for mood, suicidal thoughts, pain, and quality of life.17 The development of simple but structured verbal methods has been a more recent development, given that verbal enquiry may be more acceptable than even a single self-report item (e.g., “are you depressed?” or “how distressed have you been in the previous week?”).18 In cancer settings, use of the VAS for emotional difficulties has followed from its use in pain measurement (e.g., in the Memorial Pain Assessment Card).19 In 1997, Chochinov et al.20 examined a VAS from “worst possible mood” to “best possible mood.” However, the best known example and most adequately studied is the Distress Thermometer (DT),21 which was developed by a panel of 23 health professionals along with a patient representative working in collaboration with the NCCN.22 The DT is a simple pencil and paper measure consisting of a line with a 0-to-10 scale, indicating “No Distress” at 0, and at 10, indicating “Extreme Distress.” The words no distress, moderate distress, and severe distress are present as anchors along the scale in some versions. Patients are asked to answer the question “How distressed have you been during the past week on a scale of 0 to 10?” A cutoff of 4 or above is recommended to be significant, with 4 or 5 indicating mild distress, 6 or 7 denoting moderate distress, and 8 or higher indicating severe distress. An important addition is a problem checklist that highlights potential areas of difficulty for a patient that may be linked with perceived distress.
Recently, several other methods of measuring distress have been proposed. The Psychological Distress Inventory (PDI) is a 13-item scale first proposed to measure distress in patients with breast cancer. It was tested against a structured clinical interview as the criterion, with a cut-off of 28 or 29 considered clinically significant.23,24 Several variants on the thermometer format have also been developed. Lees and Lloyd-Williams25 tested a VAS anchored with a sad face and happy face. They reported a high correlated with the Hospital Anxiety and Depression Scale total score (HADS-T) but did not report sensitivity or specificity. García et al.26 tested a VAS for anxiety and depression but did not use a robust outcome standard.
In a multicenter study in Europe, Gil et al.27 assessed the value of both the DT and a Mood Thermometer (MT), although the comparator was the HADS. Interestingly, the DT was more highly associated with HADS anxiety scores than depression scores, whereas the MT was related to both HADS anxiety and depression scores. Recently, Mitchell et al.28 developed a 5-item Emotion Thermometer designed to measure multidomain emotional complications of cancer. It had good validity against Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV)-defined depression and HADS total scores in early cancer, but studies are awaited regarding interview-defined distress.28
In addition to these custom scales, abbreviated versions of every major mood scale have been published using factor analysis or Rasch analysis. A good example is the adaptation of 10-item Edinburgh Postnatal Depression Scale (EPDS) into an 8-item version.29 An important caveat is that often the abbreviated version is untested in an independent sample, making interpretation difficult.
The purpose of the following data synthesis is to examine which short scales have been adequately validated against defined distress in cancer or palliative settings and to compare the accuracy of single and multiple applications of the scale.
Holland JC, Bultz BD. The NCCN guideline for distress management: a case for making distress the sixth vital sign. J Natl Compr Canc Netw 2007;5:3–7.
Carlson LE, Angen M, Cullum J et al.. High levels of untreated distress and fatigue in cancer patients. Br J Cancer 2004;90:2297–2304.
Shim EJ, Mehnert A, Koyama A et al.. Health-related quality of life in breast cancer: cross-cultural survey of German, Japanese, and South Korean patients. Breast Cancer Res Treat 2006;99:341–350.
Von Essen L, Larsson G, Oberg K, Sjoden PO. `Satisfaction with care': associations with health-related quality of life and psychosocial function among Swedish patients with endocrine gastrointestinal tumours. Eur J Cancer Care (Engl) 2002;11:91–99.
Faller H, Bulzebruck H, Drings P, Lang H. Coping, distress, and survival among patients with lung cancer. Arch Gen Psychiatry 1999;56:756–762.
Carroll BT, Kathol RG, Noyes R et al.. Screening for depression and anxiety in cancer-patients using the Hospital Anxiety and Depression Scale. Gen Hosp Psychiatry 1993;15:69–74.
Mitchell AJ, Kaar S, Coggan C, Herdman J. Acceptability of common screening methods used to detect distress and related mood disorders-preferences of cancer specialists and non-specialists. Psychooncology 2008;17:226–236.
Pirl W, Muriel A, Hwang V et al.. Screening for psychosocial distress: a national survey of oncologists. J Support Oncol 2007;5:499–504.
Nekolaichuk CL, Bruera E, Spachynski K et al.. A comparison of patient and proxy symptom assessments in advanced cancer patients. Palliat Med 1999;13:311–323.
Veloski J, Tai S, Evans AS, Nash DB. Clinical vignette-based surveys: a tool for assessing physician practice variation. Am J Med Qual 2005;20:151–157.
Söllner W, DeVries A, Steixner E et al.. How successful are oncologists in identifying patient distress, perceived social support, and need for psychosocial counselling? Br J Cancer 2001;84:179–185.
Mitchell AJ, Coyne JC. Do ultra-short screening instruments accurately detect depression in primary care? A pooled analysis and meta-analysis of 22 studies. Br J Gen Pract 2007;57:144–151.
Lloyd-Williams MA, Dennis MB, Taylor FC. A prospective study to compare three depression screening tools in patients who are terminally ill. Gen Hosp Psychiatry 2004;26:384–389.
Fishman B, Pasternak S, Wallenstein SI et al.. The Memorial Pain Assessment Card: a valid instrument for the evaluation of cancer pain. Cancer 1987;60:1151–1158.
Chochinov HM, Wilson KG, Enns M, Lander S. Are you depressed?'' Screening for depression in the terminally ill. Am J Psychiatry 1997;154:674–676.
Roth AJ, Kornblith AB, Batel-Copel L et al.. Rapid screening for psychologic distress in men with prostate carcinoma: a pilot study. Cancer 1998;82:1904–1908.
Holland JC, Andersen B, Breitbart WS et al.. NCCN clinical practice guidelines in oncology: distress management. Version 1, 2010. Available at: http://www.nccn.org/professionals/physician_gls/PDF/distress.pdf. Accessed September 4, 2009.
Morasso G, Costantini M, Baracco G et al.. Assessing psychological distress in cancer patients: validation of a self-administered questionnaire. Oncology 1996;53:295–302.
Lees N, Lloyd-Williams M. Assessing depression in palliative care patients using the visual analogue scale: a pilot study. Eur J Cancer Care (Engl) 1999;8:220–223.
García MM, Sales PJ, Rojas EJ, Batiste-Alentorn GX. [Simple, and fast assessment of emotional distress in a palliative care outpatient clinic]. Medicina Paliativa 2006;13:144–148.
Gil F, Grassi L, Travado L et al., Use of distress and depression thermometers to measure psychosocial morbidity among southern European cancer patients. Support Care Cancer 2005;13:600–606.
Mitchell AJ, Baker-Glenn EA, Granger L, Symonds P. Can the Distress Thermometer be improved by additional mood domains? Part I. Initial validation of the Emotion Thermometers tool. Psychooncology 2010;19:125–133.
Lloyd-Williams M, Shiels C, Dowrick C. The development of the Brief Edinburgh Depression Scale (BEDS) to screen for depression in patients with advanced cancer. J Affect Disord 2007;99:259–264.
Mitchell AJ. Pooled results from 38 analyses of the accuracy of distress thermometer and other ultra-short methods of detecting cancer-related mood disorder. J Clin Oncol 2007;25:4670–4681.
Macaskill P, Glasziou P, Irwig L. Meta-analysis of diagnostic tests. In: Armitage P, Colton T, eds. Encyclopedia of Biostatistics, 2nd edition. Chichester, UK: Wiley; 2005.
Fallowfield L, Ratcliffe D, Jenkins V, Saul J. Psychiatric morbidity and its recognition by doctors in patients with cancer. Br J Cancer 2001;84:1011–1015.
Graves KD, Arnold SM, Love CL et al.. Distress screening in a multidisciplinary lung cancer clinic: prevalence and predictors of clinically-significant distress. Lung Cancer 2007;55:215–224.
Mitchell AJ, Meader N, Symonds P. Diagnostic validity of the Hospital Anxiety and Depression Scale (HADS) in cancer and palliative settings: a meta-analysis. J Aff Dis 2010;in press.
Bruera E, Kuehn N, Miller MJ et al.. The Edmonton Symptom Assessment System (ESAS): a simple method for the assessment of palliative care patients. J Palliat Care 1991;7:6–9.
Rees E, Hardy J, Ling J et al.. The use of the Edmonton Symptom Assessment Scale (ESAS) within a palliative care unit in the UK. Palliat Med 1998;12:75–82.
Paice JA, Cohen FL. Validity of a verbally administered numeric rating scale to measure cancer pain intensity. Cancer Nurs 1997;20:88–93.
Mitchell AJ, Elena Baker-Glenn E, Thiagarajan S et al.. Diagnostic utility of the two vs. nine item patient health questionnaire (PHQ2 V PHQ9) for major depression in early cancer. Psychooncology 2008;17:S1–S348.
Akizuki N, Akechi T, Nakanishi T et al.. Development of a brief screening interview for adjustment disorders and major depression in patients with cancer. Cancer 2003;97:2605–2613.
Grassi L, Sabato S, Rossi E et al.. Affective syndromes and their screening in cancer patients with early and stable disease. J Affect Disord 2009;114:193–199.
Singer S, Danker H, Dietz A et al.. Screening for mental disorders in laryngeal cancer patients: a comparison of 6 methods Psychooncology 2008;17:280–286.
Hoffman BM, Zevon MA, D'Arrigo MC, Cecchini TB. Screening for distress in cancer patients: the NCCN rapid-screening measure. Psychooncology 2004;13:792–799.
Marrit A, Tuinman MA, Gazendam-Donofrio SM, Hoekstra-Weebers JE. Screening and referral for psychosocial distress in oncologic practice use of the distress thermometer. Cancer 2008;113:870–878
Clover K, Carter GL, Mackinnon A, Adams C. Is my patient suffering clinically significant emotional distress? Demonstration of a probabilities approach to evaluating algorithms for screening for distress. Support Care Cancer 2009;17:1455–1462.
Maunsell E, Brisson J, Deschenes L et al.. Randomized trial of a psychologic distress screening program after breast cancer: effects on quality of life. J Clin Oncol 1996;14:2747–2755.