Perhaps the most important development in psychooncology in the past 10 years has been the development and testing of short, user-friendly screening tools for distress. Attempts to validate these tools have helped crystallize the concept of distress, which had previously received little attention compared with depression.1 Distress is a very common complication of cancer at any stage and often occurs when multiple needs are unmet.2,3 The presence of distress is also linked with reduced health-related quality of life,4 poor satisfaction with medical care,5 and possibly reduced survival.6 Early psychometric research focused on diagnostic accuracy (performance against another scale) and diagnostic validity (performance against a true criterion standard) of longer tools involving 10 items or more that typically took at least 5 minutes to administer.7,8 It is now known that fewer than 15% of cancer professionals are prepared to use these questionnaires in clinical practice, with most relying on their own clinical judgement.9,10 It is also known that self-assessed judgement is inaccurate, just as accuracy in vignette studies overestimates clinical performance.11,12 Direct observation of clinicians' habits suggests modest clinical accuracy with a high proportion of both false-negative and -positive errors.13 These errors are seen in several professional groups and in all settings, leading to the interpretation that distress can be difficult to detect in busy clinical settings.
Patient-reported information such as distress and quality of life can be evaluated through interview (verbally), pencil and paper, or computer. Most questionnaires use a multiple-choice format with a Likert scale (e.g., mild, moderate, severe), but some use a visual analog format. This review and brief meta-analysis examines the merits of short tools with 5 to 14 items taking 2 to 5 minutes to complete, and ultra-short screening tools of 1 to 4 items taking less than 2 minutes to complete.14
The first application of a visual analog scale (VAS) was in 1921,15 although it was not used to measure mood until 1969. In 1969, Zealley and Aitken16 compared patient and nurse twice-daily VAS ratings. A high correlation was found between the patients' self-rated VAS score and their Hamilton score, although interestingly nurses' VAS ratings tended to cluster centrally and lag behind patient-reported change.
In the 1970s, several independent groups experimented with VAS ratings for mood, suicidal thoughts, pain, and quality of life.17 The development of simple but structured verbal methods has been a more recent development, given that verbal enquiry may be more acceptable than even a single self-report item (e.g., “are you depressed?” or “how distressed have you been in the previous week?”).18 In cancer settings, use of the VAS for emotional difficulties has followed from its use in pain measurement (e.g., in the Memorial Pain Assessment Card).19 In 1997, Chochinov et al.20 examined a VAS from “worst possible mood” to “best possible mood.” However, the best known example and most adequately studied is the Distress Thermometer (DT),21 which was developed by a panel of 23 health professionals along with a patient representative working in collaboration with the NCCN.22 The DT is a simple pencil and paper measure consisting of a line with a 0-to-10 scale, indicating “No Distress” at 0, and at 10, indicating “Extreme Distress.” The words no distress, moderate distress, and severe distress are present as anchors along the scale in some versions. Patients are asked to answer the question “How distressed have you been during the past week on a scale of 0 to 10?” A cutoff of 4 or above is recommended to be significant, with 4 or 5 indicating mild distress, 6 or 7 denoting moderate distress, and 8 or higher indicating severe distress. An important addition is a problem checklist that highlights potential areas of difficulty for a patient that may be linked with perceived distress.
Recently, several other methods of measuring distress have been proposed. The Psychological Distress Inventory (PDI) is a 13-item scale first proposed to measure distress in patients with breast cancer. It was tested against a structured clinical interview as the criterion, with a cut-off of 28 or 29 considered clinically significant.23,24 Several variants on the thermometer format have also been developed. Lees and Lloyd-Williams25 tested a VAS anchored with a sad face and happy face. They reported a high correlated with the Hospital Anxiety and Depression Scale total score (HADS-T) but did not report sensitivity or specificity. García et al.26 tested a VAS for anxiety and depression but did not use a robust outcome standard.
In a multicenter study in Europe, Gil et al.27 assessed the value of both the DT and a Mood Thermometer (MT), although the comparator was the HADS. Interestingly, the DT was more highly associated with HADS anxiety scores than depression scores, whereas the MT was related to both HADS anxiety and depression scores. Recently, Mitchell et al.28 developed a 5-item Emotion Thermometer designed to measure multidomain emotional complications of cancer. It had good validity against Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV)-defined depression and HADS total scores in early cancer, but studies are awaited regarding interview-defined distress.28
In addition to these custom scales, abbreviated versions of every major mood scale have been published using factor analysis or Rasch analysis. A good example is the adaptation of 10-item Edinburgh Postnatal Depression Scale (EPDS) into an 8-item version.29 An important caveat is that often the abbreviated version is untested in an independent sample, making interpretation difficult.
The purpose of the following data synthesis is to examine which short scales have been adequately validated against defined distress in cancer or palliative settings and to compare the accuracy of single and multiple applications of the scale.
HollandJCBultzBD. The NCCN guideline for distress management: a case for making distress the sixth vital sign. J Natl Compr Canc Netw2007;5:3–7.
ShimEJMehnertAKoyamaA. Health-related quality of life in breast cancer: cross-cultural survey of German, Japanese, and South Korean patients. Breast Cancer Res Treat2006;99:341–350.
Von EssenLLarssonGObergKSjodenPO. `Satisfaction with care': associations with health-related quality of life and psychosocial function among Swedish patients with endocrine gastrointestinal tumours. Eur J Cancer Care (Engl)2002;11:91–99.
CarrollBTKatholRGNoyesR. Screening for depression and anxiety in cancer-patients using the Hospital Anxiety and Depression Scale. Gen Hosp Psychiatry1993;15:69–74.
MitchellAJKaarSCogganCHerdmanJ. Acceptability of common screening methods used to detect distress and related mood disorders-preferences of cancer specialists and non-specialists. Psychooncology2008;17:226–236.
NekolaichukCLBrueraESpachynskiK. A comparison of patient and proxy symptom assessments in advanced cancer patients. Palliat Med1999;13:311–323.
VeloskiJTaiSEvansASNashDB. Clinical vignette-based surveys: a tool for assessing physician practice variation. Am J Med Qual2005;20:151–157.
SöllnerWDeVriesASteixnerE. How successful are oncologists in identifying patient distress, perceived social support, and need for psychosocial counselling?Br J Cancer2001;84:179–185.
MitchellAJCoyneJC. Do ultra-short screening instruments accurately detect depression in primary care? A pooled analysis and meta-analysis of 22 studies. Br J Gen Pract2007;57:144–151.
Lloyd-WilliamsMADennisMBTaylorFC. A prospective study to compare three depression screening tools in patients who are terminally ill. Gen Hosp Psychiatry2004;26:384–389.
FishmanBPasternakSWallensteinSI. The Memorial Pain Assessment Card: a valid instrument for the evaluation of cancer pain. Cancer1987;60:1151–1158.
ChochinovHMWilsonKGEnnsMLanderS. Are you depressed?'' Screening for depression in the terminally ill. Am J Psychiatry1997;154:674–676.
RothAJKornblithABBatel-CopelL. Rapid screening for psychologic distress in men with prostate carcinoma: a pilot study. Cancer1998;82:1904–1908.
HollandJCAndersenBBreitbartWS. NCCN clinical practice guidelines in oncology: distress management. Version 1 2010. Available at: http://www.nccn.org/professionals/physician_gls/PDF/distress.pdf. Accessed September 4 2009.
MorassoGCostantiniMBaraccoG. Assessing psychological distress in cancer patients: validation of a self-administered questionnaire. Oncology1996;53:295–302.
LeesNLloyd-WilliamsM. Assessing depression in palliative care patients using the visual analogue scale: a pilot study. Eur J Cancer Care (Engl)1999;8:220–223.
GarcíaMMSalesPJRojasEJBatiste-AlentornGX. [Simple, and fast assessment of emotional distress in a palliative care outpatient clinic]. Medicina Paliativa2006;13:144–148.
GilFGrassiLTravadoLUse of distress and depression thermometers to measure psychosocial morbidity among southern European cancer patients. Support Care Cancer2005;13:600–606.
MitchellAJBaker-GlennEAGrangerLSymondsP. Can the Distress Thermometer be improved by additional mood domains? Part I. Initial validation of the Emotion Thermometers tool. Psychooncology2010;19:125–133.
Lloyd-WilliamsMShielsCDowrickC. The development of the Brief Edinburgh Depression Scale (BEDS) to screen for depression in patients with advanced cancer. J Affect Disord2007;99:259–264.
MitchellAJ. Pooled results from 38 analyses of the accuracy of distress thermometer and other ultra-short methods of detecting cancer-related mood disorder. J Clin Oncol2007;25:4670–4681.
MacaskillPGlasziouPIrwigL. Meta-analysis of diagnostic tests. In: Armitage P Colton T eds.Encyclopedia of Biostatistics 2nd edition. Chichester, UK: Wiley; 2005.
FallowfieldLRatcliffeDJenkinsVSaulJ. Psychiatric morbidity and its recognition by doctors in patients with cancer. Br J Cancer2001;84:1011–1015.
GravesKDArnoldSMLoveCL. Distress screening in a multidisciplinary lung cancer clinic: prevalence and predictors of clinically-significant distress. Lung Cancer2007;55:215–224.
MitchellAJMeaderNSymondsP. Diagnostic validity of the Hospital Anxiety and Depression Scale (HADS) in cancer and palliative settings: a meta-analysis. J Aff Dis2010;in press.
BrueraEKuehnNMillerMJ. The Edmonton Symptom Assessment System (ESAS): a simple method for the assessment of palliative care patients. J Palliat Care1991;7:6–9.
ReesEHardyJLingJ. The use of the Edmonton Symptom Assessment Scale (ESAS) within a palliative care unit in the UK. Palliat Med1998;12:75–82.
PaiceJACohenFL. Validity of a verbally administered numeric rating scale to measure cancer pain intensity. Cancer Nurs1997;20:88–93.
MitchellAJElena Baker-GlennEThiagarajanS. Diagnostic utility of the two vs. nine item patient health questionnaire (PHQ2 V PHQ9) for major depression in early cancer. Psychooncology2008;17:S1–S348.
AkizukiNAkechiTNakanishiT. Development of a brief screening interview for adjustment disorders and major depression in patients with cancer. Cancer2003;97:2605–2613.
GrassiLSabatoSRossiE. Affective syndromes and their screening in cancer patients with early and stable disease. J Affect Disord2009;114:193–199.
SingerSDankerHDietzA. Screening for mental disorders in laryngeal cancer patients: a comparison of 6 methodsPsychooncology2008;17:280–286.
HoffmanBMZevonMAD'ArrigoMCCecchiniTB. Screening for distress in cancer patients: the NCCN rapid-screening measure. Psychooncology2004;13:792–799.
MarritATuinmanMAGazendam-DonofrioSMHoekstra-WeebersJE. Screening and referral for psychosocial distress in oncologic practice use of the distress thermometer. Cancer2008;113:870–878
CloverKCarterGLMackinnonAAdamsC. Is my patient suffering clinically significant emotional distress? Demonstration of a probabilities approach to evaluating algorithms for screening for distress. Support Care Cancer2009;17:1455–1462.
MaunsellEBrissonJDeschenesL. Randomized trial of a psychologic distress screening program after breast cancer: effects on quality of life. J Clin Oncol1996;14:2747–2755.