Introduction
Depression is common in older individuals (Samaras et al., Reference Samaras, Rossi, Giannakopoulos and Gold2010). Its prevalence is approximately 13% in general and 2% for the major depression subtype (Beekman et al., Reference Beekman, Copeland and Prince1999). Depression prevalence further increases among elderly patients with dementia. Globally, up to 35% develop depression during the disease course (Aalten et al., Reference Aalten, de Vugt, Jaspers, Jolles and Verhey2005) but estimates may vary according to the dementia type: 30%–50% for Alzheimer's disease (AD; Zubenko et al., Reference Zubenko2003; Burgut et al., Reference Burgut, Benaur and Hencliffe2006; Starkstein and Mizrahi, Reference Starkstein and Mizrahi2006), 52%–63% for vascular dementia (VD; Moretti et al., Reference Moretti, Torre, Antonello and Cazzato2006), 20%–65% for Lewy body dementia (LBD; Burgut et al., Reference Burgut, Benaur and Hencliffe2006), and 20%–45% for Parkinson disease (PD; Burgut et al., Reference Burgut, Benaur and Hencliffe2006).
Depression remains underdiagnosed and undertreated in the elderly, particularly in patients with dementia (Lang et al., Reference Lang2010). It is associated with faster cognitive decline and may interfere with neuropsychological testing, confounding dementia diagnosis (Lyketsos et al., Reference Lyketsos2003; Starkstein and Mizrahi, Reference Starkstein and Mizrahi2006). For these reasons, depression is frequently screened for in our hospital memory consultation using the depression subscale (HADD) of the Hospital Anxiety and Depression Scale (HADS). The choice of the HADD was based on the scale's simplicity, characteristics, and satisfying metric properties in younger populations. The HADS was initially developed to identify “caseness” (possible and probable) of anxiety and depression among patients in non-psychiatric wards (Zigmond and Snaith, Reference Zigmond and Snaith1983). Since then, its use has been extended to outpatient and community settings (Dunbar et al., Reference Dunbar, Ford, Hunt and Der2000; Caci et al., Reference Caci, Bayle, Mattei, Dossios, Robert and Boyer2003). The HADS is a well-accepted (Herrmann, Reference Herrmann1997), easy-to-use, 14-item auto-questionnaire producing two 7-item subscales assessing either depression (HADD) or anxiety (HADA; Herrmann, Reference Herrmann1997; Bjelland et al., Reference Bjelland, Dahl, Haug and Neckelmann2002; Poole and Morgan, Reference Poole and Morgan2006). It is a self-assessment based on symptoms over the preceding week and is rated on a four-point Likert scale, with a maximum score of 21 on each subscale (higher scores correspond to higher disease severity; Johnston et al., Reference Johnston, Pollard and Hennessey2000; Herrero et al., Reference Herrero, Blanch, Peri, De Pablo, Pintor and Bulbena2003). The HADD subscale is constructed mostly around the item of anhedonia (Poole and Morgan, Reference Poole and Morgan2006). Importantly, it deliberately leaves out physical indicators of psychological distress such as dizziness, lethargy, headaches, insomnia, and fatigue, to prevent interference with somatic disorders and, thus, may be particularly suited for the detection of depression in the elderly (Herrmann, Reference Herrmann1997; Bjelland et al., Reference Bjelland, Dahl, Haug and Neckelmann2002; Wang et al., Reference Wang, Lopez and Martin2006). Symptoms of severe psychopathology are also omitted to avoid the “floor effect” frequently encountered in non-psychiatric patients (Herrmann, Reference Herrmann1997; Bjelland et al., Reference Bjelland, Dahl, Haug and Neckelmann2002). The scale has a high internal consistency with a Cronbach's α coefficient of 0.7–0.9 (Herrmann, Reference Herrmann1997; Aben et al., Reference Aben, Verhey, Lousberg, Lodder and Honig2002; Bjelland et al., Reference Bjelland, Dahl, Haug and Neckelmann2002; Herrero et al., Reference Herrero, Blanch, Peri, De Pablo, Pintor and Bulbena2003; Lowe et al., Reference Lowe2004; Bambauer et al., Reference Bambauer, Locke, Aupont, Mullan and McLaughlin2005; Thomas et al., Reference Thomas2005). Two-week test–retest reliability is also high (r > 0.80), demonstrating a satisfying stability of the scale (Herrmann, Reference Herrmann1997). In younger populations, concurrent validity between HADD and other depression scales is generally satisfactory, with correlation coefficients ranging from 0.6 to 0.8 (Bjelland et al., Reference Bjelland, Dahl, Haug and Neckelmann2002).
However, a recent study suggested a poorer performance in older populations. Helvik et al. (Reference Helvik, Engedal, Skancke and Selbæk2011) reported a modest correlation (Spearman coefficient 0.51) between the HADD and the Montgomery–Åsberg Depression Rating Scale (MADRS), although the MADRS has been well validated for the detection of depression in patients with dementia (Leontjevas et al., Reference Leontjevas, van Hooren and Mulders2009; Helvik et al., Reference Helvik, Engedal, Skancke and Selbæk2011).
In a quality-control context, we retrospectively compared scores on the HADD with a psychiatric diagnosis of depression in older inpatients assessed during the same hospital stay by both a memory specialist and a psychiatrist. In this paper, we report our findings on the efficiency of the scale for depression screening, as well as the effect of dementia on the scale's performance. To our knowledge, these issues have never been addressed in this population.
Methods
This is a retrospective study comparing the scores obtained on the HADD during a memory consultation with a depression diagnosis made by the consulting psychiatrist. The study was conducted in the geriatrics ward of a university hospital as part of a quality-control project and was approved by the local ethics committee.
We reviewed the medical files of all inpatients assessed by our memory consultant between 2001 and 2006. Inclusion criteria comprised:
1. Age older than 65.
2. Assessment by a psychiatrist during the same hospital stay and psychiatric diagnosis available.
3. Scores available on the HADD and the Clinical Dementia Rating (CDR) scale (Hughes et al., Reference Hughes, Berg, Danziger, Coben and Martin1982).
Patients with severe dementia (CDR score of 3) were excluded.
Psychiatric and memory assessments were requested by the treating resident, according to clinical suspicion for cognitive and psychiatric disorders. The HADD was used by neuropsychologists for depression screening during the memory consultation. Because reading comprehension and visual impairments are frequent in this population, to ensure item comprehension the HADD was administered to the patient by the neuropsychologist in all of the cases. The memory specialist established a diagnosis and attributed a score of 0–3 on the CDR scale, according to the severity of dementia. The psychiatric diagnosis was established according to the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition. The same highly experienced psychiatrist evaluated all cases and the neuropsychologists performed the HADD independent of the psychiatric evaluation. The score on the HADD was compared with the diagnosis made by the consulting psychiatrist using the latter as a “gold standard.”
The effect of dementia on the performance of the HADD was examined by dividing the total sample into three groups according to the CDR score – no dementia: CDR0–0.5; early dementia: CDR1; moderate dementia: CDR2.
Because we used a convenience sample, to assess for potential selection bias we compared the group of patients included with those excluded from the study for sociodemographic and clinical variables. Finally, psychiatric and cognitive assessments occurred at different points during the patient's hospital stay. To test for a possible bias related to changes in the patient's clinical state, we repeated the analyses restricting the time difference between the two assessments to 28, 21, and 14 days.
Statistical analyses
Group comparisons were performed using the χ2 test, unpaired t-test, or Mann–Whitney U test, as appropriate. Simple and multiple logistic regression models were applied to predict the presence of depression diagnosis using HADD scores while adjusting for age, sex, cognitive status (CDR), and delay between assessments (determined by the absolute value of difference between the two assessment dates). Areas under the receiver operating characteristics curve (ROC) were plotted and used as measures of HADD's performance (a value of 0.5 corresponding to a useless test no different from random, and a value of 1 to the perfect test with 100% sensitivity and specificity). Areas under curves (AUC) were compared by χ2 tests. Specificity, sensitivity values, percentage of correctly classified cases, and most appropriate HADD cut-off score were calculated in univariate analysis for the whole group and the three subgroups (CDR0–0.5, CDR1, and CDR2). The same cut-off score was applied in multiple logistic regression analyses for the whole group to recalculate specificity, sensitivity values, and correctly classified cases. Multiple logistic regression analyses were repeated for the whole group limiting time difference between the two assessments to 28, 21, and 14 days, and for the three subgroups (CDR0–0.5, CDR1, and CDR2) without time limitation.
All analyses were performed using Stata release 12 (College Station, TX).
Results
From 2001 to 2006, 1,795 inpatients were evaluated in the memory consultation, of which 427 patients were assessed by both the memory specialist and the psychiatrist during the same hospital stay. Twelve patients were excluded because of a score of 3 on the CDR scale. Another 143 patients did not meet inclusion criteria (unavailable data for one or more of the CDR score, HADD score, and psychiatric diagnosis). A total of 272 patients were finally included in the study. We compared the included group with the 1,523 non-included patients. The sex distribution was identical (p = 0.365). The age of the selected group was one year younger (p = 0.0027). The CDR distribution was statistically different (p < 0.001) between the two groups (included: 24.6%, 45.6%, and 29.8% vs. excluded: 17.3%, 40.2%, and 42.6%, for CDR: 0–0.5, 1, and 2, respectively).
Of the included patients, 108 (39.7%) were diagnosed with depression by the consulting psychiatrist. Fifty patients had an episode of mild depression occurring in the context of a known bipolar disorder for one patient, a recurrent depressive disorder for 12 patients, and an adjustment disorder for another 19 patients. Thirty-one patients had a depressive episode described as moderate, of which half in the context of recurrent depression. Eight patients were diagnosed with a severe depression, of which one with psychotic symptoms and three in the context of recurrent depression. Finally, for 19 patients the type and severity of the depressive episode were not specified.
Table 1 shows the demographic and clinical characteristics of the included patients. Both groups (depressed and non-depressed) were similar, except for significantly higher HADD scores (p = 0.009) and higher delays (p = 0.004) between the two assessments in the depressed group.
Demographic and clinical characteristics (n = 272)
*Student's t-test; **Chi-square test; ***Mann–Whitney U test.
CDR = Clinical Dementia Rating; HADS = Hospital Anxiety and Depression Scale; HADA = Hospital Anxiety and Depression scale, Anxiety subscale; HADD = Hospital Anxiety and Depression scale, Depression subscale; MMSE = mini-Mental State Examination; SD = standard deviation.
In a univariate analysis for the total sample, the HADD was significantly correlated with the presence of depression (p = 0.009; Table 2). However, sensitivity and specificity were both low (50.9% and 69.5%, respectively) using the generally accepted threshold score of 8 on the HADD (Zigmond and Snaith, Reference Zigmond and Snaith1983) and fewer than two-thirds of the cases were correctly classified. In the subgroup analysis, the HADD score was correlated to depression only in the non-demented group (p = 0.044; Table 2). The AUC was similar in all three groups (p = 0.802; Table 2).
Performance of the HADD for depression detection: univariate analysis
AUC = Areas Under Curve; CDR = Clinical Dementia Rating; CI = Confidence Interval; HADD = Hospital Anxiety and Depression scale, Depression subscale.
In a multiple regression analysis of the total sample, after adjustment for age, sex, delay, and dementia severity (CDR score), the HADD was significantly correlated with the presence of depression but performance remained modest (p = 0.007, AUC = 0.65 (95% confidence interval (CI) = 0.58–0.71); sensitivity = 62.0%, specificity = 63%) (Table 3). Higher time intervals between psychiatric and memory assessments were significantly related to the presence of depression (p = 0.010). However, there was no major improvement in the scale's performance when analyses were repeated after limiting the interval between the two assessments to 28, 21, and 14 days (Table 3).
Performance of the HADD for depression detection. Multiple regression analysis (dementia severity according to CDR, age, sex, and delay) for the total population, and by delay limits (28, 21, and 14 days)
AUC = Areas Under Curve; CDR = Clinical Dementia Rating; CI = Confidence Interval; HADD = Hospital Anxiety and Depression scale, Depression subscale.
In a multiple analysis for each CDR group after adjustment for age, sex, and delay between the two assessments, the HADD score significantly predicted depression only for the non-demented group and there was a trend toward significance for mild dementia cases (CDR0–0.5: p = 0.047, CDR1: p = 0.054, and CDR2: p = 0.266). AUC were calculated on ROC curves for the three groups (CDR0–0.5: AUC = 0.64 (95% CI = 0.51–0.78); CDR1: AUC = 0.62 (95% CI = 0.52–0.72); CDR2: AUC = 0.67 (95% CI = 0.54–0.79)). The difference among AUC was not statistically significant (p = 0.837).
Discussion
To our knowledge, this study is the first to compare the HADD with a psychiatric assessment for depression screening in older inpatients. Moreover, it is the first to study the effect of dementia presence and severity on the scale's performance.
The most widely accepted HADD threshold for depression screening is eight (Zigmond and Snaith, Reference Zigmond and Snaith1983; Bjelland et al., Reference Bjelland, Dahl, Haug and Neckelmann2002), for which sensitivity and specificity in the literature vary between 70% and 90% (Aben et al., Reference Aben, Verhey, Lousberg, Lodder and Honig2002; Bjelland et al., Reference Bjelland, Dahl, Haug and Neckelmann2002; Lowe et al., Reference Lowe2004; Bambauer et al., Reference Bambauer, Locke, Aupont, Mullan and McLaughlin2005). In our study, the ROC curve also indicated that the above cut-off score was the most appropriate. Nevertheless, sensitivity, specificity, and accuracy were far lower than those described in younger populations, strongly suggesting that the HADD should not be used in the hospitalized elderly. Furthermore, AUCs were significantly low (0.60–0.65) compared with the value of 0.8 generally preferred in clinical tests, or those reported in younger populations (0.81–0.96; Aben et al., Reference Aben, Verhey, Lousberg, Lodder and Honig2002; Bambauer et al., Reference Bambauer, Locke, Aupont, Mullan and McLaughlin2005; Rodgers et al., Reference Rodgers, Martin, Morse, Kendell and Verrill2005; Poole and Morgan, Reference Poole and Morgan2006). Importantly, analysis by CDR group revealed only minor changes in the performance of the HADD and similar AUCS between the three groups, indicating that the modest performance of this scale in our study population was not strongly related to the presence of dementia.
Our study has several limitations. First, the depressed group included patients with various subtypes and only eight patients had severe forms of depression. Thus, we have insufficient power to report the performance of the HADD for severe depression. However, because screening tools such as the HADD are mostly used to identify cases that might otherwise go clinically undetected, its rather low sensitivity and inability to reliably detect milder cases is the most serious concern. Second, the delay between the psychiatric and neuropsychological evaluations was at times quite long and some of the depressed cases may have sufficiently improved between the two assessments to score negatively on the HADD. To take into account this potentially significant bias, we repeated the multiple regression analyses in three sub-samples including only cases with a maximum delay between assessments of 28, 21, and 14 days. The AUC remained low in all three groups, suggesting that the relatively poor performance of the HADD was not strongly related to the above delay. Although sensitivity, specificity, and accuracy improved with shorter delays, their values also remained low, even in the group with a delay of 14 days or fewer, thus confirming that delay was not the main reason for the disappointing performance of the HADD. Finally, in keeping with a quality-control investigation, we used a convenience sample that included only cases that received both cognitive and psychiatric evaluations. This sample was not meant to be representative of all patients assessed in the memory consultation, but differences with non-included patients were minor. Moreover, some cases with very mild cognitive or depressive symptoms for whom psychiatric and memory assessments were not requested by the treating resident might have been inappropriately excluded from the study.
In our experience, the HADD did not perform well in older hospitalized patients both with or without dementia. Further prospective studies are warranted to explore this issue and to compare the HADD with other depression scales that have been developed for use in the elderly.
Conflicts of interest
None.
Description of authors’ roles
Nikolaos Samaras designed the study, collected data, performed the literature review, and wrote the paper. François R. Herrmann assisted in designing the study and writing of the paper, and performed the statistical analysis. Dimitrios Samaras assisted with the data collection and writing of the paper. Pierre-Olivier Lang assisted with writing of the paper and the statistical analysis. Alessandra Canuto and Alexandre Forster assisted with writing of the paper and data collection. Henriette Hilleret performed the patients’ psychiatric evaluation and assisted with writing of the paper. Gabriel Gold performed the patients’ memory evaluation, participated in the design of the study and writing of the paper.
Acknowledgments
We thank our team of neuropsychologists (Lara Fazio, Malika Claire Fabjan, Delia Antille, Anne-Marie Bugnon, Myriam Büchelin-Fazio, and Joëlle Emmenegger) for their contribution in passing the HADD scale.