Introduction
Attention-deficit/hyperactivity disorder (ADHD) is a prevalent and often persistent developmental disorder, characterised by age-inappropriate and impairing levels of inattention and/or hyperactivity–impulsivity. ADHD has been associated with a broad range of neurocognitive deficits, including impaired executive functioning (Willcutt et al. Reference Willcutt, Doyle, Nigg, Faraone and Pennington2005), timing deficits (Noreika et al. Reference Noreika, Falter and Rubia2013) and higher response time variability (Klein et al. Reference Klein, Wendling, Huettner, Ruder and Peper2006). In the majority of individuals with ADHD, stimulants acutely reduce symptoms (Swanson et al. Reference Swanson, Kraemer, Hinshaw, Arnold, Conners and Abikoff2001) and improve neurocognitive functioning (Coghill et al. Reference Coghill, Seth, Pedroso, Usala, Currie and Gagliano2014). Concerns about potential harmful long-term effects of stimulant treatment, as well as anticipation of potential lasting benefits of treatment have dominated the public and scientific debate. Adequately investigating long-term treatment effects, especially in children, is methodologically and ethically challenging, hence evidence for either positive or negative long-term outcomes of stimulant treatment is equivocal. In the Multimodal Treatment Study of ADHD (MTA), the largest controlled treatment study to date, the benefits of 14 months of stimulant treatment on a broad range of outcomes rapidly diminished in the subsequent observational phase (MTA Cooperative Group, 1999; Swanson et al. Reference Swanson, Hinshaw, Arnold, Gibbons, Marcus and Hur2007; Molina et al. Reference Molina, Hinshaw, Swanson, Arnold, Vitiello and Jensen2009). In the MTA study, outcomes were assessed without a medication wash-out phase, which impedes the distinction between lasting effects of prior treatment and acute effects of ongoing treatment. When rated while off-medication, ADHD symptoms were found not to change with 1 year of stimulant treatment (Huang et al. Reference Huang, Wang and Chen2012). Attention task performance and IQ did improve over the course of 1 year, but in the absence of a comparable non-treated or healthy control group, these changes may reflect normal maturation (Tsai et al. Reference Tsai, Huang, Wu, Hwang, Young and Tsai2013). Observational studies have reported higher ADHD persistence rates in stimulant-treated patients compared with non-treated patients (Biederman et al. Reference Biederman, Petty, O'Connor, Hyder and Faraone2012; van Lieshout et al. Reference van Lieshout, Luman, Twisk, van Ewijk, Groenman and Thissen2016), while at the same time, rates of comorbidity were found to be lower in treated patients (Biederman et al. Reference Biederman, Monuteaux, Spencer, Wilens and Faraone2009). Importantly, in these studies confounding-by-indication and self-selection could not satisfactorily be addressed. Here, we applied stringent matching procedures to derive two comparable ADHD samples from a large prospective cohort study (i.e. stimulant-treated and not stimulant-treated) as well as a typically developing reference group. Outcomes were repeatedly measured over 6 years, always while participants were in their non-medicated state. We investigated whether stimulant treatment between baseline and follow-up predicted the developmental trajectory of ADHD symptoms, social–emotional functioning and/or cognitive functioning in the following domains: motor control, timing and verbal working memory. Note that, while there is evidence that these domains are affected in ADHD and may benefit (acutely) from methylphenidate treatment (Rubia et al. Reference Rubia, Noorloos, Smith, Gunning and Sergeant2003; Yang et al. Reference Yang, Cao, Shuai, Li, Chan and Wang2012; Kaiser et al. Reference Kaiser, Schoemaker, Albaret and Geuze2014), our choice of cognitive domains was limited by task availability. Tasks measuring response inhibition, reward sensitivity and visuospatial (rather than verbal) working memory would have been highly informative but unfortunately were unavailable within the current sample.
Methods
Participants
Participants were drawn from the prospective multi-centre IMAGE-NeuroIMAGE cohort study (von Rhein et al. Reference von Rhein, Mennes, van Ewijk, Groenman, Zwiers and Oosterlaan2015). The full cohort includes 751 children, adolescents and young adults with ADHD from 590 families. At baseline, ADHD diagnosis was ascertained using the Strengths and Difficulties Questionnaire (SDQ; >90th percentile on the hyperactivity subscale; van Widenfelt et al. Reference van Widenfelt, Goedhart, Treffers and Goodman2003), the parent- and teacher-rated Conners’ ADHD scales (CPRS and CTRS; T ⩾ 63 on the DSM inattentive or hyperactive/impulsive scale; Conners et al. Reference Conners, Sitarenios, Parker and Epstein1998a, Reference Conners, Sitarenios, Parker and Epsteinb) and the Parental Account of Children's Symptoms interview (PACS; ⩾6 symptoms, present in ⩾2 situations and ⩾1 symptom reported by the teacher; Tailor, 1986). Participants with ⩾6 symptoms but who did not fulfil all diagnostic criteria were classified as subthreshold ADHD. At follow-up, ADHD diagnosis in participants <18 years was ascertained again using the same CPRS and CTRS criteria, complemented with the Schedule for Affective Disorders and Schizophrenia for School-Age Children interview (K-SADS; ⩾6 symptoms, present in ⩾2 situations, causing impairment, and onset before age 12; Kaufman et al. Reference Kaufman, Birmaher, Brent, Rao, Flynn and Moreci1997). For participants ⩾18 years, the self-rated Conners’ scale (CAARS; Conners et al. Reference Conners, Erhardt and Sparrow1999) was used instead of the teacher-rated scale, and five symptoms were sufficient for diagnosis. Participants who scored T ⩾ 63 on either of the Conners’ scales or had sufficient symptoms, but did not fulfil all diagnostic criteria, were classified as subthreshold ADHD.
Average follow-up time was 5.9 years (s.d. = 0.6), and the retention rate was high (77%). We applied the following inclusion criteria: (1) participation at baseline and follow-up, (2) diagnosis of (subthreshold) ADHD at baseline and/or at follow-up, (3) IQ>70 at baseline and follow-up, and (4) no known genetic or neurological disorders. Eligible participants were split according to treatment between baseline and follow-up into stimulant-treated (n = 337) and not stimulant-treated participants (n = 138). Stimulant treatment prior to baseline and treatment with non-stimulant psychoactive medication was allowed in both groups. From the two ADHD groups, we selected all participants who had a one-to-one match on gender, age (±<0.5 s.d.) and baseline number of ADHD symptoms (± < 0.5 s.d.). This resulted in two comparable groups of 74 participants with ADHD each (Table 1).
Baseline characteristics of the two treatment groups
Stat = χ2 for categorical variables, Student's t test for continuous variables.
a Significant difference between treated and non-treated participants
b Scores on the anxiety/shyness scale, perfectionism scale and psychosomatic problems scale of the parent- and teacher-rated Conners’ questionnaires were used as a proxy of baseline comorbid problems.
For reference, a gender- and age-matched healthy control sample was drawn from the IMAGE-NeuroIMAGE cohort as well, applying the same inclusion and matching criteria (except inclusion criterion 2/symptom-matching). In addition, control participants had no first-degree relatives with psychiatric disorders, as ascertained by interview. All assessments took place at two sites in the Netherlands. Participants were asked to withhold use of psychoactive drugs for 48 h before each assessment. Informed consent was signed by all participants and their parents (only parents signed informed consent for participants <12 years). Procedures were approved by the local ethical committee of each site.
Stimulant treatment
Participants and parents provided written consent to request prescription records from their pharmacies. In addition, they reported lifetime history of psychoactive medication in a questionnaire at follow-up measurement. Pharmacy data covering the baseline–follow-up interval were available for 91% of participants with ADHD (n = 135). Participants were classified as stimulant-treated if they had been prescribed any immediate or extended release methylphenidate preparations, or d-amphetamine preparations, between baseline and follow-up. When pharmacy transcripts were not available or incomplete (n = 13), treatment history was derived from the questionnaire data. The questionnaire data were also used to determine stimulant treatment prior to baseline (‘previously treated’ or ‘stimulant-naïve’) for all participants.
Outcome measures
Parent-rated numbers of hyperactivity–impulsivity and inattention symptoms were measured at baseline and follow-up using the respective DSM subscales of the CPRS (range 0–27). For participants using medication, parents were instructed to rate behaviour in the participant's non-medicated state. Four indicators of social–emotional functioning were derived from the SDQ for both time points: problems with emotion regulation, problems with peer relationships, conduct problems and prosocial behaviour (range 0–10).
In addition, six cognitive tests were administered at both baseline and follow-up. Three tasks measured motor control: baseline speed, in which participants were required to press a key upon unpredictable appearance of a stimulus; pursuit, where participants followed a randomly moving target with the cursor as precisely as possible; and tracking, in which participants were required to trace an invisible midline between an inner and an outer circle as precisely as possible. Two tasks measured timing: time estimation, where participants were asked to reproduce the duration of visually presented stimuli of different lengths (4, 8, 12, 16 and 20 s); and motor timing, in which participants were instructed to produce 1 s intervals as accurately as possible. Working memory was assessed in the backwards condition of the digit span test (WISC-III/WAIS-III), in which participants had to reproduce an increasingly long sequence of numbers in reverse order. Details are in Table 2. We note that several cognitive domains that are relevant to ADHD, including inhibition and delay aversion, were not available at both time points and could not be evaluated here.
Neurocognitive tasks
N = number of participants with ADHD who completed the task at baseline and at follow-up.
Statistical analyses
We used linear mixed-effects models, predicting symptoms of hyperactivity/impulsivity and inattention, each of the four social–emotional outcomes, and performance on each cognitive test from time (baseline or follow-up), treatment (stimulant-treated or not stimulant-treated during the study phase) and time-by-treatment interaction. The effect of interest is captured in the time-by-treatment interaction, which evaluated whether the outcome variables changed differently over time for the stimulant-treated group compared with the non-treated group. Baseline demographic/clinical between-group differences that remained despite matching [testing site, socio-economic status (SES) and treatment prior to baseline] were included as covariates, as was a random intercept per family to account for dependencies among siblings. Multiple testing was accounted for by Bonferroni adjustment: α was divided by two for ADHD symptoms (α = 0.05/2 = 0.025), by four for social–emotional outcomes (α = 0.012) and by six for cognitive outcomes (α = 0.008).
Previous work by our group described changes over time in ADHD symptoms in participants with ADHD compared with typically developing participants (van Lieshout et al. Reference van Lieshout, Luman, Twisk, van Ewijk, Groenman and Thissen2016). Case–control differences are thus not the focus of the current study. Rather, the matched control group was used as a reference group for normative developmental changes. For visualisation of estimated marginal means of all groups (stimulant-treated, not stimulant-treated and control), the models described above were re-estimated across all participants with a fixed factor for group.
Sensitivity analyses were performed to test the robustness of our findings. With a relatively short wash-out time (48 h), immediate withdrawal effects may have affected cognitive functioning in participants who received ongoing treatment at the time of measurement. Therefore, analyses were repeated with an additional covariate encoding whether participants were actively being treated with stimulants within 6 months prior to assessment or not, and its interaction with the effect of interest (active treatment × time × treatment between baseline and follow-up). Second, all analyses were repeated with baseline age as an additional predictor, to address the wide age range within our sample. Here, similarly, change over time in each outcome variable was predicted from age-by-treatment interaction, thus analysing whether the effect of treatment on clinical/social–emotional/cognitive changes over time was different for participants of different ages.
Results
Mean age of participants with ADHD was 11.1 years (s.d. = 3.2) at baseline and 17.0 years (s.d. = 3.3) at follow-up. Fifty-eight per cent of participants were male. Participants were diagnosed with ADHD or subthreshold ADHD at baseline (n = 135, 91.2%) and/or at follow-up (n = 132, 89.2%). Most participants reached diagnostic criteria at both times (n = 119, 80.41%). Fifteen participants (10.1%) with subthreshold ADHD never met criteria for full ADHD diagnosis. At baseline, the majority of participants had combined type ADHD (n = 94, 63.5%), while at follow-up, the majority had either combined type (n = 40, 27.0%) or inattentive type (n = 51, 34.5%), with no differences between groups (Table 1). Within the stimulant-treated group, average cumulative stimulant dose between baseline and follow-up was 43 336 mg, which equals 5.9 years of 20.1 mg per day. Forty participants (54.1%) had received active stimulant treatment within 6 months prior to follow-up assessment; the other participants had ceased stimulant treatment earlier. Participants in the stimulant-treated group were from lower socio-economic backgrounds (p = 0.035), were more likely to have received stimulant treatment prior to the initial assessment (χ2 = 31.335, p = 0.001) and more likely to have received atomoxetine treatment between baseline and follow-up (n OVERALL = 16, 10.8%; n TREATED = 13, 17.6%; n NON−TREATED = 3, 4.1%; χ2 = 6.862, p = 0.009). There was a site effect for stimulant treatment as well (χ2 = 9.759, p = 0.002). Site, SES and prior treatment were therefore added as covariates in all between-group comparisons. At baseline, the two treatment groups did not differ from each other with regard to any of the clinical or cognitive outcome measures.
There was a significant main effect of time on ADHD symptoms, as well as on two out of four social–emotional outcome measures (Table 3). Across all participants with ADHD, symptoms of hyperactivity/impulsivity and inattention, peer problems and conduct problems improved between baseline and follow-up. There were no main effects of time on emotional problems or prosocial behaviour. Improvement over time was also found for performance on all cognitive tasks: participants showed lower baseline speed variability, smaller deviations on the tracking, pursuit and time estimation tasks, and higher maximum digit span at follow-up compared with baseline. Potential confounder's site and SES had no main effect on any outcome with one exception: lower SES was nominally associated with more peer problems (t = −2.340, p = 0.021).
Baseline and follow-up scores across treatment groups, and the effects of time, treatment and time-by-treatment interaction
EMM = estimated mean score across participants with ADHD, adjusted for stimulant treatment prior to baseline measurement, site and SES.
*p < 0.012 or p < 0.008.
There were no main effects of treatment group, and no time-by-treatment-group interaction effects on any of the outcome measures (Table 3, Fig. 1 and Fig. 2). Thus, changes in ADHD symptoms, social–emotional and cognitive functioning over time were the same for participants who received stimulant treatment between baseline and follow-up and those who had not. Moreover, changes over time were the same for participants on active stimulant treatment at follow-up assessment and those who were not, suggesting no confounding by withdrawal effects. Finally, there were no significant interactions with age, site or SES, suggesting that treatment effects were similar at different levels of these covariates.
Change in ADHD symptoms and social–emotional functioning over ~6 years, for stimulant-treated (green) and non-treated (red) participants with ADHD, and control participants (grey). Groups are matched on baseline age and gender, and ADHD groups are matched on baseline ADHD symptoms. Baseline social–emotional outcomes were not assessed for typically developing participants. The slopes of the two treatment groups did not differ for any outcome.
Change in cognitive test performance over ~6 years, for stimulant-treated (green) and non-treated (red) participants with ADHD, and control participants (grey). Groups are matched on baseline age and gender, and ADHD groups are matched on baseline ADHD symptoms. The slopes of the two treatment groups did not differ for any outcome.
Discussion
We investigated developmental changes in a broad spectrum of outcomes, including ADHD symptoms, social–emotional functioning and cognition, in two groups of individuals with ADHD defined by whether they had been treated with stimulants or not. The groups were stringently matched on baseline characteristics and were non-medicated at both assessments. We found no evidence for any (beneficial or adverse) stimulant treatment effects persisting after stimulant treatment had (temporarily) been ceased. ADHD symptoms, peer problems, conduct problems and performance on tests of motor control, timing and working memory improved over time, but improvement occurred irrespective of treatment. Even at a lenient threshold for statistical significance, stimulant treatment was not associated with any of the outcomes.
Our findings put into perspective previous studies reporting potential beneficial long-term effects of stimulant treatment that did not allow firm conclusions. First, previous studies reporting long-term beneficial treatment effects typically assessed outcomes when patients were on active treatment (e.g. Abikoff et al. Reference Abikoff, Hechtman, Klein, Weiss, Fleiss and Etcovitch2004; Charach et al. Reference Charach, Ickowicz and Schachar2004). Their findings may thus represent either lasting effects of prior treatment, transient effects of ongoing treatment or a combination of both. Our findings, in conjunction with reports of better outcome during phases of active stimulant treatment (Lichtenstein et al. Reference Lichtenstein, Halldner, Zetterqvist, Sjolander, Serlachius and Fazel2012; Chang et al. Reference Chang, D'Onofrio, Quinn, Lichtenstein and Larsson2016) suggest that previously reported long-term effects may be driven by ongoing transient effects rather than lasting effects. The absence of lasting treatment effects in our sample aligns with negative long-term findings during the observational phase of the MTA study, which have previously been attributed to self-selection (Swanson et al. Reference Swanson, Hinshaw, Arnold, Gibbons, Marcus and Hur2007; Molina et al. Reference Molina, Hinshaw, Swanson, Arnold, Vitiello and Jensen2009). Our findings, however, underline the possibility that the theorised long-term effects may in fact not occur. At the same time, we wish to emphasise that beneficial long-term treatment effects have been found in outcomes that were not addressed here, such as the development of comorbid disorders later in life (Biederman et al. Reference Biederman, Monuteaux, Spencer, Wilens and Faraone2009).
Second, our findings are in line with a previous report of improved attention task performance after a 1-year stimulant treatment episode even while off medication (Huang et al. Reference Huang, Wang and Chen2012), which, in the absence of a reference group, could indicate either lasting beneficial treatment effects or improved cognitive performance at older age. In the current study, changes over time were the same in the treated and non-treated groups, suggesting that improvement over time is not related to treatment.
Third, several previous studies have reported more severe and/or more persistent ADHD in individuals who had received stimulant treatment during childhood, which could indicate either detrimental treatment effects or confounding-by-indication (Molina et al. Reference Molina, Hinshaw, Swanson, Arnold, Vitiello and Jensen2009; Biederman et al. Reference Biederman, Petty, O'Connor, Hyder and Faraone2012; van Lieshout et al. Reference van Lieshout, Luman, Twisk, van Ewijk, Groenman and Thissen2016). The current findings, free of confounding-by-indication due to stringent matching procedures and accounting for baseline measurements, provide no evidence of detrimental treatment effects.
The current findings are an important source to inform the scientific and public debate about pharmacological treatment for ADHD that has focused on long-term hazards and benefits. First, our findings emphasise that the developmental course of ADHD symptoms, social–emotional outcomes and cognitive functioning, at least for the areas of cognition assessed in the current study, are not altered by stimulant treatment. Previous work of our group showed that ADHD symptoms tend to decline but not disappear at later age (van Lieshout et al. Reference van Lieshout, Luman, Twisk, van Ewijk, Groenman and Thissen2016). The current results add to these findings by showing that this conclusion holds for both stimulant-treated and non-treated individuals. Second, the absence of long-term treatment effects on clinical and selected cognitive outcomes may guide the interpretation of findings of structural brain changes associated with stimulant treatment (or the absence thereof). The evidence for such an association is mixed (Shaw et al. Reference Shaw, Sharp, Morrison, Eckstrand, Greenstein and Clasen2009, Reference Shaw, De Rossi, Watson, Wharton, Greenstein and Raznahan2014; Schweren et al. Reference Schweren, Hartman, Heslenfeld, van der Meer, Franke and Oosterlaan2015). The absence of lasting treatment effects on a broad spectrum of clinical/behavioural outcomes emphasises the importance of investigating behavioural correlates and clinical relevance of stimulant effects on the brain.
This is the first longitudinal study investigating long-term treatment effects that included a non-treated ADHD and a typically developing sample, and reported on a wide spectrum of clinical and cognitive outcomes while participants were non-medicated. The average follow-up time of almost 6 years allowed the detection of effects emerging at later age, and captured the late adolescent/early adulthood phase that is often characterised by both clinical and normative developmental changes, which we were able to tease apart. Our rigorous one-to-one matching procedure allowed firm conclusions. Finally, extensive diagnostic assessments resulted in a well-characterised ADHD sample, and the availability of pharmacy records enabled highly reliable assessment of treatment history.
The current study had limitations as well. Treatment allocation was not random. We were able to rule out confounding-by-indication for all measured baseline variables other than testing site and SES, but not for non-measured potential between-group differences. Especially functional impairment and comorbidity could not satisfactorily be addressed. Propensity score adjustment would have been valuable in this regard. Confounding may also have occurred during the study phase, e.g. behavioural treatment (not assessed) may have been more common in one group compared with the other. Second, inclusion of matched participants was based on the smallest ADHD group, i.e. those who did not receive stimulant treatment between baseline and follow-up. This may have resulted in a sample that is less representative of the ADHD population. For example, the number of symptoms in the current sample was slightly lower, and the number of females was slightly higher, compared with the full sample as described elsewhere (von Rhein et al. Reference von Rhein, Mennes, van Ewijk, Groenman, Zwiers and Oosterlaan2015); the rate of symptom change between baseline and follow-up, however, was the same (data not shown). Third, cognitive domains that are pertinent to ADHD were not consistently assessed across time. Long-term changes may have occurred in these domains, while long-term changes may have been less likely to occur within the domains we were able to evaluate (e.g. verbal rather than visuospatial working memory). Finally, the current design did not allow full investigation of treatment timing, since participants had often initiated treatment prior to the baseline measurement and/or continued treatment after the follow-up measurement. Treatment at different ages may be associated with different long-term consequences, although in our sample, we found no indications of such effects.
In conclusion, we find no evidence that stimulant treatment may have a beneficial or detrimental effect on the long-term course of ADHD symptoms, social–emotional functioning, motor control, timing or verbal working memory. Using a prospective longitudinal study design, we show that clinical improvement of ADHD symptoms over the course of adolescence occurs in those who are treated with stimulants during that time, as well as in those who are not.
Acknowledgement
This work was supported by National Institutes of Health Grant (R01MH62873); Netherlands Organization for Scientific Research Large Investment Grant (JB, 1750102007010); ZonMW Priority Medicines for Children Grant (PH, 113202005); grants from Radboud University Nijmegen Medical Center, University Medical Center Groningen, Accare and the VU University Amsterdam. BF is supported by a Vici grant of the Netherlands Organization for Scientific Research (016-130-669).
Conflict of interest
Dr Buitelaar has been in the past 3 years a consultant to/member of advisory board of/and/or speaker for Janssen Cilag BV, Eli Lilly and Co., Shire, Novartis, Lundbeck and Servier. He is not an employee of any of these companies, or a stock shareholder of any of these companies. He has no other financial or material support, including expert testimony, patents or royalties. Dr Franke received an educational speaking fee from Merz. Dr Hoekstra has been a paid consultant to Shire and Eli Lilly and Co. Dr Hartman, Dr Heslenfeld, Dr Rommelse, Dr Oosterlaan, Dr Schweren and Ms. van Lieshout report no potential conflicts of interest.
Ethical standards
The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.
