2010-International Journal of Methods in Psychiatric Research
2010-International Journal of Methods in Psychiatric Research
Table 1 Proportion of respondents stratified by age range Table 2 Socio-demographic distribution of individuals with
and scores strata on the ASRS Screener, weighted to rep- positive screening for ADHD
resent the Brazilian population
Percentage Odds ratio
Age range (years) Characteristic (SE)1 (95% CI)2
1.17, indicating a reasonable fit among the respondents in cational level. Items 1, 2, 3 and 5 showed altered thresholds.
the sample (Table 3). With respect to reliability, the PSI Altered thresholds were reordered in the three sets of analy-
statistic was 0.808, which indicates that the ASRS Screener ses and did not result in a significant improvement of the
has good person separation reliability. The same pattern overall performance of the scale.
of results was confirmed in a random sample of 1000
subjects.
Discussion
Subsequently, we stratified the sample in three catego-
ries according to age range (14 to 17, 18 to 44, and older We have evaluated the prevalence of individuals with posi-
than 44) to test the hypothesis that the misfit of the data to tive screening for ADHD in a representative sample of
the model was related to age. Data from each age group household Brazilian population. It was estimated that
were tested against the Rasch model separately. The PSI approximately 6% of the Brazilian population screens
statistic varied from 0.80 to 0.82 for the three groups, indi- positive for ADHD based on the ASRS Screener. This is the
cating that ASRS Screener has good internal consistency first representative survey conducted in Brazil that evalu-
reliability. In the group of adolescents, item–trait ated adult ADHD and the fourth conducted in a develop-
interaction showed borderline significance (c2 = 44.6; ing country to date.
p = 0.04) indicating a slight variability on hierarchical We found a significant higher prevalence of positive
ordering of items across the trait. The residual mean value screeners among women, a finding also detected in the
for items was 0.53 (SD 0.68) and the residual mean value for subgroup of 18 to 44 years of age. It is well established the
persons was -0.29 (SD 1.16). There were no items display- higher prevalence of ADHD among boys, specially in clini-
ing DIF or presenting misfit. Items 1, 2, 3 and 4 showed cal samples (Pliszka, 2007). However, in community
altered thresholds. In the strata composed by individuals samples, the difference of ADHD rates between boys and
age 18 to 44, item–trait interaction was highly significant girls is less prominent (Polanczyk and Rohde, 2007). A
(c2 = 185.3; p < 0.001) indicating a lack of hierarchical scarcity of data had been published on this matter among
ordering of items across the trait. The residual mean value adults. Kessler et al. (2006) and Fayyad et al. (2007) found
for items was 0.74 (SD 2.44) and the residual mean value for a higher prevalence of ADHD among men in their sample,
persons was -0.27 (SD 1.14). Items 1, 2, 4 and 6 showed with modest OR (1.6 and 1.5, respectively). Kooij et al.
misfit to model expectation and items 4 and 6 showed some (2005) explored the validity of two different cut-off points
degree of uniform DIF regarding social class. Moreover, (six and four symptoms) for the diagnosis of ADHD and
item 6 showed DIF regarding demographic region in Brazil. found no gender effect when applying the cut-off of six
Items 1 and 3 showed altered thresholds. In the group of symptoms but a higher prevalence of females when apply-
subjects older than 44 years of age, item–trait interaction ing the cut-off of four symptoms. The authors ruled out a
was also highly significant (c2 = 90,3; p < 0.001) indicating confounding effect of comorbidities and hypothesized that
an altered hierarchical ordering of items across the trait. women during adulthood may be more sensitive than men
The residual mean value for items was 0.42 (SD 1.79) and to the identification of symptoms. An alternative explana-
the residual mean value for persons was -0.3 (SD 1.26). tion is that the stability of ADHD symptoms during the
Items 1, 2 and 6 showed misfit to model expectation and lifetime might be higher in women. We cannot exclude that
item 6 showed uniform DIF regarding social class and edu- the presence of other mental disorders (e.g depression or
anxiety) have a role in the higher prevalence of ADHD adolescents did not. In this regard, our results, along with
among women in our sample. Our results, in conjunction previous studies, may indicate the existence of problems in
with those from Kooj’s investigation (Kooij et al., 2005), the construct validity of ADHD diagnostic criteria for
points to this intriguing hypothesis, which deserves further adults, since this diagnosis was more extensively validated
study. However, the fact that a higher prevalence of women in children and adolescents (Pliszka, 2007; Rohde, 2008;
screened positive on ASRS Screener may not necessarily Wilens et al., 2004).
reflect a higher prevalence of ADHD in this group. The The results from the first study to assess ADHD symp-
instrument is a screening tool and, although presented toms in a representative sample of the Brazilian population
adequate sensitivity (68.7%), specificity (99.5%), and total indicated that these are common problems in all age ranges
classification accuracy (97.9%), there are uncertainties in this country. Furthermore, our results point to the rel-
about the appropriate scoring method (Kessler et al., evance of evaluating both the validity of constructs which
2005). investigators intend to measure, and the properties of the
Aiming to assess the adequacy of the ADHD construct scales used in this field. The phenomenology of ADHD in
and ASRS Screener, we evaluated the data in relation to the adults seem to be specific and a list of symptoms that takes
Rasch model (Chachamovich et al., 2008; Hartman et al., into account this developmental perspective must be devel-
2008; Tennant et al., 2004). It is important to note that oped and validated in this age group before any effort to
previous epidemiological investigations in the adult integrate adult ADHD diagnosis in future classificatory
ADHD have not assessed the psychometric properties of systems.
the instruments used in light of more recent approaches
like IRT. Our results from Rasch analyses provides several
Acknowledgements
interesting insights to the ADHD and to the epidemiology
field in general. We showed that data pertaining the overall The authors thank Marcos Sanches and Eduardo Chachamov-
sample did not fit the model. Since conceptual assump- ich for their valuable contributions to this study.
tions of the Rasch model support its independence of the
individuals who answer the items (i.e. sample indepen- Funding source
dent) (Andrich, 1988), this finding should call attention
to the necessity of the evaluation of psychometric Funding for this study was provided by Secretária Nacional
properties of instruments in different populations with Antidrogas, Federal Government of Brazil, which had no
further role in study design; in the collection, analysis and
complementary methodological approaches. The absence
interpretation of data; in the writing of the report; and in the
of fitness to the model challenges the possibility of a linear
decision to submit the paper for publication.
transformation of the ordinal data from the ASRS into
interval measures, as originally proposed (Kessler et al.,
2007). This has an important practical implication: since Declaration of interest statement
the interval between two scores may not be the same along Dr Polanczyk has served as a speaker for Novartis and is a
the entire continuum, mathematical operations and para- recipient of a 2008 National Alliance of Research on Schizo-
metric analysis of data may not be possible (Andrich, 1988; phrenia and Depression (NARSAD) Young Investigator
Pallant and Tennant, 2007). Thus, any epidemiological data Award. Dr Rohde was on the speakers’ bureau and/or acted as
based on cut-off scores derived from models assuming consultant for Eli-Lilly, Janssen-Cilag, and Novartis in the last
interval properties of the data is questionable without the three years. Currently, his only industry related activity is
appropriate testing. taking part of the advisory board/speakers bureau for Eli Lilly,
A relevant finding is the superior fitness to the Rasch Novartis, and Shire (less than U$10,000 per year and reflecting
less than 5% of his gross income per year). The ADHD and
model for data provided by adolescents in relation to data
Juvenile Bipolar Disorder Outpatient Programs chaired by
answered by adults (18 to 44 years old and 45 years old or
him received unrestricted educational and research support
more). This very interesting result is in complete agree- from the following pharmaceutical companies in the last three
ment with previous studies (Merrell and Tymms, 2005; years: Abbott, Bristol-Myers Squibb, Eli-Lilly, Janssen-Cilag,
Smith and Johnson, 2000) that evaluated the ADHD crite- Novartis, and Shire.
ria with the Rasch model, indicating that the same behav-
ioral scale for ADHD could not be used by young children
References
and college students. ASRS Screener was constructed after
the adaptation of each ADHD criterion to adulthood. Even Andrich D. (1988) Rasch Models for Measurement, Sage
so, data from adults misfit the model, while data from Publications.
Brown T.E. (2006) Toward an adequate understanding of Screener in a representative sample of health plan
attention deficit disorders. Revista Brasileira de Psiquiatria, members. International Journal of Methods in Psychiatric
28, 261–262. Research, 16, 52–65.
Chachamovich E., Fleck M., Trentini C.M., Power M. (2008) Kooij J.J., Buitelaar J.K., van den Oord E.J., Furer J.W., Rijnders
The Brazilian WHOQOL-OLD Module version: a Rasch C.A., Hodiamont P.P. (2005) Internal and external validity
analysis of a new measure. Revista de Saúde Pública, 42, of attention-deficit hyperactivity disorder in a population-
308–316. based sample of adults. Psychological Medicine, 35, 817–
de Graaf R., Kessler R.C., Fayyad J., Ten Have M., Alonso J., 827.
Angermeyer M., Borges G., Demyttenaere K., Gasquet I., McGough J.J., Barkley R.A. (2004) Diagnostic controversies in
de Girolamo G., Haro J.M., Jin R., Karam E.G., Ormel J., adult attention deficit hyperactivity disorder. American
Posada-Villa J. (2008) The prevalence and effects of Adult Journal of Psychiatry, 161, 1948–1956.
Attention-Deficit/hyperactivity Disorder (ADHD) on the Merrell C., Tymms P. (2005) Rasch analysis of inattentive,
performance of workers: results from the WHO World hyperactive and impulsive behaviour in young children
Mental Health Survey Initiative. Occupational and and the link with academic achievement. Journal of Applied
Environmental Medicine, 65, 835–842. DOI: 10.1136/ Measurement, 6, 1–18.
oem.2007.038448 Pallant J.F., Tennant A. (2007) An introduction to the Rasch
Faraone S.V., Biederman J. (2005) What is the prevalence of measurement model: an example using the Hospital
adult ADHD? Results of a population screen of 966 adults. Anxiety and Depression Scale (HADS). British Journal of
Journal of Attention Disorders, 9, 384–391. Clinical Psychology, 46, 1–18.
Fayyad J., De Graaf R., Kessler R., Alonso J., Angermeyer M., Pechansky F., De Boni R., Diemen L.V., Bumaguin D., Pinsky
Demyttenaere K., De Girolamo G., Haro J.M., Karam E.G., I., Zaleski M., Caetano R., Laranjeira R. (2009) Highly
Lara C., Lepine J.P., Ormel J., Posada-Villa J., Zaslavsky reported prevalence of drinking and driving in Brazil: data
A.M., Jin R. (2007) Cross-national prevalence and corre- from the first representative household study. Revista
lates of adult attention-deficit hyperactivity disorder. Brasileira de Psiquiatria, 31, 125–130.
British Journal of Psychiatry, 190, 402–409. Pliszka S. (2007) Practice parameter for the assessment and
Gomez R. (2008) Item response theory analyses of the treatment of children and adolescents with attention-
parent and teacher ratings of the DSM-IV ADHD rating deficit/hyperactivity disorder. Journal of the American
scale. Journal of Abnormal Child Psychology, 36, 865– Academy of Child and Adolescent Psychiatry, 46, 894–
885. 921.
Hartman C.A., Gelhorn H., Crowley T.J., Sakai J.T., Stallings Polanczyk G., Lima M.S., Horta B.L., Biederman J., Rohde L.A.
M., Young S.E., Rhee S.H., Corley R., Hewitt J.K., Hopfer (2007) The worldwide prevalence of ADHD: a systematic
C.J. (2008) Item response theory analysis of DSM-IV can- review and metaregression analysis. American Journal of
nabis abuse and dependence criteria in adolescents. Journal Psychiatry, 164, 942–948.
of the American Academy of Child and Adolescent Psychia- Polanczyk G., Rohde L.A. (2007) Epidemiology of attention-
try, 47, 165–173. deficit/hyperactivity disorder across the lifespan. Current
Ietsugu T., Sukigara M., Furukawa T.A. (2007) Evaluation of Opinion in Psychiatry, 20, 386–392.
diagnostic criteria for panic attack using item response Rasch G. (1960) Probabilistic Models for Some Intelligence and
theory: findings from the National Comorbidity Survey in Attainment Tests, University of Chicago Press.
USA. Journal of Affective Disorders, 104, 197–201. Rohde L.A. (2008) Is there a need to reformulate attention
Kessler R.C., Adler L., Ames M., Demler O., Faraone S., Hiripi deficit hyperactivity disorder criteria in future nosologic
E., Howes M.J., Jin R., Secnik K., Spencer T., Ustun T.B., classifications? Child & Adolescent Psychiatric Clinics of
Walters E.E. (2005) The World Health Organization Adult North America, 17, 405–420.
ADHD Self-Report Scale (ASRS): a short screening scale Rutter M. (2006) Pesquisa de mercado, Ática.
for use in the general population. Psychological Medicine, Smith E.V.J., Johnson B.D. (2000) Attention deficit hyperac-
35, 245–256. tivity disorder: scaling and standard setting using Rasch
Kessler R.C., Adler L., Barkley R., Biederman J., Conners C.K., measurement. Journal of Applied Measurement, 1, 3–
Demler O., Faraone S.V., Greenhill L.L., Howes M.J., Secnik 24.
K., Spencer T., Ustun T.B., Walters E.E., Zaslavsky A.M. Tennant A., Penta M., Tesio L., Grimby G., Thonnard J.L.,
(2006) The prevalence and correlates of adult ADHD in the Slade A., Lawton G., Simone A., Carter J., Lundgren-
United States: results from the National Comorbidity Nilsson A., Tripolski M., Ring H., Biering-Sorensen F.,
Survey Replication. American Journal of Psychiatry, 163, Marincek C., Burger H., Phillips S. (2004) Assessing and
716–723. adjusting for cross-cultural validity of impairment and
Kessler R.C., Adler L.A., Gruber M.J., Sarawate C.A., Spencer activity limitation scales through differential item func-
T., Van Brunt D.L. (2007) Validity of the World Health tioning within the framework of the Rasch model: the
Organization Adult ADHD Self-Report Scale (ASRS) PRO-ESOR project. Medical Care, 42, I37–I48.
Wilens T.E., Faraone S.V., Biederman J. (2004) Attention- Willoughby M.T. (2003) Developmental course of ADHD
deficit/hyperactivity disorder in adults. Journal of the symptomatology during the transition from childhood to
American Medical Association, 292, 619–623. adolescence: a review with recommendations. Journal of
Child Psychology and Psychiatry, 44, 88–106.