This study employed a correlated trait—correlated method application of confirmatory factor analysis to disentangle trait and method variance from measures of attention-deficit/hyperactivity disorder obtained at the college level. The two trait factors were Diagnostic and Statistical Manual of Mental Disorders—Fourth Edition (DSM—IV ) Inattention and DSM—IV Hyperactivity-Impulsivity. The two source factors were self-reports and parent-reports. Data were collected for an epidemiological sample (N = 1,079) of college freshmen stratified for race/ethnicity, gender, and ability level according to national targets for the U.S. college population. Results revealed (a) parents' ratings were better measures of internalizing behavioral dimensions and that students' ratings were better measures of externalizing dimensions of behavior, (b) informants have a greater impact on behavior ratings than the behavioral construct that is presumed to be the primary cause of the behavior as measured by the CARE, (c) relationships among the method factors revealed a substantial amount of unique variance among informants, and (d) relationships among trait factors were largely within expectation.
Achenbach, T.M., McConaughy, S.H., & Howell, C.T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213-232.
2.
American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author .
3.
American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed., rev.). Washington, DC: Author.
4.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author .
5.
Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.) Upper Saddle River, NJ: Prentice Hall.
6.
Arbuckle, J.L., & Wothke, W. (1999). Amos 4.0 user's guide. Chicago : Small Waters.
7.
Atkins, M.S., Pelham, W.E., & Licht, M. (1985). A comparison of objective classroom measures and teacher ratings of attention deficit disorder. Journal of Abnormal Child Psychology, 13, 155-167.
8.
Bagozzi, R.P. & Yi, Y. (1990), Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. Journal of Applied Psychology, 75, 547-560.
9.
Bandalos, D., & Finney, J.S. (2001). Item parceling issues in structural equation modeling . In A. G. Marcoulides & E. R. Schumacker (Eds.), New developments and techniques in structural equation modeling (pp. 269-275). Hillsdale, NJ: Erlbaum.
10.
Barbett, S.F., & Korb, R.A. (1997). Enrollment in higher education: Fall 1995 (NCES 97-440). Washington, DC: U.S. Department of Education, Office of Educational Research and Improvement, National Center for Educational Statistics.
11.
Barkley, R.A. (1998). Attention-deficit hyperactivity disorder: A handbook of diagnosis and treatment (2nd ed.). New York: Guilford.
12.
Barkley, R.A., Fischer, M., Smallish, L., & Fletcher, K. (2002). The persistence of attention-deficit/hyperactivity disorder into young adulthood as a function of reporting source and definition of disorder. Journal of Abnormal Psychology, 111, 279-289.
13.
Barkley, R.A., Murphy, K.R., & Bush, T. (2001). Time estimation and reproduction in young adults with attention deficit hyperactivity disorder (ADHD). Neuropsychology , 15, 351-360.
14.
Bauermeister, J.J., Alegria, M., Bird, H., Robio-Stipec, M., & Canino, G. (1992). Are attentional-hyperactivity deficits unidimensional or multidimensional syndromes? Empirical findings from a community survey . Journal of the American Academy of Child and Adolescent Psychiatry, 31, 423-431.
15.
Bentler, P.M., & Bonett, D.G. (1980). Significance tests and goodness-of-fit in the analysis of covariance structures. Psychological Bulletin , 88, 588-606.
16.
Biederman, J., Faraone, S.V., Spencer, T., Wilens, T., Norman, D., Lapey, K.A., et al. (1993). Patterns of psychiatric comorbidity, cognition, and psychosocial functioning in adults with attention deficit hyperactivity disorder. American Journal of Psychiatry, 150, 1792-1798.
17.
Biederman, J., Faraone, S.V., Taylor, A., Sienna, M., Williamson, S., & Fine, C. (1998). Diagnostic continuity between child and adolescent ADHD: Findings from a longitudinal clinical sample. Journal of the American Academy of Child Adolescent Psychiatry, 37, 305-313.
18.
Biederman, J., Mick, E., & Faraone, S.V. (2000). Age-dependent decline of symptoms of attention deficit hyperactivity disorder: Impact of remission definition and symptom type. American Journal of Psychiatry, 157, 816-818.
19.
Biederman, J., Monuteaux, M.C., Mick, E., Spencer, T., Wilens, T.E., Snyder, L.E., et al. (2006). Young adult outcome of attention deficit hyperactivity disorder: A controlled 10-year follow-up study. Psychological Medicine, 36, 167-179.
20.
Bollen, K.A. (1989). Structural equations with latent variables. New York: Wiley.
21.
Browne, M.W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
22.
Burns, G.L., Walsh, J.A., & Gomez, R. (2003). Convergent and discriminant validity of trait and source effects in ADHD-inattention and hyperactivity/impulsivity measures across a 3-month interval. Journal of Abnormal Child Psychology , 31, 529-541.
23.
Byrne, B.M. (1988). Measuring adolescent self-concept: Factorial validity and equivalency of the SDQ III across gender. Multivariate Behavioral Research, 23, 361-375.
24.
Campbell, D.T., & Fiske, D.W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
25.
Canivez, G.L., Watkins, M.W., & Schaefer, B.A. (2002). Interrater agreement for discriminant classifications for the adjustment scales for children and adolescents . Psychology in the Schools, 39, 375-384.
26.
Cattell, R.B. (1957). Personality and motivation structure and measurement . Yonkers, NY: World Book.
27.
College Board. (2000). National SAT averages. New York: Author. Retrieved November 2000 from www.collegeboard.org/stat/cbsenior/html/sat00c.html
28.
Comrey, A.L., & Lee, H.B. (1992). A first course in factor analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
29.
Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
30.
Dauphinee, T.L., Schau, C., & Stevens, J.J. (1997). Survey of attitudes toward statistics: Factor structure and factorial invariance for women and men. Structural Equation Modeling, 4, 129-141.
31.
Donlon, T. F. (Ed.). (1984). The college board technical handbook for the scholastic aptitude test and achievement tests. New York: College Entrance Examination Board.
32.
DuPaul, G.J. (1991). Parent and teacher ratings of ADHD symptoms: Psychometric properties in a community-based sample. Journal of Clinical Child Psychology, 20, 242-253.
33.
DuPaul, G.J., Schaughency, E.A., Weyandt, L.L., Weyandt, G.T., Kiesner, J., Ota, K., et al. (2001). Self-report of ADHD symptoms in university students: Cross-gender and cross-national prevalence. Journal of Learning Disabilities, 34, 370-379.
34.
Fabrigar, L.R., Wegener, D.T., MacCallum, R.C., & Strahan, E.J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299.
35.
Fergusson, D.M., Lynskey, M.T., & Horwood, L.J. (1997). Attentional difficulties in middle childhood and psychosocial outcomes in young adulthood. Journal of Child Psychology & Psychiatry & Allied Disciplines, 38, 633-644.
36.
Fischer, M., Barkley, R.A., Fletcher, K.E., & Smallish, L. (1993). The stability of dimensions of behavior in ADHD and normal children over an 8-year period. Journal of Abnormal Child Psychology, 21, 315-337.
37.
Fiske, D.W. (1987). Construct invalidity comes from method effects . Educational and Psychological Measurement, 47, 285-336.
38.
Frazier, T.W., Youngstrom, E.A., Glutting, J.J., & Watkins, M.W. (2007). ADHD and achievement: Meta-analysis of the child, adolescent, and adult literatures and a concomitant study with college students . Journal of Learning Disabilities, 40, 49-65.
39.
Frick, P.J., Lahey, B.B., Appelgate, B., Kerdyk, L., Ollendick, T., Hynd, G.W., et al. (1994). DSM-IV field trials for the disruptive and attention deficit disorders: Diagnostic utility of symptoms. Journal of the American Academy of Child and Adolescent Psychiatry, 33, 529-539.
40.
Glutting, J.J., Adams, W., & Sheslow, D. (2000). Wide Range Intelligence Test (WRIT). Wilmington, DE: Wide Range.
41.
Glutting, J.J., & Kaplan, D.E. (1990). Stanford-Binet intelligence scale: Fourth edition: Making the case for reasonable interpretations. In C. R. Reynolds & R. W. Kamphaus (Eds.), Handbook of psychological and educational assessment: Vol. 1, Intelligence and achievement (pp. 277-295). New York: Guilford.
42.
Glutting, J.J., Monaghan, M.C., Adams, W., & Sheslow, D. (2002). Some psychometric properties of a system to measure ADHD among college students: Factor pattern, reliability, and one-year predictive validity. Measurement and Evaluation in Counseling and Development , 34, 194-208.
43.
Glutting, J., Sheslow, D., & Adams, W. (2002). The college ADHD response evaluation (CARE). Odessa, FL: Psychological Assessment Resources.
44.
Glutting, J.J., Youngstrom, E.A., & Watkins, M.W. (2005). ADHD and college students: Exploratory and confirmatory factor structures with student and parent data. Psychological Assessment, 17, 44-55.
45.
Gomez, R., Burns, G.L., Walsh, J.A., & de Moura, M.A. (2003). Trait, source, and error variance in ADHD symptoms in Australian and Brazilian children: A multitrait-multisource confirmatory factor analytic approach to the construct validity of ADHD rating scales. Psychological Assessment, 15, 3-16,
46.
Gomez, R., Harvey, J., Quick, C., Scharer, I., & Harris, G. (1999). DSM-V AD/HD: Confirmatory factor models, prevalence, and gender and age differences based on parent and teacher ratings of Australian primary school children. Journal of Child Psychology and Psychiatry , 40, 265-274.
47.
Gorsuch, R.L. (1997). Exploratory factor analysis: Its role in item analysis. In J. A. Schinka & R. L. Greene (Eds.), Emerging issues and methods in personality assessment (pp. 309-337). Mahwah, NJ : Erlbaum.
48.
Greenbaum, P.E., & Dedrick, R.F. (1998). Hierarchical confirmatory factor analysis of the Child Behavior Checklist/4-18. Psychological Assessment, 10, 149-155.
49.
Gregory, R.J. (1996). Psychological testing: History, principles, and applications (2nd ed.). Boston : Allyn & Bacon.
50.
Hall, R.J., Snell, A.F., & Foust, M.S. (1999). Item parceling strategies in SEM: Investigating the subtle effects of unmodeled secondary constructs. Organizational Research Methods, 2, 233-256.
51.
Hattie, A.J. (1986). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9, 139-164.
52.
Hayduk, L. (1996). LISREL issues, debates, and strategies. Baltimore: Johns Hopkins University Press.
53.
Heiligenstein, E., Conyers, L.M., Berns, A.R., & Smith, M.A. (1998). Preliminary normative data on DSM-IV attention deficit hyperactivity disorder in college students. College Health, 46, 185-188.
54.
Heiligenstein, E., Guenther, G., Levy, A., Savino, F., & Fulwiler, J. (1999). Psychological and academic functioning in college students with attention deficit hyperactivity disorder. College Health, 47, 181-185.
55.
Hinshaw, S.P., Henker, B., & Whalen, C.K. (1984). Cognitive-behavioral and pharmacologic interventions for hyperactive boys: Comparative and combined effects. Journal of Consulting and Clinical Psychology, 52, 739-749.
56.
Hu, L., & Bentler, P.M. (1995). Evaluating model fit. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76-99). Thousand Oaks, CA: Sage.
57.
Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
58.
Jackson, G.D., Lee, D.H., Oakland, T., & Glutting, J.J. (in press). Estimated prevalence of attention deficit hyperactivity disorder among postsecondary students: Rater, gender, and race/ethnicity effects. Journal of Learning Disabilities .
59.
Jensen, A.R. (1998). The g factor. Westport, CT : Praeger.
60.
Jöreskog, K.G. (1993). Testing structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 294-316). Newbury Park, CA: Sage.
61.
Kaplan, D. (1990). Evaluating and modifying covariance structure models: A review and recommendation. Multivariate Behavioral Research, 25, 137-155.
62.
Kenny, D.A., & Kashy, D.A. (1992). Analysis of the multitrait-multimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112, 165-172.
63.
Kessler, R.C., Adler, L., Barkley, R., Biederman, J., Conners, C.K., Demsey, R., et al. (2006). The prevalence and correlates of adult ADHD in the United States: Prevalence from the national comorbidity survey replication. American Journal of Psychiatry, 163, 716-723.
64.
Kline, R.B. (1988). Methodological considerations in the evaluation of the convergence of psychiatric diagnoses and parent-informant checklists . Journal of Abnormal Child Psychology, 16, 289-298.
65.
Kline, R.B. (1998). Principles and practice of structural equation modeling. New York: Guilford.
66.
Konold, T.R., Brewster, J.C., & Pianta, R.C. (2004). The behavior of child behavior ratings: Measurement structure of the Child Behavior Checklist across time, informants, and child gender. Journal of Behavioral Disorders, 29, 372-383.
67.
Kraemer, H.C., Measelle, J.R., Ablow, J.C., Essex, M.J., Boyce, W.T., & Kupfer, D.J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160(9), 1566-1577.
68.
Kranzler, J.H., & Keith, T.Z. (1999). Independent confirmatory factor analysis of the Cognitive Assessment System (CAS): What does the CAS measure? School Psychology Review, 28, 117-144.
69.
Lahey, B.B., Applegate, B., McBurnett, K., Biederman, J., Greenhill, L., Hynd, G., et al. (1994). DSM-IV field trials for attention deficit/hyperactivity disorder in children and adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 151, 1673-1685.
70.
Lance, C.E., Noble, C.L., & Scullen, S.E. (2002). A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods, 7, 228-244.
71.
Lewis, M. (2000). Toward a development of psychopathology: Models, definitions, and prediction. In A. J. Sameroff , M. Lewis, & S. M. Miller (Eds.), Handbook of developmental psychopathology (2nd ed., pp. 3-19). New York: Plenum.
72.
Loeber, R., Green, S.M., Lahey, B.B., Frick, P.J., & McBurnett, K. (2000). Findings on disruptive behavior disorders from the first decade of the developmental trends study. Clinical Child and Family Psychology Review, 3, 37-60.
73.
Macmann, G.M., Barnett, D.W., & Lopez, E.J. (1993). The child behavior checklist/4-18 and related materials: Reliability and validity of syndromal assessment. School Psychology Review, 22, 322-333.
McConaughy, S.H. (1993). Advances in empirically based assessment of children's behavioral and emotional problems. School Psychology Review , 22, 2, 285-307.
76.
McConaughy, S.H. & Ritter, D.R. (1995). Best practices in multidimensional assessment of emotional or behavioral disorders. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology (Vol. 3, pp. 865-877). Washington, DC: National Association of School Psychologists .
77.
McDermott, P.A. (1994). Adjustment scales for children and adolescents . Philadelphia: Edumetric and Clinical Science.
78.
McGough, J.J., & Barkley, R.A. (2004). Diagnostic controversies in adult attention deficit hyperactivity disorder. American Journal of Psychiatry, 161, 1948-1956.
79.
Mischel, W., Shoda, Y., & Mendoza-Denton, R. (2002). Situation-behavior profiles as a locus of consistency in personality. Current Directions in Psychological Science, 11, 50-54.
80.
Murphy, K., & Barkley, R.A. (1996). Attention deficit hyperactivity disorder adults: Comorbidity and adaptive impairments. Comprehensive Psychiatry , 37, 393-401.
81.
NICHD Early Child Care Research Network. ( 1998). Early child care and self-control, compliance, and problem behavior at twenty-four and thirty-six months. Child Development , 69, 1145-1170.
82.
Pelham, W.E., Evans, S.W., Gnagy, K.M., & Greenslade, K.E. (1992). Teacher ratings of DSM-III-R symptoms for the disruptive behavior disorders: Prevalence, factor analyses, and conditional probabilities in a special education sample. School Psychology Review, 21, 285-299.
83.
Piacentini, J. (1993). Checklists and rating scales. In T. H. Ollendick & M. Hersen (Eds.), Handbook of child and adolescent assessment (pp. 82-97). Boston: Allyn & Bacon.
84.
Podsakoff, P.M., MacKenzie, S.B., Lee, J.Y., & Podsakoff, N.P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies . Journal of Applied Psychology, 88, 879-903.
85.
Reilley, S.P. (2005). Empirically informed attention-deficit/hyperactivity disorder evaluation of college students. Journal of College Counseling, 8, 153-164.
86.
Robin, A.L. (1998). ADHD in adolescents: Diagnosis and treatment. New York: Guilford.
87.
Ruffalo, S.L., & Elliott, S.N. (1997). Teachers' and parents' ratings of children's social skills: A closer look at cross-informant agreements through an item analysis protocol. School Psychology Review, 26, 489-501.
88.
Smith, E.V., & Johnson, B.D. (1998). Factor structure of the DSM-IV criteria for college students using the adult behavior checklist. Measurement and Evaluation in Counseling and Development, 31, 164-183.
89.
Span, S.A., Earleywine, M., & Strybel, T.Z. (2002). Confirming the factor structure of attention deficit hyperactivity disorder symptoms in adult, nonclinical samples. Journal of Psychopathology and Behavioral Assessment, 24, 129-136.
Tanaka, J.S. (1993). Multifaceted conceptions of fit in structural equation models. In K. S. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 10-39). Newbury Park, CA: Sage.
92.
Thorndike, R.L. (1982). Applied psychometrics. Boston : Houghton Mifflin.
93.
Wender, P.H. (1995). Attention-deficit hyperactivity disorder in adults . New York: Oxford University Press .
94.
Weyandt, L.L., Linterman, I., & Rice, J.A. (1995). Reported prevalence of attention difficulties in a general sample of college students. Journal of Psychopathology and Behavioral Assessment, 17, 293-304.
95.
Youngstrom, E.A., Loeber, R., & Stouthamer-Loeber, M. (1999, August). Factors influencing youth self-report agreement with parent/teacher behavior ratings. Paper presented at the annual meeting of the American Psychological Association, Boston.
96.
Zwick, R. (1987). Assessment of dimensionality of year 15 reading data. In A. E. Baton (Ed.), Implementing the new design: The NAEP technical report. Princeton, NJ: Educational Testing Service.
97.
Zwick, W.R., & Velicer, W.F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 117, 253-269.
