The Non-Cognitive Questionnaire (NCQ) is a 23-item measure assessing eight noncognitive variables that are thought to predict the performance and retention of students in college. The NCQ is widely used in research and practice. This study is a meta-analytic review of the validity of scores on the NCQ across 47 independent samples for predicting academic outcomes (N = 9,321). Across all analyses, none of the scales of the NCQ are adequate predictors of GPA or persistence in college. Based on their evaluation of the NCQ, the authors recommend against its use for research or practice.
References marked with an asterisk indicate studies included in the meta-analysis.
2.
* Alexander, C.J. (1988). The use of noncognitive variables for admission into dental school. Unpublished doctoral dissertation, Marquette University .
3.
* Altman, L.A. (1997). A study of the efficacy of using noncognitive factors to predict persistence of adult students at a residential university . Unpublished doctoral dissertation, Indiana University , Bloomington .
4.
Ancis, J.R. , & Sedlacek, W.E. (1997). Predicting the academic achievement of female students using the SAT and noncognitive variables . College and University, 72, 2-8 .
5.
* Anderson, C.Y. (1998). An investigation of the effects of selected factors on the success of Black college students as compared to the general population at a predominately White institution. Unpublished doctoral dissertation, Wayne State University, Detroit, MI .
6.
Aspinwall, L.G. , & Taylor, S.E. (1992). A longitudinal investigation of the impact of individual differences and coping on college adjustment and performance . Journal of Personality & Social Psychology, 63, 989-1003 .
7.
Astin, A.W. (1975). Preventing students from dropping out. San Francisco: Jossey-Bass .
8.
Astin, A.W. (1999). Student involvement: A developmental theory for higher education . Journal of College Student Development, 40, 518-529 .
9.
* Awe, C.O. (1995). The study of the retention of first year minority students at a predominately White, urban university as analyzed by selected variables. Unpublished doctoral dissertation, Northern Illinois University, De Kalb .
10.
* Babington, C.A. (1996). Traditional and nontraditional predictors of academic success of freshman student athletes at Indiana University. Unpublished doctoral dissertation, Indiana University, Bloomington .
11.
Baird, L.L. (1984). Predicting predictability: The influence of student and institutional characteristics on the prediction of grades. Research in Higher Education, 21, 261-279 .
12.
Bean, J.P. (1980). Dropouts and turnover. The synthesis and test of a causal model of student attrition. Research in Higher Education, 12, 155-187 .
13.
Bean, J.P. (1985). Interaction effects based on class level in an explanatory model of college student dropout syndrome . American Educational Research Journal, 22, 35-64 .
14.
Bennett, C. , & Okinaka, A.M. (1989). Factors related to persistence among Asian, Black, Hispanic, and White undergraduates at a predominantly White university: Comparison between first and fourth year cohorts . Paper presented at the annual meeting of the American Educational Research Association, San Francisco. (ERIC Document Reproduction Service No. ED 309 729)
15.
Bill & Melinda Gates Foundation. (2004 ). The Gates millennium scholars [WWW document]. Available from http://www.gmsp.org/main.cfm
16.
* Boham, R.V. (1997). The Noncognitive Questionnaire: An instrument to discriminate between successful and unsuccessful EOP students? Unpublished doctoral dissertation, Montana State University, Mobeman .
17.
* Boldt, K.E. (2000). Predicting academic performance of high-risk college students using Scholastic Aptitude Test scores and noncognitive variables . Unpublished doctoral dissertation, North Carolina State University, Raleigh .
18.
Bowen, W.G. , & Bok, D. (1998). The shape of the river: The long term consequences of considering race in college admissions. Princeton, NJ : Princeton University Press .
19.
Boyd, V. (1989). Use of a diagnostic and prescriptive interview in the Colleges of Agriculture and Life Science: A collaborative study (Tech. Rep. No. 12-89). College Park: University of Maryland, Counseling Center .
20.
Boyer, S.P. , & Sedlacek, W.E. (1988). Noncognitive predictors of academic success for international students: A longitudinal study . Journal of College Student Development, 29, 218-223 .
21.
Bragg, T.A. (1994, May). Investigating first-semester freshman adjustment to college using a measurement of student psychosocial adjustment . Paper presented at the Annual Forum of the Association for Institutional Research, New Orleans, LA. (ERIC Document Reproduction Service No. ED373622)
22.
Breland, H.M. (1981). Assessing student characteristics in admissions to higher education (Research Monograph No. 9). New York : College Board .
23.
Bridgeman, B. , McCamley-Jenkins, L. , & Ervin, N. (2000). Predictions of freshman grade point average from the revised and recentered SAT I: Reasoning Test (College Board Rep. No. 2000-1) . New York: College Entrance Examination Board .
24.
* Bullock-McNeill, J. (1992). Variables related to grade performance of African American freshman at a predominately White university. Unpublished doctoral dissertation, North Carolina State University, Raleigh .
* Carstens, S.P. (1993). Use of noncognitive variables to predict the academic persistence and graduation of high-risk students who are admitted using special admissions standards. Unpublished doctoral dissertation, State University of New York at Buffalo .
27.
Cascio, W.F. (1998). Applied psychology in human resource management (5th ed.). Upper Saddle River, NJ: Prentice Hall .
28.
Chung, Y. (1996). Career commitment, aspirations, and expectations of Black college students. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign .
29.
Conner, R. (1991). The effect of selected variables on African-American student persistence. Unpublished doctoral dissertation, Southern Illinois University, Carbondale .
30.
Coopersmith, S. (1968). Studies of self-esteem . Scientific American, 218, 96-106 .
31.
Cureton, E.E. (1950). Validity, reliability, and baloney . Educational and Psychological Measurement, 10, 94-96 .
32.
* Dalton, D.L. (1997). A study of eight noncognitive variables and their prediction of academic success among health professions students. Unpublished doctoral dissertation, Georgia State University, Atlanta .
33.
* Dias, A. (1993). A study of alienation and non-cognitive factors among African American college students. Unpublished doctoral dissertation, University of North Carolina at Chapel Hill .
34.
Duran, R.P. (1986). Prediction of Hispanics' college achievement. In M. A. Olivas (Ed.), Latino college students (pp. 221-245). New York: Teachers College Press .
35.
* Eiche, K. , Sedlacek, W.E. , & Adams-Gaston, J. (1997). An exploration of leadership characteristics in college athletes (Rep. No. UMCP-RR-6-97). College Park: University of Maryland, Counseling Center . (ERIC Document Production Service No. ED411753)
36.
Epps, E.G. (1969). Motivation and academic achievement of Negro Americans . Journal of Social Issues, 29, 169-203 .
37.
Eshel, Y. , & Kurman, J. (1991). Academic self-concept, accuracy of perceived ability, and academic attainment . British Journal of Educational Psychology , 61, 187-196 .
38.
Eysenck, H.J. , & Eysenck, S.B. (1969). Personality structure and measurement. London: Routledge & Kegan Paul .
39.
Freedman, D. (1983). A note on screening regression equations . American Statistician, 37, 152-155 .
40.
* Fuertes, J.N. , & Sedlacek, W.E. (1995). Using noncognitive variables to predict the grades and retention of Hispanic students . College Student Affairs Journal, 14, 30-36 .
41.
Fuertes, J.N. , Sedlacek, W.E. , & Liu, W.M. (1994). Using the SAT and noncognitive variables to predict the grades and retention of Asian-American university students . Measurement and Evaluation in Counseling and Development, 27, 74-84 .
42.
* Fuller, M.K. (1994). The contribution of selected cognitive and noncognitive variables to the academic success of medical technology students. Unpublished doctoral dissertation, Old Dominion University, Norfolk, VA.
43.
* Gagnon, M.E. (1990). Noncognitive factors related to persistence and withdrawal of adult learners in baccalaureate degree programs. Unpublished doctoral dissertation, University of Maryland at College Park .
44.
* Gardner, A.A. (1994). Noncognitive variables as predictors of academic performance for Black American students in teacher education preparation programs . Unpublished doctoral dissertation, Florida State University , Tallahassee .
45.
Gratz v. Bollinger, 539 U.S. 306 (2003).
46.
Grutter v. Bollinger, 539 U.S. 244 (2003).
47.
* Guffey, J.S. (2000). Relative value of cognitive and noncognitive variables as predictors of scores on the physical therapy licensing examination. Unpublished doctoral dissertation, Arkansas State University, State University .
48.
Hedges, L.V. , & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press .
49.
* Hill, W. (1995). The academic retention and graduation status of African American students: Factors in a public university. Unpublished doctoral dissertation, North Carolina State University, Raleigh .
50.
Hood, D.W. (1992). Academic and noncognitive factors affecting the retention of Black men at a predominantly White university . Journal of Negro Education, 61, 12-23 .
51.
* Hughes, H.M. (1995). The relationship between noncognitive factors and racial identity attitudes in Black and White West Point cadets. Unpublished doctoral dissertation, University of Virginia, Charlottesville .
52.
Hunter, J.E. , & Schmidt F.L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage .
53.
Hunter, J.E. , & Schmidt, F.L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage .
54.
Izaak, A.R. (2002). The prediction of clinical competence in clinical psychology graduate students. Unpublished doctoral dissertation, Chicago School ofProfessional Psychology.
55.
* James, X.V. (1990). Academic achievement of Black university students: The relationship of noncognitive variables, selected student characteristics and academic achievement. Unpublished doctoral dissertation, Virginia Commonwealth University, Richmond .
56.
* Johnson, I.V.H. (1989). Factors that influence the persistence of Afro- American science students. Unpublished doctoral dissertation, Purdue University, West Lafayette, IN .
57.
Kaase, K.J. (1994, May). Testing the limits of student adaptation to college questionnaire . Paper presented at the Annual Forum of the Association for Institutional Research, New Orleans, LA. (ERIC Document Reproduction Service No. 373619)
58.
* King, P.M. , Taylor, J.A. , & Ottinger, D.C. (1989, November). Intellectual development of Black college students on a predominantly White campus . Paper presented at the annual meeting of the Association for the Study of Higher Education, Atlanta, GA. (ERIC Document Reproduction Service No. ED346761)
59.
Kuncel, N.R. , Credé, M. , & Thomas, L.L. (in press). The validity of the GMAT: A meta-analysis . Academy of Management Learning and Education.
60.
Kuncel, N.R. , Credé, M. , Thomas, L.L. , Seiler, S.N. , Klieger, D.M. , & Woo, S.E. (2005). A meta-analysis of the Pharmacy College Admission Test (PCAT) and grade predictors of pharmacy student success . American Journal of Pharmaceutical Education, 69, 339-347 .
61.
Kuncel, N.R. , Hezlett, S.A. , & Ones, D.S. (2001). A comprehensive meta-analysis of the predictive validity of the Graduate Record Examinations: Implications for graduate student selection and performance . Psychological Bulletin,127, 162-181 .
62.
Kuncel, N.R. , Hezlett, S.A. , & Ones, D.S. (2004). Academic performance, career potential, creativity, and job performance: Can one construct predict them all ? Journal of Personality and Social Psychology, 86, 148-161 .
63.
Lavin, D.E. (1965). The prediction of academic performance. New York: Russell Sage Foundation .
64.
Le, H. , Casillas, A. , Robbins, S.B. , & Langley, R. (2005). Motivational and skills, social, and self-management predictors of college outcomes: Constructing theStudent Readiness Inventory. Educational and Psychological Measurement, 65, 482-508 .
65.
Lemley, E.Y. (1991). Effects of selected extracurricular involvement on persistence in church-related university. Unpublished doctoral dissertation , Texas Tech University, Lubbock .
66.
Lindgren, H.C. (1973). Leadership and college grades . Journal of Social Psychology, 90, 165-166 .
67.
Locke, E.A. (1968). Toward a theory of task motivation and incentives . Organizational Behavior and Human Performance, 3, 157-189 .
68.
MacKinnon-Slaney, F. (1994). The adult persistence in learning model . Journal of Counseling and Development, 72, 268-275 .
69.
Martin, O.L. (1990, April). The college milieu for the 1990s: Increasing Black student retention rates on White campuses . Paper presented the annual meeting of the American Educational Research Association , Boston. (ERIC Document Reproduction Service No. ED333091)
70.
* Mavis, B. , & Doig, K. (1998). The value of noncognitive factors in predicting students' first-year academic probation . Academic Medicine , 73, 201-203 .
71.
McCarthy, J.M. , & Goffin, R.D. (2001). Improving the validity of letters of recommendation: An investigation of three standardized reference forms. MilitaryPsychology, 13, 199-222 .
72.
Mischel, W. , & Ayduk, O. (2004). Willpower in a cognitive-affective processing system: The dynamics of delay of gratification. In R. F. Baumeister & K. D. Vohs (Eds.), Handbook of self-regulation: Research, theory, and applications (pp. 99-129). New York: Guilford .
73.
Moll, R. (1979). Playing the private college admissions game. New York: Times Books .
74.
* Moore, S.K. (1995). Indicators of academic success and student characteristics of international students at Santa Monica College. Unpublished doctoral dissertation, Pepperdine University, Malibu, CA .
75.
Moreland, R. , Miller, J. , & Laucka, F. (1981). Academic achievement and self-evaluations of academic performance . Journal of Educational Psychology, 73, 335-344 .
76.
Nettles, M. (1991). Racial similarities and differences in the predictors of college student achievement. In W. R. Allen & E. G. Epps (Eds.), College in Black and White: African American students in predominantly White and in historically Black public universities (pp. 75-94). Albany : State University of New York Press .
77.
Nisbet, J. , Ruble, V.E. , & Schurr, K.T. (1982). Predictors of academic success with high risk college students . Journal of College Student Personnel, 57, 289-318 .
78.
Noble, J.P. (1989). Predicting grades in college freshman English and mathematic courses . Journal of College Student Development , 30, 345-353 .
79.
Noble, J.P. (1991). Predicting college grades from ACT assessment scores and high school course work and grade information (Rep. No. ACT-RR-91-3). Iowa City, IA: American College Testing Program . (ERIC Document Reproduction Service No. ED344943)
80.
Nunnally, J.C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill .
81.
Nunnally, J.C. , & Bernstein, I.H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill .
82.
* O'Callaghan, K.W. (1987). The effects of noncognitive variables on academic persistence among Blacks at the Air Force Academy. Unpublished doctoral dissertation, University of Denver, CO .
83.
Oswald, F.L. , Schmitt, N. , Kim, B.H. , Ramsay, L.J. , & Gillespie, M.A. (2004). Developing a biodata measure and situational judgment inventory as predictors of college student performance . Journal of Applied Psychology, 89, 187-207 .
84.
Pantages, T.J. , & Creedon, C.F. (1978). Studies of college attrition: 1950-1975 . Review of Educational Research, 48, 49-101 .
85.
* Perez, V.P. (1994). An examination of noncognitive variables as predictors of academic success for Latino/a first year college students. Unpublished doctoral dissertation, Boston College .
86.
Reinhardt, B. (1996). Factors affecting coefficient alpha: A mini Monte Carlo study. In B. Thompson (Ed.), Advances in social science methodology (Vol. 4, pp. 3-20). Greenwich, CT: JAI .
87.
Rencher, A.C. , & Pun, F.C. (1980). Inflation of R2 in best subset regression . Technometrics, 22, 49-53 .
88.
Richard, J.M., Jr. , Holland, J.L. , & Lutz, S.W. (1967). Prediction of student accomplishment in college . Journal of Educational Psychology, 58, 343-355 .
89.
Sackett, P.R. , Schmitt, N. , Ellingson, J.E. , & Kabin, M.B. (2001). High stakes testing in employment, credentialing, and higher education: Prospects in a post-affirmative action world . American Psychologist, 56, 302-318 .
90.
* Scameheorn, D.M. (2001). Cognitive and non-cognitive characteristics as predictors of college success among African-American and Caucasian students in a comprehensive community college. Unpublished doctoral dissertation, Andrews University, Berrien Springs, MI .
91.
Scott, A.H. , Chase L.M. , Lefkowitz, R. , Morton-Rias, D. , Chambers, C. , Joe, J. , et al. (1995). A national survey of admissions criteria and processes in selected allied health professions . Journal of Allied Health, 24, 95-106 .
92.
Sedlacek, W.E. (1987). Black students on white campuses: 20 years of research . Journal of College Student Personnel, 28, 484-495 .
93.
Sedlacek, W.E. (2004) Beyond the big test: Noncognitive assessment in higher education. San Francisco: Jossey-Bass .
94.
* Sedlacek, W.E. , & Adams-Gaston, J. (1992). Predicting the academic success of student-athletes using SAT and noncognitive variables . Journal of Counseling & Development, 70, 724-727 .
95.
* Selman, R.V.C. (1999). Noncognitive indicators of academic success of nontraditional older students: Toward equal access to higher education. Unpublished doctoral dissertation, University of Nebraska—Lincoln .
96.
* Sicherer, M.J. (1995). Self concept in college academic achievement among multicultural college women. Unpublished doctoral dissertation, Rutgers , State University of New Jersey .
97.
Smith, C.N. (1991). A study of the relationship between living environment press and retention of freshman pledges in fraternities at Oregon State University. Unpublished doctoral dissertation, Oregon State University , Corvallis .
98.
Thomas, J.H. (1986). Affiliation and retention at a selected land grant university. Unpublished doctoral dissertation, West Virginia University, Morgantown .
99.
* Ting, S. (1997). Estimating success in the first year of college for specially admitted White students: A model combining cognitive and psychosocial predictors . Journal of College Student Development, 38, 401-409 .
100.
* Ting, S. (1998). First year grades and academic progress of college students of first generation and low income families . Journal of College Admissions, 158, 15-23 .
101.
* Ting, S. (2000). Predicting Asian Americans' academic performance in the first year of college: An approach combining SAT scores and noncognitive variables . Journal of College Student Development, 41, 442-449 .
102.
* Ting, S. , & Robinson, T.L. (1998). First-year academic success: A prediction combining cognitive and psychosocial variables for Caucasian and African American students . Journal of College Student Development, 39, 599-610 .
103.
Tinto, V. (1975). Dropout from higher education: A theoretical synthesis of recent research . Review of Educational Research, 45, 89-125 .
104.
Tinto, V. (1993). Leaving college: Rethinking the causes and cures of student attrition. Chicago: University of Chicago Press .
105.
* Tipling, A.N. (1993). Cognitive and noncognitive predictors of academic success in older returning women students. Unpublished doctoral dissertation, University of Virginia, Charlottesville .
106.
Tracey, T.J. , & Sedlacek, W.E. (1984). Noncognitive variables in predicting academic success by race . Measurement & Evaluation in Guidance, 16, 171-178 .
107.
Tracey, T.J. , & Sedlacek, W.E. (1985). The relationship of noncognitive variables to academic success: A longitudinal comparison by race . Journal of College Student Personnel, 26, 405-410 .
108.
* Tracey, T.J. , & Sedlacek, W.E. (1987a). A comparison of White and Black student academic success using noncognitive variables: A LISREL analysis . Research in Higher Education, 27, 333-348 .
109.
Tracey, T.J. , & Sedlacek, W.E. (1987b). Prediction of college graduation using non-cognitive variables by race . Measurement and Evaluation in Counseling and Development, 19, 177-183 .
110.
Tracey, T.J. , Sedlacek, W.E. , & Miars, R.D. (1983). Applying ridge regression to admissions data by race and sex . College and University, 58, 313-318 .
111.
* Travis, R.L. (1994). Noncognitive predictors of academic success for nontraditional students at a large, southeastern, urban community college . Unpublished doctoral dissertation, Florida International University, Miami .
112.
University of Maryland. (2004). Diversity database: Moving towards community [WWW document]. Available from http://www.inform.umd.edu/EdRes/Topic/Diversity/
113.
Vacha-Haase, T. , Henson, R.K. , & Caruso, J. (2002). Reliability generalization: Moving toward improved understanding and use of score reliability . Educational and Psychological Measurement, 62, 562-569 .
114.
* Walker, C.W. (1992). The use of noncognitive variables to predict the academic success of student-athletes. Unpublished doctoral dissertation, Iowa State University, Ames .
115.
* Washington, C.M. (1996). A study of early academic performance, attrition, and retention as related to selected cognitive, noncognitive, and adjustment variables for African-American college students attending a private, open admission, historically Black institution . Unpublished doctoral dissertation, University of South Carolina , Columbia.
116.
Weisberg, S. (1985). Applied linear regression (2nd ed.). New York: Wiley .
117.
Whetzel, D.L. , & McDaniel, M.A. (1988). Reliability of validity generalization databases . Psychological Reports, 63, 131-134 .
118.
White, T.J. , & Sedlacek, W.E. (1986). Noncognitive predictors: Grades and retention of specially-admitted students . Journal of College Admissions, 111, 20-23 .
119.
Wilds, D.J. , & Wilson, R. (1998). Minorities in higher education, 1997-1998: Sixteenth annual status report. Washington, DC: American Council on Education, Office of Minority Concerns .
120.
Willingham, W.W. , & Breland, H.M. (1982). Personal qualities and college admissions. New York: College Entrance Examination Board .
121.
* Wolfolk, W.B. (1995). An attitudinal survey comparing the relationship between perceptions of hostility due to racism and noncognitive variables of African-American male students at Ohio University. Unpublished doctoral dissertation, Ohio University, Athens .
122.
Wood, P.S. , Smith, A.L. , Altmaier, E.M. , Tarico, V.S. , & Franken, E.A. (1990). A prospective study of cognitive and noncognitive selection criteria as predictors of resident performance . Investigative Radiology, 25, 855-859 .
123.
* Young, B.D. , & Sowa, C.J. (1992). Predictors of academic success for black student athletes . Journal of College Student Development, 33, 318-324 .
124.
Zakzanis, K.K. (1998). The reliability of meta-analytic review . Psychological Reports, 83, 215-222 .
