This study examined the gender-related differential predictive validity of five subscales of the Institutional Integration Scale (IIS) with regard to college student withdrawal. Differential functioning of the IIS across genders was assessed using an item response theory (IRT)—based framework of differential item and test functioning. The results confirmed the absence of differential functioning and supported the predictive validity of two of the five subscales for student withdrawal. IRT analyses revealed that a number of the items did not adequately reflect the construct and should be revised or removed from the measure. A discussion of these results and the implications for higher education institutions focused on preventing student withdrawal are presented.
Allison, P.D. (1999). Logistic regression using the SAS system: Theory and application. Cary, NC: SAS Institute .
2.
Baker, F. (1995). EQUATE 2.1: Computer program for equating two metrics in item response theory (Version 2.1). Madison : University of Wisconsin, Laboratory of Experimental Design.
3.
Berger, J., & Milem, J. (1999). The role of student involvement and perceptions of integration in a causal model of student persistence. Research in Higher Education, 40, 641-664.
4.
Camilli, G., & Sheppard, L. (1994). Methods for identifying biased test items. Thousand Oaks, CA: Sage.
5.
Collins, W., Raju, N., & Edwards, J. (2000). Assessing differential functioning in a satisfaction scale. Journal of Applied Psychology, 85, 451-461.
6.
Eckland, B. (1964). College dropouts who come back. Harvard Educational Review, 34, 402-420.
7.
Embretson, S.E., & Reise, S.P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
8.
Flowers, C.P., Oshima, T.C., & Raju, N.S. (1999). A description and demonstration of the polytomous-DFIT framework. Applied Psychological Measurement, 23, 309-326.
9.
Fox, R. ( 1984). Reliability and discriminant validity of the Institutional Integration Scales for disadvantaged college students. Educational and Psychological Measurement, 44, 1051-1057.
10.
French, B., & Oakes, W. (2004). Reliability and validity evidence for the Institutional Integration Scale. Educational and Psychological Measurement , 64, 88-98.
11.
Hambleton, R.K., Swaminathan, H., & Rogers, H.J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
12.
Henson, R.K. (2001). Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-189.
13.
Horn, L.J., & Carroll, C.D. (1998). Stopouts or stayouts? Undergraduates who leave college in their first year (National Center for Education Statistics Statistical Analysis Report No. NCES 1999-087). Washington, DC: U.S. Department of Education, Office of Educational Research and Improvement .
14.
Hosmer, D.W., & Lemeshow, S. (2000). Applied logistic regression (2nd ed.). New York: John Wiley.
15.
Jöreskog, K.G. (1969). A general approach to confirmatory maximum likelihood factor analysis. Psychometrika, 34, 183-202.
16.
Knight, W.E. (2002). Toward a comprehensive model of influences upon time to bachelor's degree attainment (AIR Professional File No. 85). Tallahassee, FL: Association for Institutional Research .
17.
Lang, M. (2001-2002). Student retention in higher education: Some conceptual and programmatic perspectives. Journal of College Student Retention, 3, 217-229.
18.
Lord, F. (1980). Applications of item response theory to practical testing problems. Hillside, NJ: Lawrence Erlbaum.
19.
Mallette, B., & Cabrera, A. (1991). Determinants of withdrawal behavior: An exploratory study. Research in Higher Education, 32, 179-194.
20.
Mannan, M. (2001). An assessment of the academic and social integration as perceived by the students in the University of Papua New Guinea. Higher Education, 41, 283-298.
21.
Marsh, L. (1966). College dropouts—A review. Personnel and Guidance Journal, 44, 475-481.
22.
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525-543.
23.
Millsap, R.E. (1995). Measurement invariance, predictive invariance, and the duality paradox. Multivariate Behavioral Research , 30, 577-605.
24.
Nunnally, J.C., & Bernstein, I.H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
25.
Pascarella, E.T., & Chapman, D. (1983). A multi-institutional path analytical validation of Tinto's model of college withdrawal. American Educational Research Journal, 20, 87-102.
26.
Pascarella, E., & Terenzini, P. (1980). Predicting freshman persistence and voluntary dropout decisions from a theoretical model. Journal of Higher Education, 51, 60-75.
27.
Pascarella, E., & Terenzini, P. (1983). Predicting voluntary freshman year persistence/withdrawal behavior in a residential university: A path analytic validation of Tinto's model. Journal of Educational Psychology, 75, 215-226.
28.
Raju, N.S. (1988). The area between two item characteristic curves . Psychometrika, 53, 495-502.
29.
Raju, N.S. (1999). DFIT5P: A Fortran program for calculating DIF/DTF [computer software]. Chicago: Illinois Institute of Technology.
30.
Raju, N.S., Laffitte, L.J., & Byrne, B.M. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517-529.
31.
Raju, N.S., van der Linden, W.J., & Fleer, P.F. (1995). IRT-based internal measures of differential functioning of items and tests. Applied Psychological Measurement, 19, 353-368.
32.
Reise, S.P., Widaman, K.F., & Pugh, R.H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin,114, 552-566.
33.
Robie, C., Zickar, M., & Schmit, M. (2001). Measurement equivalence between applicant and incumbent groups: An IRT analysis of personality scales. Human Performance, 14, 187-207.
34.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement , 34, 100.
35.
Stocking, M.L., & Lord, F.M. (1983). Developing a common metric in item response theory . Applied Psychological Measurement, 7, 201-210.
36.
Terenzini, P., Lorang, W., & Pascarella, E. (1981). Predicting freshman persistence and voluntary dropout decisions: A replication. Research in Higher Education, 15, 109-127.
37.
Thissen, D. (1991). MULTILOG: Multiple, categorical item analysis and test scoring using item response theory (Version 6). Chicago: Scientific Software.
38.
Tinto, V. (1975). Dropout from higher education: A theoretical synthesis of recent research. Review of Educational Research, 45, 89-125.
39.
Tinto, V. (1982). Limits of theory and practice in student attrition . Journal of Higher Education, 53, 687-700.
40.
Vandenberg, R.J., & Lance, C.E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-69.
41.
Wang, M., & Russell, S.S. (2005). Measurement equivalence of the Job Descriptive Index across Chinese and American workers: Results from confirmatory factor analysis and item response theory. Educational and Psychological Measurement, 65, 709-732.
