This article summarizes main findings from a two-step investigation about the effects of tailoring a scale with etic and emic items and extreme-response styles on the validity and reliability of scores. The Career Decision-Making Self-Efficacy scale was chosen, and its Spanish version was tailored with translated items, adapted items, and newly developed items. The tailored scale was administered to two independent samples of high school students from Mexico. Reliability estimates for the emic and etic scales were marginally different between them and with respect to those for the English language. Tailoring a scale with the best etic and emic items neither improved on the recovery of the five-dimension structure nor reduced the effects of the extreme response style variable.
Get full access to this article
View all access options for this article.
References
1.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
2.
Allalouf, A., Hambleton, R., & Sireci, S. (1999). Identifying the causes of DIF in translated verbal items. Journal of Educational Measurement, 36, 185-198.
3.
Angoff, W., & Cook, L. (1988). Equating the scores of the Prueba de Aptitud Academica and the Scholastic Aptitude Test (Research Report No. 3). New York: College Entrance Examination Board.
4.
Arce-Ferrer, A. (2001). Factorial invariance in psychological testing: New construct dimensions or differential item interpretation? Revista Mexicana de Psicología, 18, 11.
5.
Barrett, P. (1986). Factor comparison: An examination of three methods. Personality and Individual Differences, 3, 361-372.
6.
Betz, N., Klein, K., & Taylor, K. (1996). Evaluation of a short form of the career decision-making self-efficacy scale. Journal of Career Assessment, 4, 47-57.
7.
Betz, N., & Luzzo, D. (1996). Career assessment and the Career Decision-Making Self-Efficacy scale. Journal of Career Assessment, 4, 413-428.
8.
Brislin, R. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1, 185-216.
9.
Canto, J. (1999). Factors influencing certainty of career choice. Unpublished doctoral dissertation, Autonomous University of Yucatan, Mexico.
10.
Chan, W., Ho, R., Leung, K., Chan, D., & Yung, Y. (1999). An alternative method for evaluating congruence coefficients with procrustes rotation: A bootstrap procedure. Psychological Methods, 4, 378-402.
11.
Cheung, G., & Rensvold, R. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equation modeling. Journal of Cross-Cultural Psychology, 31, 187-212.
12.
Clarke, I. III. (2000). Extreme response style in cross-cultural research: An empirical investigation. Journal of Social Behavior and Personality, 15, 137-152.
13.
Crites, J. (1978). Career maturity inventory. Monterey, CA: CTB/McGraw-Hill.
14.
Díaz-Guerrero, R. (1975). Psychology of the Mexican: Culture and personality. Austin: University of Texas Press.
15.
deVera, M. (1985). Establishing cultural relevance and measurement equivalence using emic and etic items. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.
16.
Ellis, B. (1989). Differential item functioning: Implication for test translation. Journal of Applied Psychology, 74, 912-921.
17.
Fouad, N., Smith, P., & Enochs, L. (1997). Reliability and validity evidence for the middle school self-efficacy scale. Measurement and Evaluation in Counseling and Development, 30, 17-29.
18.
Gibbons, J., Zeller, J., & Rudek, D. (1999). Effects of language and meaningfulness on the use of extreme response style by Spanish-English bilinguals. Cross-Cultural Research, 33, 369-381.
19.
Hambleton, R. (1994). Guidelines for adapting educational and psychological tests: A progress report. European Journal of Psychological Assessment, 10, 224-229.
20.
Hambleton, R., & Jones, R. (1995). Comparison of empirical and judgmental procedures for detecting differential item functioning. Educational Research Quarterly, 18, 21-36.
21.
Hulin, C. (1987). A psychometric theory of evaluations of item and test translations: Fidelity across languages. Journal of Cross-Cultural Psychology, 67, 115-142.
22.
Hulin, C., Drasgow, F., & Komoar, J. (1982). Applications of item response theory to analysis of attitude scale translations. Journal of Applied Psychology, 67, 818-825.
23.
Korth, B., & Tucker, L. (1976). Procrustes matching by congruency coefficients. Psychometrika, 41, 531-535.
24.
Little, T. (2000). On the comparability of constructs in cross-cultural research: A critique of Cheung and Rensvold. Journal of Cross-Cultural Psychology, 31, 213-219.
25.
Luzzo, D. (1993). Reliability and validity testing of the Career Decision-Making Self-Efficacy scale. Measurement and Evaluation in Counseling and Development, 26, 137-142.
26.
McCrae, R., Zonderman, A., Costa, P., Bond, M., & Paunonen, S. (1996). Evaluating replicability of factors in the revised NEO Personality Inventory: Confirmatory factor analysis versus procrustes rotation. Journal of Personality and Social Psychology, 70, 552-566.
27.
Mulaik, S. (1972). The foundations of factor analysis. New York: McGraw-Hill.
28.
Mullen, M. (1995). Diagnosing measurement equivalence in cross-national research. Journal of International Business Studies, 23, 169-179.
29.
Nunnally, J., & Bernstein, I. (1995). Psychometric theory. San Francisco: McGraw-Hill.
30.
Paunonen, S. (1997). On chance and factor congruence following orthogonal procrustesrotation. Educational and Psychological Measurement, 57, 33-59.
31.
Ramirez, M., Arce-Ferrer, A., & Canto, J. (2000). Students' self-efficacy. Social Psychology in Mexico, 7, 297-302.
32.
Rensvold, R., & Cheung, G. (1998). Testing measurement models for factorial invariance: A systematic approach. Educational and Psychological Measurement, 58, 1017-1034.
33.
Riordan, C., & Vandenberg, R. (1994). A central question in cross-cultural research: Do employees of different cultures interpret work-related measures in a equivalent manner? Journal of Management, 20, 643-671.
34.
Schönemann, P. (1966). A generalized solution to the orthogonal procrustes problem. Psychometrika, 31, 1-10.
35.
Tucker, L. (1951). A method for synthesis of factor analysis studies (Personnel Research Section Report No. 984). Washington, DC: U.S. Department of Defense.
