What Do Interest Inventories Measure? The Convergence and Content Validity of Four RIASEC Inventories

Abstract

Despite the widespread use of RIASEC interest inventories, little is known about whether these inventories actually measure the same core constructs and provide similar career recommendations to individuals. This study investigates the construct validity among four major interest inventories—the Self-Directed Search (SDS), O*NET Interest Profiler (IP), ACT Interest Inventory (UNIACT), and Strong Interest Inventory (SII). Results showed that RIASEC interest scores from the four inventories were highly correlated, but the measures often gave respondents different high-point codes. Item content analysis revealed that the basic interests reflected in each RIASEC scale both overlapped and diverged across inventories, providing an explanation for why RIASEC inventories are not interchangeable. We integrate findings across our analyses to offer cautionary notes for choosing among established RIASEC inventories and interpreting interest results. Furthermore, we also provide recommendations for constructing the next generation of basic interest inventories.

Keywords

vocational interests measurement multitrait multimethod Holland’s RIASEC basic interests convergent validity content validity

Get full access to this article

View all access options for this article.

References

American College Testing Program (1995). Technical manual: Revised unisex edition of the ACT interest inventory (UNIACT). American College Testing Program.

Armstrong

P. I.

Allison

Rounds

(2008). Development and initial validation of brief public domain RIASEC marker scales. Journal of Vocational Behavior, 73(2), 287–299. https://doi.org/10.1016/j.jvb.2008.06.003.

Armstrong

P. I.

Hubert

Rounds

(2003). Circular unidimensional scaling: A new look at group differences in interest structure. Journal of Counseling Psychology, 50(3), 297–308. http://dx.doi.org/10.1037/0022-0167.50.3.297.

Blakeney

R. N.

Matteson

M. T.

Holland

T. A.

(1972). A research note on the new SVIB Holland scales. Journal of Vocational Behavior, 2(3), 239–243. https://doi.org/10.1016/0001-8791(72)90029-2.

Browne

M. W.

Cudeck

(1992). Alternative ways of assessing model fit. Sociological methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005.

Campbell

D. P.

(1971). Handbook for the strong vocational interest blank. CA: Stanford University Press.

Campbell

D. P.

Borgen

F. H.

(1999). Holland's theory and the development of interest inventories. Journal of Vocational Behavior, 55(1), 86–101. http://dx.doi.org/10.1006/jvbe.1999.1699.

Campbell

D. T.

Fiske

D. W.

(1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. http://dx.doi.org/10.1037/h0046016.

Campbell

D. P.

Holland

(1972). A merger in vocational interest research: Applying holland's theory to strong's data. Journal of Vocational Behavior, 2(4), 353–376. http://dx.doi.org/10.1016/0001-8791(72)90012-7.

10.

Cohen

(1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46. http://dx.doi.org/10.1177/001316446002000104.

11.

Dixon

Johnston

(2019). Content validity of measures of theoretical constructs in health psychology: Discriminant content validity is needed. British Journal of Health Psychology, 24(3), 477–484. https://doi.org/10.1111/bjhp.12373.

12.

Eid

Lischetzke

Nussbeck

F. W.

(2006). Structural equation models for multitrait-multimethod data. In Eid

Diener

(Eds), (pp. 283–299). Handbook of multimethod measurement in psychology; Handbook of multimethod measurement in psychology. American Psychological Association. Chapter xiv, 553 Pages) http://dx.doi.org/10.1037/11383-020.

13.

Eid

Lischetzke

Nussbeck

F. W.

Trierweiler

L. I.

(2003). Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple-indicator CT-C(M-1) model. Psychological Methods, 8(1), 38–60. http://dx.doi.org/10.1037/1082-989X.8.1.38.

14.

Eid

Nussbeck

F. W.

Geiser

Cole

D. A.

Gollwitzer

Lischetzke

(2008). Structural equation modeling of multitrait-multimethod data: Different models for different types of methods. Psychological Methods, 13(3), 230–253. http://dx.doi.org/10.1037/a0013219.

15.

Fabry

Blake

Seran

(1978). A construct validation study of the ACT Interest Inventory with high school students. Measurement and Evaluation in. Guidance, 10(4), 233-236. https://doi.org/10.1080/00256307.1978.12022136.

16.

Fleiss

J. L.

(1981). Statistical methods for rates and proportions. John Wiley & Sons.

17.

Furr

R. M.

Bacharach

V. R.

(2006). Validity: Estimating and evaluating convergent and discriminant validity evidence. Psychometrics: An Introduction, 191–235.

18.

Gelfand

D. M.

Hartmann

D.P.

(1975). Child behavior analysis and therapy. New York: Pergamon.

19.

Hanna

Rounds

(2020). How accurate are interest inventories? A quantitative review of career choice hit rates. Psychological Bulletin, 146(9), 765–796. http://dx.doi.org/10.1037/bul0000269.

20.

Hansen

J. C.

(2019). Interest Inventories. In Goldstein

Allen

D. N.

DeLuca

(Eds), (4th ed., pp. 169–190). 4th ed.; Handbook of psychological assessment. Elsevier Academic Press. http://dx.doi.org/10.1016/B978-0-12-802203-0.00006-7.

21.

Hanson

G. R.

(1974). Assessing the career interests of college youth: Summary of research and applications. ACT Research Reports, 67, 76.

22.

Hanson

G. R.

Lamb

R. R.

English

(1974). An analysis of Holland’s interest types for women: A comparison of the Strong-Holland and the ACT Vocational Interest Profile scales for women. Journal of Vocational Behavior, 4(2), 259–269. https://doi.org/10.1016/0001-8791(74)90109-2.

23.

Harmon

L. W.

DeWitt

D. W.

Campbell

D. P.

Hansen

J. I. C.

(1994). Strong interest inventory: Applications and technical guide: Form T317 of the strong vocational interest blanks. Stanford University Press.

24.

Harmon

L. W.

Zytowski

D. G.

(1980). Reliability of holland codes across interest measures for adult females. Journal of Counseling Psychology, 27(5), 478–483. http://dx.doi.org/10.1037/0022-0167.27.5.478.

25.

Hinkin

T. R.

Tracey

J. B.

(1999). An Analysis of Variance Approach to Content Validation. Organizational Research Methods, 2(2), 175–186. https://doi.org/10.1177/109442819922004.

26.

Hoff

K.A.

Chu

Einarsdóttir

Briley

D.A.

Hanna

Rounds

(2022). Adolescent vocational interests predict early career success: Two 12-year longitudinal studies. Applied Psychology, 71, 49-75. https://doi.org/10.1111/apps.12311.

27.

Hoff

K. A.

Song

Q. C.

Wee

C. J.

Phan

W. M. J.

Rounds

(2020). Interest fit and job satisfaction: A systematic review and meta-analysis. Journal of Vocational Behavior, 103503. https://doi.org/10.1016/j.jvb.2020.103503.

28.

Holland

J. L

(1973). Making vocational choices. Prentice-Hall.

29.

Holland

J. L

(1985). Making vocational choices: A theory of vocational personalities and work environments. Prentice-Hall.

30.

Holland

J. L

(1997). Making vocational choices: A theory of vocational personalities and work environments (3rd ed.). Psychological Assessment Resources.

31.

Holland

J. L.

Fritzsche

Powell

(1994). Self-directed Search: Technical manual. Psychological Assessment Resources.

32.

Holland

J. L.

Rayman

J. R.

Gottfredson

G. D.

(2020). My life with a theory: John L. Holland's autobiography and theory of careers. National Career Development Association.

33.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. http://dx.doi.org/10.1080/10705519909540118.

34.

Lamb

R. R.

Prediger

D. J.

(1981). Technical report for the Unisex Edition of the ACT Interest Inventory (UNIACT). American College Testing Program.

35.

Landis

Koch

(1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310.

36.

Lewis

Rivkin

(1999). Development of the O* NET interest profiler. National Center for O* NET Development.

37.

Liao

Armstrong

P. I.

Rounds

(2008). Development and initial validation of public domain basic interest markers. Journal of Vocational Behavior, 73(1), 159–183. http://dx.doi.org/10.1016/j.jvb.2007.12.002.

38.

Lowman

R. L.

(2022). Career assessment: Integrating interests, abilities, and personality. American Psychological Association. http://dx.doi.org/10.1037/0000254-000.

39.

Lowman

R. L.

Palmer

L. K.

Santana

Abott

(2003). Executive and career assessment: Can alternative occupational interest measures Be used interchangeably? The Psychologist-Manager Journal, 6(2), 65–78. http://dx.doi.org/10.1037/h0095927.

40.

Marsh

H. W.

Grayson

(1995). Latent variable models of multitrait-multimethod data. In Hoyle

R. H.

(Ed), (pp. 177–198). Structural equation modeling: Concepts, issues, and applications; structural equation modeling: Concepts, issues, and applications. Sage Publications, Inc.

41.

Mount

K. M.

Barrick

M. R.

Scullen

S. M.

Rounds

J. B.

(2005). Higher order dimensions of the big five personality traits and the big six interest types. Personnel Psychology, 58, 447–478. http://dx.doi.org/10.1111/j.1744-6570.2005.00468.x.

42.

Muthén

L.K.

Muthén

B.O.

(1998–2017). Mplus user’s guide (Eighth Edition). Muthén & Muthén.

43.

Nye

C. D.

Rounds

Drasgow

(2012). Vocational interests and performance: A quantitative summary of over 60 years of research. Perspectives on Psychological Science, 7(4), 384–403. http://dx.doi.org/10.1177/1745691612449021.

44.

Nye

C. D.

Rounds

Drasgow

(2017). Interest congruence and performance: Revisiting recent meta-analytic findings. Journal of Vocational Behavior, 98, 138–151. http://dx.doi.org/10.1016/j.jvb.2016.11.002.

45.

Passler

Beinicke

Hell

(2015). Interests and intelligence: A meta-analysis. Intelligence, 50, 30–51. http://doi.org/10.1016/j.intell.2015.02.001.

46.

Prediger

D. J.

Swaney

K. B.

(2004). Work task dimensions underlying the world of work: Research results for diverse occupational databases. Journal of Career Assessment, 12(4), 440–459.

47.

Rounds

(1995). Vocational interests: Evaluating structural hypotheses. In Lubinski

D. J.

Dawis

R. V.

(Eds), (pp. 177–232). Assessing individual differences in human behavior: New concepts, methods, and findings; assessing individual differences in human behavior: New concepts, methods, and findings. Davies-Black Publishing.

48.

Rounds

Day

S. X.

(1999). Describing, evaluating, and creating vocational interest structures. In Savickas

M. L.

Spokane

A. R.

(Eds), (pp. 103–133). Vocational interests: Meaning, measurement, and counseling use; vocational interests: Meaning, measurement, and counseling use. Davies-Black Publishing.

49.

Rounds

Hoff

K. A

Lewis

(2021). O*NET® interest profiler manual. U.S. Department of Labor National O*NET Resource Center. https://www.onetcenter.org/reports/IP_Manual.html.

50.

Rounds

(2014). The nature and power of interests. Current Directions in Psychological Science, 23(2), 98–103. http://dx.doi.org/10.1177/0963721414522812.

51.

Rounds

Lewis

Rivkin

(2010). O* NET interest profiler short form psychometric characteristics: Summary. National Center for O* NET Development.

52.

Rounds

Lewis

Rivkin

(2010). O* NET interest profiler short form psychometric characteristics: Summary. Raleigh, NC: National Center for O* NET Development.

53.

Rounds

Tracey

T. J.

(1996). Cross-cultural structural equivalence of RIASEC models and measures. Journal of Counseling Psychology, 43(3), 310–329. http://dx.doi.org/10.1037/0022-0167.43.3.310.

54.

Rounds

Walker

C. M.

Day

S. X.

Hubert

Lewis

Rivkin

(1999). O* NET Interest Profiler: Reliability, validity, and self-scoring . Raleigh, NC: National Center for O* NET Development.

55.

Assessing vocational interests: Convergence and divergence of inventories and informants (Order No. AAI3301220) Russell

(2008). Available from APA PsycInfo®. (621739401; 2008-99150-261). https://search.proquest.com/dissertations-theses/assessing-vocational-interests-convergence/docview/621739401/se-2?accountid=14553.

56.

Savickas

M. L.

Taber

B. J.

(2006). Individual differences in RIASEC profile similarity across five interest inventories. Measurement and Evaluation in Counseling and Development, 38(4), 203–210. https://search.proquest.com/scholarly-journals/individual-differences-riasec-profile-similarity/docview/621116351/se-2?accountid=14553.

57.

Savickas

M. L.

Taber

B. J.

Spokane

A. R.

(2002). Convergent and discriminant validity of five interest inventories. Journal of Vocational Behavior, 61(1), 139–184. http://dx.doi.org/10.1006/jvbe.2002.1878.

58.

Stoll

Einarsdóttir

Song

Q. C.

Ondish

Sun

J. J.

Rounds

(2020). The roles of personality traits and vocational interests in explaining what people want out of life. Journal of Research in Personality, 86, 103939. https://doi.org/10.1016/j.jrp.2020.103939.

59.

Nye

C. D.

(2017). Interests and person-environment fit: A new perspective on workforce readiness and success. In Burrus

Mattern

K. D.

Naemi

B. D.

Roberts

R. D.

(Eds), Building better students: Preparation for the workforce; Building better students: Preparation for the workforce (pp. 177–206). Oxford University Press.

60.

Rounds

Armstrong

P. I.

(2009). Men and things, women and people: a meta-analysis of sex differences in interests. Psychological Bulletin, 135(6), 859–884. http://dx.doi.org/10.1037/a0017364.

61.

Tay

Liao

Zhang

Rounds

(2019). Toward a dimensional model of vocational interests. Journal of Applied Psychology, 104(5), 690–714. http://dx.doi.org/10.1037/apl0000373.

62.

Swaney

K. B.

Lamb

Prediger

American College Testing Program (1995). Technical manual: Revised unisex edition of the ACT interest inventory (UNIACT). ACT.

63.

Tracey

T. J.

Rounds

J. B.

(1993). Evaluating holland's and gati's vocational-interest models: a structural meta-analysis. Psychological Bulletin, 113(2), 229–246. http://dx.doi.org/10.1037/0033-2909.113.2.229.

64.

U.S. Bureau of Labor Statistics . (2021, September 8). Employment by Major Occupational Group. U.S. Bureau of Labor Statistics. Retrieved March 29, 2022, from https://www.bls.gov/emp/tables/emp-by-major-occupational-group.htm

65.

U.S. Bureau of Labor Statistics . (2022, March 4). Employment and earnings table B-1A. U.S. Bureau of Labor Statistics. Retrieved March 29, 2022, from https://www.bls.gov/web/empsit/ceseeb1a.htm

66.

Van Iddekinge

C. H.

Putka

D. J.

Campbell

J. P.

(2011). Reconsidering vocational interests for personnel selection: the validity of an interest-based selection test in relation to job knowledge, job performance, and continuance intentions. Journal of Applied Psychology, 96(1), 13–33. http://dx.doi.org/10.1037/a0021193.

67.

Widaman

K. F.

(1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9(1), 1–26. http://dx.doi.org/10.1177/014662168500900101.