The Factor Structure of Outcome Questionnaire–45.2 Scores Using Confirmatory Tetrad Analysis

Abstract

The researchers employed a confirmatory tetrad analysis (CTA) using partial least squares–structural equation modeling (PLS-SEM) with Outcome Questionnaire–45.2 (OQ-45) data, examining the measurement model of the OQ-45 scores with a sample of male adult clients (N = 1,558) receiving individual therapy at a university-based community counseling and research center (UBCCRC). Using CTA-PLS, this study examined the reflective and formative nature of each of the OQ-45 items and dimensions. These results identified the innovative second-order formative–formative three-factor model as a best alternative measurement model to represent and calculate the scores of OQ-45 scale.

Keywords

confirmatory tetrad analysis Outcome Questionnaire–45.2 psychological assessment structural equation modeling

Get full access to this article

View all access options for this article.

References

Bauldry

Bollen

K. A.

(2016). Tetrad: A set of Stata commands for confirmatory tetrad analysis. Structural Equation Modeling: A Multidisciplinary Journal, 23, 921-930.

Bentler

P. M.

(1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238-246.

Beretvas

S. N.

Kearney

L. K.

(2003). A shortened form of the Outcome Questionnaire: A validation of scores across groups (A Research Report of the Research Consortium of Counseling and Psychological Services for Higher Education). Austin: University of Texas at Austin, Counseling and Mental Health Center.

Bickman

Salzer

M. S.

(1997). Introduction: Measuring quality in mental health services. Evaluation Review, 21, 285-291. doi:10.1177/0193841X9702100301

Bludworth

J. L.

Tracey

T. G.

Glidden-Tracey

(2010). The bilevel structure of the Outcome Questionnaire-45. Psychological Assessment, 22, 350-355. doi:10.1037/a0019187

Bollen

K. A.

Lennox

(1991). Conventional wisdom on measurement: A structural equation Perspective. Psychological Bulletin, 110, 305-134. http://dx.doi.org/10.1037/0033-2909.110.2.305

Bollen

K. A.

Ting

K. F.

(2000). A tetrad test for causal indicators. Psychological Methods, 5, 3-22.

Browne

M. W.

(1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62-83.

Chen

Sousa

K. H.

West

S. G.

(2005). Teacher’s corner: Testing measurement invariance of second-order factor models. Sturctural Equation Modeling, 12:3, 471-492. doi: 10.1207/s15328007sem1203_7

10.

de Jong

Nugter

M. A.

Polak

M. G.

Wagenborg

J. E. A.

Spinhoven

Heiser

W. J

. (2007). The Outcome Questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clinical Psychology & Psychotherapy, 14, 288-301. doi:10.1002/cpp.529

11.

Enders

C. K.

(2010). Applied missing data analysis. New York, NY: Guilford.

12.

Graham

J. W.

(2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576. doi:10.1146/annurev.psych.58.110405.085530

13.

Gudergan

S. P.

Ringle

C. M.

Wende

Will

(2008). Confirmatory tetrad analysis in PLS path modeling. Journal of Business Research, 61, 1238-1249.

14.

Hair

J. F.

Black

W. C.

Babin

B. J.

Anderson

R. E.

Tatham

R. L.

(2010). Multivariate data analysis: A global perspective. Upper Saddle River, NJ: Pearson.

15.

Hair

J. F.

Hult

G. T. M.

Ringle

C. M.

Sarstedt

(2017). A primer on partial least squares structural equation modeling (2nd ed.). Thousand Oaks, CA: Sage.

16.

Hair

J. F.

Sarstedt

Hopkins

L. G.

Kuppelwieser

(2014). Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research. European Business Review, 26, 106-121. doi:10.1108/EBR-10-2013-0128

17.

Hair

J. F.

Sarstedt

Ringle

C. M.

Gudergan

S. P.

(2018). Advanced issues in partial least squares structural equation modeling (PLS-SEM). Thousand Oaks, CA: Sage.

18.

Hatfield

D. R.

Ogles

B. M.

(2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35, 485-491.

19.

Horowitz

L. M.

Rosenberg

S. E.

Baer

B. A.

Ureno

Villasenor

V. S.

(1988). Inventory of interpersonal problems: Psychometric properties and clinical applications. Journal of Consulting and Clinical Psychology, 56, 885-892.

20.

Howell

R. D.

Breivik

Wilcox

J. B.

(2007). Reconsidering formative measurement. Psychological Methods, 12, 205-218.

21.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1-55.

22.

Jarvis

C. B.

MacKenzie

S. B.

Podsakoff

P. M.

(2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30, 199-218. doi:10.1086/376806

23.

Kim

Beretvas

Sherry

A. R.

(2010). A validation of the factor structure of OQ-45 scores using factor mixture modeling. Measurement and Evaluation in Counseling and Development, 42, 275-295.

24.

Kline

R. B.

(2011). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press.

25.

Kock

(2017). WarpPLS User Manual: Version 6.0. Laredo, TX: Script Warp Systems.

26.

Kock

Lynn

G. S.

(2012). Lateral collinearity and misleading results in variance-based SEM: An illustration and recommendations. Journal of the Association for Information Systems, 13, 546-580.

27.

Lambert

M. J.

(1983). Introduction to assessment of psychotherapy outcomee: Historical perspective and current issues. In Lambert

M. J.

Christensen

E. R.

Dejulio

S. S.

(Eds), The Assessment of Psychotherapy Outcome. New York: John Wiley.

28.

Lambert

M. J.

Burlingame

G. M.

Umphress

Hansen

N. B.

Vermeersch

D. A.

Clouse

G. C.

Yanchar

S. C.

(1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology and Psychotherapy, 3, 249-258.

29.

Lambert

M. J.

Gregersen

A. T.

Burlingame

G. M.

(2004). The Outcome Questionnaire. In Maruish

M. E.

(Ed.), The use of psychological testing for treatment planning and outcome assessment: Vol. 3: Instruments for adults (3rd ed., pp. 191-234). Mahwah, NJ: Lawrence Erlbaum.

30.

Lambert

M. J.

Hansen

N. B.

Finch

A. E.

(2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159-172.

31.

Lambert

M. J.

Lunnen

Umphress

Hansen

N. B.

Burlingame

G. M.

(1994). Administration and scoring manual for the Outcome Questionnaire (OQ-45.1). Salt Lake City, UT: IHC Center for Behavioral Healthcare Efficacy.

32.

Luo

(2009). The reliability and validity of the Outcome Questionnaire-Chinese version. Chinese Mental Health Journal, 23, 105-107.

33.

Little

(1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83, 1198-1202. 10.1080/01621459.1988.10478722

34.

Lo Coco

Chiappelli

Bensi

Gullo

Prestano

Lambert

M. J

. (2008). The factorial structure of the Outcome Questionnaire-45: A study with an Italian sample. Clinical Psychology & Psychotherapy, 15, 418-423. doi:10.1002/cpp.601

35.

MacKenzie

S. B.

Podsakoff

P. M.

Jarvis

(2005). The Problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. Journal of Applied Psychology, 90, 710-730.

36.

Mueller

R. M.

Lambert

M. J.

Burlingame

G. M.

(1998). Construct validity of the Outcome Questionnaire: A confirmatory factor analysis. Journal of Personality Assessment, 70, 248-262. doi:10.1207/s15327752jpa7002_5

37.

Mvududu

N. H.

Sink

C. A.

(2013). Factor analysis in counseling research and practice. Counseling Outcome Research and Evaluation, 4, 75-98.

38.

Pallant

(2016). SPSS survival manual: A step by step guide to data analysis using IBM SPSS (6th ed.). Maidenhead, Berkshire, England: McGraw Hill.

39.

Osborne

J. W.

(2013). Best practices in data cleaning. Thousand Oaks, CA: Sage.

40.

Rasoolimanesh

S. M.

Noor

S. M.

Jaafar

(2017). Positive and negative perceptions of residents toward tourism development: Formative or reflective. In Rezaei

(Ed.), Quantitative tourism research in Asia: Current status and future directions. Singapore: Springer.

41.

Rice

K. G.

Suh

Ege

(2014). Further evaluation of the Outcome Questionnaire–45.2. Measurement and Evaluation in Counseling and Development, 47, 102-117.

42.

Rigdon

E. E.

(2015). Structural equation modeling: Nontraditional alternatives. In Balakrishnan

Colton

Everitt

Piegorsch

Ruggeri

Teugels

J. L.

(Eds.), Wiley StatsRef: Statistics reference online (pp. 1-12). Chichester, UK: John Wiley. doi:10.1002/9781118445112.stat06528.pub2

43.

Ringle

C. M.

Wende

Becker

J.-M.

(2015). SmartPLS 3 (Version 3.2.3, computer software). Boenningstedt, Germany: SmartPLS GmbH.

44.

Sarstedt

Hair

J. F.

Ringle

C. M.

Thiele

K. O.

Gudergan

S. P.

(2016). Estimation issues with PLS and CBSEM: Where the bias lies! Journal of Business Research, 69, 3998-4010.

45.

Schumacker

R. E.

Lomax

R. G.

(2016). A beginner’s guide to structural equation modeling. New York, NY: Routledge.

46.

Steiger

J. H.

(1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 21, 309-331.

47.

Tabachnick

B. G.

Fidell

L. S.

(2013). Using multivariate statistics (6th ed.). Upper Saddle River, NJ: Pearson.

48.

Thalmayer

A. G.

(2015). Alternative models of the Outcome Questionnaire-45. European Journal of Psychological Assessment, 31, 120-130. doi:10.1027/1015-5759/a000216

49.

Timman

de Jong

de Neve-Enthoven

(2017). Cut-off scores and clinical change indices for the Dutch Outcome Questionnaire (OQ-45) in a large sample of normal and several psychotherapuetic populations. Clinical Psychology and Psychotherapy, 24, 72-81.

50.

Tucker

L. R.

Lewis

(1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10.

51.

Veit

C. T.

Ware

J. E.

(1983). The structure of psychological distress and well-being in general populations. Journal of Consulting and Clinical Psychology, 51, 730-742. doi:10.1037/0022-006X.51.5.730

52.

Vermeersch

D. A.

Whipple

J. L.

Lambert

M. J.

Hawkins

E. J.

Burchfield

C. M.

Okiishi

J. C.

(2004). Outcome Questionnaire: Is it sensitive to changes in counseling center clients? Journal of Counseling Psychology, 51, 38-49. doi:10.1037/0022-0167.51.1.38

53.

Wennberg

Philips

de Jong

(2010). The Swedish version of the Outcome Questionnaire (OQ-45): Reliability and factor structure in a substance abuse sample. Psychology and Psychotherapy: Theory, Research and Practice, 83, 325-329.

54.

Willoughby

Holochwost

S. J.

Blanton

Z. E.

Blair

C. B.

(2014). Executive functions: Formative versus reflective measurement. Measurement: Interdisciplinary Research & Perspectives, 12(3), 69-95.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.54 MB

The Factor Structure of Outcome Questionnaire–45.2 Scores Using Confirmatory Tetrad Analysis–Partial Least Squares

Abstract

Keywords

Get full access to this article

References

Supplementary Material