How to Interpret the Effect of Covariates on the Extreme Categories in Ordinal Data Models

Abstract

This contribution deals with effect measures for covariates in ordinal data models to address the interpretation of the results on the extreme categories of the scales, evaluate possible response styles, and motivate collapsing of extreme categories. It provides a simpler interpretation of the influence of the covariates on the probability of the response categories both in standard cumulative link models under the proportional odds assumption and in the recent extension of the Combination of Uncertainty and Preference of the respondents models, the mixture models introduced to account for uncertainty in rating systems. The article shows by means of marginal effect measures that the effects of the covariates are underestimated when the uncertainty component is neglected. Visualization tools for the effect of covariates are proposed, and measures of relative size and partial effect based on rates of change are evaluated by the use of real data sets.

Keywords

cumulative link models cumulative logits extreme categories marginal effects mixture models proportional odds rating data uncertainty visualization tools

Get full access to this article

View all access options for this article.

References

Agresti

2010. Analysis of Ordinal Categorical Data. 2nd ed. Hoboken: J. Wiley.

Agresti

Tarantola

. 2018. “Simple Ways to Interpret Effects in Modeling Ordinal Categorical Data.” Statistica Neerlandica 72:210–23.

Bartels

L. M.

2000. “Partisanship and Voting Behavior, 1952-1996.” American Journal of Political Science 44:35–50.

Breen

Luijkx

. 2010. “Mixture Models for Ordinal Data.” Sociological Methods & Research 39:3–24.

Colombi

Giordano

Gottard

Iannario

. 2018. “Hierarchical Marginal Models with Latent Uncertainty.” Scandinavian Journal of Statistics 46:595–620.

Faraway

J. J.

2006. Extending the Linear Model with R. London, England: Chapman & Hall.

Franses

P. H.

Paap

. (2004). Quantitative Models in Marketing Research. Cambridge: Cambridge University Press.

Gottard

Iannario

Piccolo

. 2016. “Varying Uncertainty in CUB Models.” Advances in Data Analysis and Classification 10:225–44.

Greene

W. H.

2008. Econometric Analysis. 6th ed. Upper Saddle River, NJ: Pearson Prentice Hall.

10.

Greene

W. H.

Hensher

D. A.

. 2010. Modeling Ordered Choices: A Primer. Cambridge, England: Cambridge University Press.

11.

Grün

Leisch

. 2008. “Identifiability of Finite Mixtures of Multinomial Logit Models with Varying and Fixed Effects.” Journal of Classification 25:225–47.

12.

Harris

N. M.

Zhao

. 2007. “A Zero-inflated Ordered Probit Model, with an Application to Modelling Tobacco Consumption.” Journal of Econometrics 141:1073–99.

13.

Iannario

Manisera

Piccolo

Zuccolotto

. 2020. “Ordinal Data Models for No-opinion Responses in Attitude Survey.” Sociological Methods & Research 49:250–76.

14.

Iannario

Monti

A. C.

Piccolo

Ronchetti

. 2017. “Robust Inference for Ordinal Response Models.” Electronic Journal of Statistics 11:3407–45.

15.

Iannario

Monti

A. C.

Scalera

. 2021. “The Number of Response Categories in Rating Scales.”

16.

Iannario

Piccolo

. 2016. “A Comprehensive Framework of Regression Models for Ordnal Data.” Metron 74:233–52.

17.

Johnson

V. E.

Albert

J. H.

. 1999. Ordinal Data Modeling. New York: Springer-Verlag.

18.

Lesschaeve

2017. “The Predictive Power of the Left-right Self-placement Scale for the Policy Positions of Voters and Parties.” West European Politics 40:357–77.

19.

Long

J. S.

1997. Regression Models for Categorical and Limited Dependent Variables. Thousand Oaks, CA: Sage.

20.

Long

J. S.

Freese

. 2014. Regression Models for Categorical Dependent Variables Using Stata. College Station, TX: Stata Press.

21.

Long

J. S.

Mustillo

A. S.

. 2018. “Using Predictions and Marginal Effects to Compare Groups in Regression Models for Binary Outcomes.” Sociological Methods & Research. doi: 10.1177/0049124118799374.

22.

McCullagh

1980. “Regression Models for Ordinal Data (with Discussion).” Journal of the Royal Statistical Society, Series B 42:109–142.

23.

Miller

W. E.

1991. “Party Identification, Realignment, and Party Voting: Back to the Basics.” American Political Science Review 85:557–68.

24.

Mood

Carina

. 2010. “Logistic Regression: Why We Cannot Do What We Think We Can Do, and What We Can Do about It.” European Sociological Review 26:67–82.

25.

Piccolo

2003. “On the Moments of a Mixture of Uniform and Shifted Binomial Random Variables.” Quaderni di Statistica 5:85–104.

26.

Piccolo

Simone

. 2019. “The Class of CUB Models: Statistical Foundations, Inferential Issues and Empirical Evidence.” Statistical Methods & Applications 28:389–435.

27.

Piccolo

Simone

Iannario

. 2019. “Cumulative and CUB Models for Rating Data: A Comparative Analysis.” International Statistical Review 87:207–36.

28.

Sun

2015. Empirical Research in Economics: Growing up with R. Starkville, MS: Pine Square LLC.

29.

Tosteson

A. N.

Weinstein

M. C.

Wittenberg

Begg

C. B.

. 1994. “ROC Curve Regression Analysis: The Use of Ordinal Regression Models for Diagnostic Test Assessment.” Environmental Health Perspectives 102:73–78.

30.

Tutz

2012. Regression for Categorical Data. Cambridge, England: Cambridge University Press.

31.

Tutz

Schneider

. 2019. “Flexible Uncertainty in Mixture Models for Ordinal Responses.” Journal of Applied Statistics 46:1582–1601.

32.

Tutz

Schneider

Iannario

Piccolo

. 2017. “Mixture Models for Ordinal Responses to Account for Uncertainty of Choice.” Advances in Data Analysis and Classification 11:281–305.

33.

Wedel

DeSarbo

. 1995. “A Mixture Likelihood Approach for Generalized Linear Models.” Journal of Classification 12:21–55.

34.

Whitehead

1993. “Sample Size Calculations for Ordered Categorical Data.” Statistics in Medicine 12:2257–71.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.04 MB

0.01 MB

0.02 MB