Semiparametric models for multilevel overdispersed count data with extra zeros

Abstract

This study proposes semiparametric models for analysis of hierarchical count data containing excess zeros and overdispersion simultaneously. The methods discussed in this paper handle nonlinear covariate effects through flexible semiparametric multilevel regression techniques. This is performed by providing a comprehensive comparison of semiparametric multilevel zero-inflated negative binomial and semiparametric multilevel zero-inflated generalized Poisson models under the real and simulated data. An EM algorithm based on Newton–Raphson equations for maximum penalized likelihood estimation approach is developed. The performance of the proposed models is assessed by using a Monte Carlo simulation study. We also illustrated the methods by the analysis of decayed, missing, and filled teeth of children aged 5–14 years old.

Keywords

Semiparametric multilevel overdispersion zero inflated negative binomial zero inflated generalized Poisson

Get full access to this article

View all access options for this article.

References

Agresti

. Categorical data analysis, 3th ed. New York: John Wiley & Sons, 2013, pp. 7–7.

Consul

Famoye

. Generalized poisson regression model. Commun Stat Theor Meth 1992; 21: 89–101.

Famoye

. Restricted generalized Poisson regression model. Commun Stat Theor Meth 1993; 22: 1335–1354.

Hilbe

. Negative binomial regression, 2nd ed. London: Cambridge University Press, 2011.

Breslow

. Extra-Poisson variation in log-linear models. J Roy Stat Soc C Appl Stat 1984; 33: 38–44.

Palmer

Losilla

Vives

et al.

Overdispersion in the Poisson regression model. A comparative simulation study: correction. Meth Eur J Res Meth Behav Soc Sci 2013; 9: 178–178.

Payne

Hardin

Egede

et al.

Approaches for dealing with various sources of overdispersion in modeling count data: scale adjustment versus modeling. Stat Methods Med Res 2017; 26: 1802–1823.

Cohen AC. Estimation in mixtures of discrete distributions. Calcutta: Statistical Pub. Society, 1963.

Johnson

Kemp

Kotz

. Univariate discrete distributions, Hoboken, NJ: John Wiley & Sons, 2005.

10.

Lambert

. Zero-inflated Poisson regression, with an application to defects in manufacturing. Technometrics 1992; 34: 1–14.

11.

Greene WH. Accounting for excess zeros and sample selection in Poisson and negative binomial regression models. Working Paper EC-94-10: Department of Economics, New York University. 1994.

12.

Famoye

Singh

. Zero-inflated generalized Poisson regression model with an application to domestic violence data. J Data Sci 2006; 4: 117–30.

13.

Vuong

. Likelihood ratio tests for model selection and non-nested hypotheses. Econometrica 1989; 1: 307–333.

14.

Ridout

Hinde

DeméAtrio

. A score test for testing a zero-inflated Poisson regression model against zero-inflated negative binomial alternatives. Biometrics 2001; 57: 219–223.

15.

Hall

. Zero-inflated Poisson and binomial regression with random effects: a case study. Biometrics 2000; 56: 1030–1039.

16.

Wang

Yau

Lee

. A zero-inflated Poisson mixed model to analyze diagnosis related groups with majority of same-day hospital stays. Comput Meth Program Biomed 2002; 68: 195–203.

17.

Hur

Hedeker

Henderson

et al.

Modeling clustered count data with excess zeros in health care outcomes research. Health Serv Outcomes Res Methodol 2002; 3: 5–20.

18.

Moghimbeigi

Eshraghian

Mohammad

et al.

Multilevel zero-inflated negative binomial regression modeling for over-dispersed count data with extra zeros. J Appl Stat 2008; 35: 1193–1202.

19.

Xiang

Lee

Yau

et al.

A score test for overdispersion in zero-inflated Poisson mixed regression model. Stat Med 2007; 26: 1608–1608.

20.

Moghimbeigi

Eshraghian

Mohammad

et al.

A score test for zero-inflation in multilevel count data. Comput Stat Data Anal 2009; 53: 1239–1248.

21.

Hardle

Müller

Sperlich

et al.

A course on non-and semiparametric modelling, Berlin: Humboldt-Universität zu, 1999.

22.

Green

Silverman

. Nonparametric regression and generalized linear models: a roughness penalty approach, London: Chapman& Hall/CRC Press, 1993.

23.

Wood

. Fast stable direct fitting and smoothness selection for generalized additive models. J R Stat Soc Ser B Stat Methodol 2008; 70: 495–518.

24.

McLean

Hooker

Staicu

et al.

Functional generalized additive models. J Comput Graph Statist 2014; 23: 249–269.

25.

Huang

Wang

. Nonparametric mixture of regression models. J Am Stat Assoc 2013; 108: 929–941.

26.

Ruppert

. Nonparametric regression and spline smoothing. J Am Stat Assoc 2011; 96: 1523–1524.

27.

Chen

Wang

Paik

et al.

A marginal approach to reduced-rank penalized spline smoothing with application to multilevel functional data. J Am Stat Assoc 2013; 108: 1216–1229.

28.

Wiesenfarth

Hisgen

Kneib

et al.

Bayesian nonparametric instrumental variables regression based on penalized splines and dirichlet process mixtures. J Bus Econom Statist 2014; 32: 468–482.

29.

Racine

Yang

. Spline regression in the presence of categorical predictors. J Appl Econom 2015; 30: 705–717.

30.

Feng

Zhu

. Semiparametric analysis of longitudinal zero-inflated count data. J Multivariate Anal 2011; 102: 61–72.

31.

Yao

Liu

. Semiparametric analysis of longitudinal zero-inflated count data with applications to instrumental activities of daily living. J Biomet Biostat 2013; 4: 172–172.

32.

Wang

et al.

Distribution-free inference of zero-inflated binomial data for longitudinal studies. J Appl Stat 2015; 42: 2203–2219.

33.

Yau

Wang

Lee

. Zero-inflated negative binomial mixed regression modeling of over-dispersed count data with extra zeros. Biometrical J 2003; 45: 437–452.

34.

Xie

Lin

Wei

. Score test for homogeneity of dispersion in generalized Poisson mixed models with excess zeros. Commun Stat-Simul C 2017; 46: 301–314.

35.

Almasi

Eshraghian

Moghimbeigi

et al.

Multilevel zero-inflated generalized Poisson regression modeling for dispersed correlated count data. Stat Methodol 2016; 30: 1–4.

36.

Lee

Wang

Scott

et al.

Multi-level zero-inflated Poisson regression modelling of correlated count data with excess zeros. Stat Meth Med Res 2006; 15: 47–61.

37.

Bratthall

. Estimation of global DMFT for 12-year-olds in 2004. Int dent J 2005; 55: 370–237.

38.

Buu

Tan

et al.

Statistical models for longitudinal zero-inflated count data with applications to the substance abuse field. Stat Med 2012; 31: 4074–4086.

39.

Fang

Wagner

Harris

et al.

Application of zero-inflated negative binomial mixed model to human microbiota sequence data. PeerJ PrePrints 2014.

40.

Zhu

Luo

DeSantis

. Zero-inflated count models for longitudinal measurements with heterogeneous random effects. Stat Meth Med Res 2015.

41.

Wood

. Generalized additive models: an introduction with R, New York: Chapman & Hall/CRC, 2006.

42.

Ruppert

Wand

Carroll

. Semiparametric regression, London: Cambridge University Press, 2003.

43.

Breslow

Clayton

. Approximate inference in generalized linear mixed models. J Am Stat Assoc 1993; 88: 9–25.

44.

Dempster

Laird

Rubin

. Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc Ser B Stat Methodol 1977; 39: 1–38.

45.

Splieth

Fleßa

. Modelling lifelong costs of caries with and without fluoride use. Eur J Oral Sci 2008; 116: 164–169.

46.

Matranga

Castiglia

Solinas

. Challenges in dental statistics: data and modelling. Epidemiol Biostat Public Health 2013; 10: e87591-8–e87591-8.

47.

Zare Javid

Amerian

Basir

et al.

Effects of short-term consumption of probiotic yogurt on streptococcus mutans and lactobacilli levels in 18-30 years old students with initial stages of dental caries in Ahvaz City. Nutr Food Sci Res 2015; 2: 7–12.

48.

Karimi

Esfahanian

Khadem

. Determination of the incidence of dental caries and periodontal disease among Shiraz, Iran, residents. Galen Med J 2013; 1: 66–71.

49.

Leghari

. Association of dental caries and parents knowledge of oral health: a cross-sectional survey of schools of Karachi, Pakistan. J Pak Med Assoc 2014; 23: 19–19.

50.

Bica

Cunha

Reis

et al.

Food consumption, body mass index and risk for oral health in adolescents. Aten Primaria 2014; 46: 154–159.

51.

Joe

Zhu

. Generalized Poisson distribution: the property of mixture of Poisson and comparison with negative binomial distribution. Biomet J 2005; 47: 219–229.

52.

Zafakali

NSB

Ahmad

. Modeling and handling overdispersion health science data with zero-inflated Poisson model. J Mod Appl Stat Meth 2013; 12: 28–28.

53.

Moghimbeigi

. Two-part zero-inflated negative binomial regression model for quantitative trait loci mapping with count trait. J Theor Biol 2015; 372: 74–80.

54.

Chu

Koval

. Trajectory modeling of longitudinal binary data: application of the EM algorithm for mixture models. Commun Stat-Simul C 2014; 43: 495–519.

55.

Hedeker

Gibbons

. Longitudinal data analysis, Hoboken, NJ: John Wiley & Sons, 2006.

56.

Wedderburn

. Quasi-likelihood functions, generalized linear models, and the Gauss—Newton method. Biometrika 1974; 61: 439–447.