Sage Journals: Discover world-class research

Abstract

Modified Poisson regression, which estimates the regression parameters in the log-binomial regression model using the Poisson quasi-likelihood estimating equation and robust variance, is a useful tool for estimating the adjusted risk and prevalence ratio in binary outcome analysis. Although several goodness-of-fit tests have been developed for other binary regressions, few goodness-of-fit tests are available for modified Poisson regression. In this study, we proposed several goodness-of-fit tests for modified Poisson regression, including the modified Hosmer-Lemeshow test with empirical variance, Tsiatis test, normalized Pearson chi-square tests with binomial variance and Poisson variance, and normalized residual sum of squares test. The original Hosmer-Lemeshow test and normalized Pearson chi-square test with binomial variance are inappropriate for the modified Poisson regression, which can produce a fitted value exceeding 1 owing to the unconstrained parameter space. A simulation study revealed that the normalized residual sum of squares test performed well regarding the type I error probability and the power for a wrong link function. We applied the proposed goodness-of-fit tests to the analysis of cross-sectional data of patients with cancer. We recommend the normalized residual sum of squares test as a goodness-of-fit test in the modified Poisson regression.

Keywords

Goodness-of-fit test log-binomial regression model modified Poisson regression prevalence ratio risk ratio

Get full access to this article

View all access options for this article.

References

Wacholder

. Binomial regression in GLIM: estimating risk ratios and risk differences. Am J Epidemiol 1986; 123: 174–184.

McNutt

Xue

, et al. Estimating the relative risk in cohort studies and clinical trials of common outcomes. Am J Epidemiol 2003; 157: 940–943.

Blizzard

Hosmer

. Parameter estimation and goodness-of-fit in log binomial regression. Biometrical J 2006; 48: 5–22.

de Andrade

Andrade

JMD

. Some results for maximum likelihood estimation of adjusted relative risks. Commun Stat-Theor M 2018; 47: 5750–5769.

Carter

Lipsitz

Tilley

. Quasi-likelihood estimation for relative risk regression models. Biostatistics 2005; 6: 39–44.

Zou

. A modified Poisson regression approach to prospective studies with binary data. Am J Epidemiol 2004; 159: 702–706.

Barros

Hirakata

. Alternatives for logistic regression in cross-sectional studies: an empirical comparison of models that directly estimate the prevalence ratio. BMC Med Res Methodol 2003; 3: 21.

White

. Maximum likelihood estimation of misspecified models. Econometrica 1982; 50: 1–25.

Campbell

BCV

Parsons

, et al. Thrombolysis guided by perfusion imaging up to 9 hours after onset of stroke. New Engl J Med 2019; 380: 1795–1803.

10.

Griffin

Yuan

Takas

, et al. Single-dose nirsevimab for prevention of RSV in preterm infants. New Engl J Med 2020; 383: 415–425.

11.

Wilson

Martin

Yamamoto

, et al. Electronic health record alerts for acute kidney injury: multicenter, randomized clinical trial. Br Med J 2021; 372: m4786.

12.

Cnattingius

Johansson

Razaz

. Apgar score and risk of neonatal death among preterm infants. New Engl J Med 2020; 383: 49–57.

13.

Lee

Brumback

Sathitratanacheewin

, et al. Association of physician orders for life-sustaining treatment with ICU admission among patients hospitalized near the end of life. JAMA 2020; 323: 950–960.

14.

Anand

Montez-Rath

Han

, et al. SARS-CoV-2 vaccine antibody response and breakthrough infection in patients receiving dialysis. Ann Intern Med 2022; 175: 371–378.

15.

Wolf

Serper

Opsasnick

, et al. Awareness, attitudes, and actions related to COVID-19 among adults with chronic conditions at the onset of the US outbreak: a cross-sectional survey. Ann Intern Med 2020; 173: 100–109.

16.

Jonsdottir

Hauksdottir

Aspelund

, et al. Risk factors for workplace sexual harassment and violence among a national cohort of women in Iceland: a cross-sectional study. Lancet Public Health 2022; 7: e763–e774.

17.

Prete

Subramanian

Bancos

, et al. Cardiometabolic disease burden and steroid excretion in benign adrenal tumors: a cross-sectional multicenter study. Ann Intern Med 2022; 175: 325–334.

18.

Quinn

Hosmer

Blizzard

. Goodness-of-fit statistics for log-link regression models. J Stat Comput Sim 2015; 85: 2533–2545.

19.

Canary

Blizzard

Barry

, et al. Summary goodness-of-fit statistics for binary generalized linear models with noncanonical link functions. Biometrical J 2016; 58: 674–690.

20.

Wei

. A lack-of-fit test for the mean function in a generalized linear model. J Am Stat Assoc 1991; 86: 420–426.

21.

Lin

Wei

Ying

. Model-checking techniques based on cumulative residuals. Biometrics 2002; 58: 1–12.

22.

Barnhart

Williamson

. Goodness-of-fit tests for GEE modeling with binary responses. Biometrics 1998; 54: 720–729.

23.

Horton

Bebchuk

Jones

, et al. Goodness-of-fit for GEE: an example with mental health service utilization. Stat Med 1999; 18: 213–222.

24.

Pan

. Goodness-of-fit tests for GEE with correlated binary data. Scand J Stat 2002; 29: 101–110.

25.

Tian

Liu

. Re: easy SAS calculations for risk or prevalence ratios and differences. Am J Epidemiol 2006; 163: 1157–1158.

26.

Hosmer

Lemeshow

. Goodness of fit tests for the multiple logistic regression model. Commun Stat-Theor M 1980; 9: 1043–1069.

27.

Hosmer

le Cessie

, et al. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med 1997; 16: 965–980.

28.

Tsiatis

. A note on a goodness-of-fit test for the logistic regression model. Biometrika 1980; 67: 250–251.

29.

Breslow

. Tests of hypotheses in overdispersed Poisson regression and other quasi-likelihood models. J Am Stat Assoc 1990; 85: 565–571.

30.

Boos

. On generalized score tests. Am Stat 1992; 46: 327–333.

31.

Moore

Spruill

. Unified large-sample theory of general chi-squared statistics for tests of fit. Ann Stat 1975; 3: 599–616.

32.

Halteman

. A goodness-of-fit statistic for binary logistic regression (Ph.D. dissertation). University of Washington, Washington, 1980.

33.

Hosmer

Hjort

. Goodness-of-fit processes for logistic regression: simulation results. Stat Med 2002; 21: 2723–2738.

34.

Osius

Rojek

. Normal goodness-of-fit tests for multinomial models with large degrees of freedom. J Am Stat Assoc 1992; 87: 1145–1152.

35.

Evans

Hosmer

. Goodness of fit tests for logistic GEE models: simulation results. Commun Stat-Simul C 2004; 33: 247–258.

36.

Kent

. Robust properties of likelihood ratio tests. Biometrika 1982; 69: 19–27.

37.

Rotnitzky

Jewell

. Hypothesis testing of regression parameters in semiparametric generalized linear models for cluster correlated data. Biometrika 1990; 77: 485–497.

38.

Stefanski

Boos

. The calculus of M-estimation. Am Stat 2002; 56: 29–38.

39.

Ristl

McDaniel

Henderson

, et al. mmmgee: Simultaneous Inference for Multiple Linear Contrasts in GEE Models, https://cran.r-project.org/web/packages/mmmgee/index.html (accessed 30 Nov 2023).

40.

Hagiwara

Shiroiwa

Taira

, et al. Mapping EORTC QLQ-C30 and FACT-G onto EQ-5D-5L index for patients with cancer. Health Qual Life Outcomes 2020; 18: 354.

41.

Hagiwara

Shiroiwa

Taira

, et al. Gradient boosted tree approaches for mapping European Organization for Research and Treatment of Cancer quality of life questionnaire core 30 onto 5-level version of EQ-5D index for patients with cancer. Value Health 2023; 26: 269–279.

42.

Izumi

Hagiwara

Matsuyama

, et al. Impacts of the preceding cancer-specific health-related quality of life instruments on the responses to the subsequent EQ-5D-5L. Health Qual Life Outcomes 2023; 21: 3.

43.

Herdman

Gudex

Lloyd

, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011; 20: 1727–1736.

44.

Greenland

. Introduction to regression modeling. In: Rothman

Greenland

Lash

(eds) Mordern Epidemiology. 3rd ed. Philadelphia: Lippincott Williams & Wilkins, 2008, pp. 418–455.

45.

Stukel

. Generalized logistic models. J Am Stat Assoc 1988; 83: 426–431.

46.

Pan

. On the robust variance estimator in generalised estimating equations. Biometrika 2001; 88: 901–906.

47.

Mancl

DeRouen

. A covariance estimator for GEE with improved small-sample properties. Biometrics 2001; 57: 126–134.

48.

Wang

Long

. Modified robust variance estimator for generalized estimating equations with improved small-sample performance. Stat Med 2011; 30: 1278–1291.

49.

Guo

Shah

. Rank-transformed subsampling: inference for multiple data splitting and exchangeable p-values. arXiv:2301.02739.

50.

Shah

Bühlmann

. Goodness-of-fit tests for high dimensional linear models. J R Stat Soc B 2018; 80: 113–135.

51.

Janková

Shah

RJD

Bühlmann

, et al. Goodness-of-fit testing in high dimensional generalized linear models. J R Stat Soc B 2020; 82: 773–795.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.64 MB

Goodness-of-fit tests for modified Poisson regression possibly producing fitted values exceeding one in binary outcome analysis

Abstract

Keywords

Get full access to this article

References

Supplementary Material