Outlier detection for inequality and poverty analysis

Abstract

Extreme values are common in survey data and represent a recurring threat to the reliability of both poverty and inequality estimates. The adoption of a consistent criterion for outlier detection is useful in many practical applications, particularly when international and intertemporal comparisons are involved. In this article, we discuss a simple univariate detection procedure to flag outliers. We present outdetect, a command that implements the procedure and provides useful diagnostic tools. The output of outdetect compares statistics obtained before and after the exclusion of outliers, with a focus on inequality and poverty measures. Finally, we carry out an extensive sensitivity exercise where the same outlier detection method is applied consistently to per capita expenditure across more than 30 household budget surveys. The results are clear and provide a sense of the influence of extreme values on poverty and inequality estimates.

Keywords

st0759 outdetect outliers extreme values inequality poverty incremental trimming curve

Get full access to this article

View all access options for this article.

References

Alfons

Templ

Filzmoser

. 2013. Robust estimation of economic indicators from survey samples based on Pareto tail modelling. Journal of the Royal Statistical Society, C ser., 62: 271–286. 10.1111/j.1467-9876.2012.01063.x.

Atkinson

A. B

. 2019. Measuring Poverty Around the World. ed. J. Micklewright and A. Brandolini. Princeton, NJ: Princeton University Press. 10.2307/j.ctvc77fd6.

Barnett

Lewis

. 1994. Outliers in Statistical Data. 3rd ed. Chichester, UK: Wiley.

Belotti

Mancini

Vecchi

. 2022. Outlier detection for welfare analysis. Policy Research Working Paper 10231, World Bank. 10.1596/1813-9450-10231.

Billor

Hadi

A. S.

Velleman

P. F.

. 2000. BACON: Blocked adaptive computationally efficient outlier nominators. Computational Statistics and Data Analysis 34: 279–298. https://doi.org/10.1016 /S0167-9473(99)00101-2.

Box

G. E. P.

Cox

D. R.

. 1964. An analysis of transformations. Journal of the Royal Statistical Society, B ser., 26: 211–243. 10.1111/j.2517-6161.1964.tb00553.x.

Bruffaerts

Verardi

Vermandele

. 2014. A generalized boxplot for skewed and heavy-tailed distributions. Statistics and Probability Letters 95: 110–117. 10.1016/j.spl.2014.08.016.

Cowell

F. A.

Flachaire

. 2007. Income distribution and inequality measurement: The problem of extreme values. Journal of Econometrics 141: 1044–1072. 10.1016/j.jeconom.2007.01.001.

—. 2015. Statistical methods for distributional analysis. In Vol. 2 of Handbook of Income Distribution, ed. A. B. Atkinson and F. Bourguignon, 359-465. Amsterdam: North-Holland. 10.1016/B978-0-444-59428-0.00007-2.

10.

Cowell, F. A., and P. Van Kerm. 2015. Wealth inequality: A survey. Journal of Economic Surveys 29: 671–710. 10.1111/joes.12114.

11.

Cowell

F. A.

Victoria-Feser

M.-P.

. 1996a. Poverty measurement with contaminated data: A robust approach. European Economic Review 40: 1761–1771. 10.1016/0014-2921(95)00048-8.

12.

—. 1996b. Robustness properties of inequality measures. Econometrica 64: 77–101. https://doi.org/10.2307/2171925 .

13.

Croux

Rousseeuw

P. J.

. 1992. Time-efficient algorithms for two highly robust estimators of scale. In Vol. 1 of Computational Statistics, ed. Y. Dodge and J. Whittaker, 411-428. Heidelberg: Physica-Verlag. https://doi.org/10.1007/978-3-662-26811-7_58 .

14.

D’Agostino

R. B.

Belanger

D’Agostino

R. B.

Jr . 1990. A suggestion for using powerful and informative tests of normality. American Statistician 44: 316–321. https://doi.org/10.1080/00031305.1990.10475751 .

15.

Davies

Gather

. 1993. The identification of multiple outliers. Journal of the American Statistical Association 88: 782–792. https://doi.org/10.1080/01621459.1993.10476339 .

16.

Deaton

Kozel

. 2005. Prices and poverty in India. In The Great Indian Poverty Debate, ed. Deaton

Kozel

, 381–411. New Delhi, India: MacMillian.

17.

Dupriez

. 2007. Building a household consumption database for the calculation of poverty PPPs. Technical note, World Bank.

18.

Filzmoser

Gussenbauer

Templ

. 2016. Detecting outliers in household consumption survey data. Working Paper 1157976, Vienna University of Technology.

19.

Foster

Greer

Thorbecke

. 1984. A class of decomposable poverty measures. Econometrica 52: 761–766. https://doi.org/10.2307/1913475 .

20.

Friedline

Masa

R. D.

Chowa

G. A.

. 2015. Transforming wealth: Using the inverse hyperbolic sine (IHS) and splines to predict youth’s math achievement. Social Science Research 49: 264–287. https://doi.org/10.1016/j.ssresearch.2014.08.018 .

21.

Gather

Becker

. 1997. Outlier identification and robust methods. In Vol. 15 of Handbook of Statistics: Robust Inference, ed. G. S. Maddala and C. R. Rao, 123-143. Amsterdam: North-Holland. https://doi.org/10.1016/S0169-7161(97)15008-8 .

22.

Grubbs

F. E

. 1969. Procedures for detecting outlying observations in samples. Technometrics 11: 1–21. https://doi.org/10.1080/00401706.1969.10490657 .

23.

Hampel

F. R

. 1974. The influence curve and its role in robust estimation. Journal of the American Statistical Association 69: 383–393. https://doi.org/10.2307/2285666 .

24.

Hampel

F. R.

Ronchetti

E. M.

Rousseeuw

P. J.

Stahel

W. A.

. 1986. Robust Statistics: The Approach Based on Influence Functions. New York: Wiley. https://doi.org/10.1002/9781118186435 .

25.

Hlasny

. 2020. Nonresponse bias in inequality measurement: Cross-country analysis using Luxembourg Income Study surveys. Social Science Quarterly 101: 712–731. https://doi.org/10.1111/ssqu.12762 .

26.

Huber

P. J

. 1981. Robust Statistics. New York: Wiley.

27.

—. 2002. John W. Tukey’s contributions to robust statistics. Annals of Statistics 30: 1640–1648. https://doi.org/10.1214/aos/1043351251 .

28.

Jann

2020. dstat: Stata module to compute summary statistics and distribution functions including standard errors and optional covariate balancing. Statistical Software Components S458874, Department of Economics, Boston College. https://ideas.repec.org/c/boc/bocode/s458874.html .

29.

Jann, B., V. Verardi, and C. Vermandele. 2018. robstat: Stata module to estimate robust univariate statistics. Statistical Software Components S458524, Department of Economics, Boston College. https://ideas.repec.org/c/boc/bocode/s458524.html .

30.

Jenkins

S. P

. 1991. The measurement of income inequality. In Economic Inequality and Poverty: International Perspectives, ed. Osberg

, 3–38. London: M. E. Sharpe.

31.

—. 2017. Pareto models, top incomes and recent trends in UK income inequality. Economica 84: 261–289. https://doi.org/10.1111/ecca.12217 .

32.

Mancini

Vecchi

. 2022. On the Construction of the Consumption Aggregate for Inequality and Poverty Analysis. Washington, DC: World Bank.

33.

Peterson

R. A.

Cavanaugh

J. E.

. 2019. Ordered quantile normalization: A semi- parametric transformation built for the cross-validation era. Journal ofApplied Statistics 47: 2312–2327. https://doi.org/10.1080/02664763.2019.1630372 .

34.

Ravallion

. 1994. Poverty Comparisons. Chur, Switzerland: Harwood Academic Publishers.

35.

Rousseeuw

P. J.

Croux

. 1993. Alternatives to the median absolute deviation. Journal of the American Statistical Association 88: 1273–1283. 10.2307/2291267.

36.

Rousseeuw

P. J.

Hubert

. 2018. Anomaly detection by robust statistics. WIREs Data Mining and Knowledge Discovery 8: e1236. https://doi.org/10.1002/widm.1236 .

37.

Schluter

. 2012. On the problem of inference for inequality measures for heavy-tailed distributions. Econometrics Journal 15: 125–153. https://doi.org/10.1111/j.1368-423X.2011.00356.x .

38.

Shapiro

S. S.

Francia

R. S.

. 1972. An approximate analysis of variance test for normality. Journal of the American Statistical Association 67: 215–216. https://doi.org/10.1080/01621459.1972.10481232 .

39.

Shapiro

S. S.

Wilk

M. B.

. 1965. An analysis of variance test for normality (complete samples). Biometrika 52: 591–611. https://doi.org/10.2307/2333709 .

40.

Snedecor

G. W.

Cochran

W. G.

. 1989. Statistical Methods. 8th ed. Ames, IA: Iowa State University Press.

41.

Tukey

J. W

. 1962. The future of data analysis. Annals of Mathematical Statistics 33: 1–67. 10.1214/aoms/1177704711.

42.

Turkiewicz

K. L

. 2017. Data trimming. In Vol. 4 of The Sage Encyclopedia of Communication Research Methods, ed. M. Allen, 347-348. Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781483381411 .

43.

Van Kerm, P. 2007. Extreme incomes and the estimation of poverty and inequality indicators from EU-SILC. IRISS Working Paper Series 2007–01, CEPS/INSTEAD.

44.

Verardi

Vermandele

. 2018. Univariate and multivariate outlier identification for skewed or heavy-tailed distributions. Stata Journal 18: 517–532. https://doi.org/10.1177/1536867X1801800303 .

45.

Victoria-Feser

M.-P

. 2000. Robust methods for the analysis of income distribution, inequality and poverty. International Statistical Review 68: 277–293. 10.1111/j.1751-5823.2000.tb00331.x.

46.

Weber

. 2010. bacon: An effective way to detect outliers in multivariate data using Stata (and Mata). Stata Journal 10: 331–338. https://doi.org/10.1177/1536867X1001000302 .

47.

Yeo

I.-K.

Johnson

R. A.

. 2000. A new family of power transformations to improve normality or symmetry. Biometrika 87: 954–959. https://doi.org/10.1093/biomet/87.4.954 .