Sage Journals: Discover world-class research

Abstract

Bland–Altman plots can be useful in paired data settings such as measurement-method comparison studies. A Bland–Altman plot has differences, percentage differences, or ratios on the y axis and a mean of the data pairs on the x axis, with 95% limits of agreement indicating the central 95% range of differences, percentage differences, or ratios. This range can vary with the mean. We introduce the community-contributed blandaltman command, which uniquely in Stata can 1) create Bland–Altman plots featuring ratios in addition to differences and percentage differences, 2) allow the limits of agreement for ratios and percentage differences to vary as a function of the mean, and 3) add confidence intervals, prediction intervals, and tolerance intervals to the plots.

Keywords

gr0094 blandaltman Bland–Altman plot limits of agreement agreement baplot batplot concord prediction tolerance interval ratio percentage difference

Get full access to this article

View all access options for this article.

References

Bland

J. M.

Altman

D. G.

. 1986. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 327: 307–310. https://doi.org/10.1016/S0140-6736(86)90837-8.

Bland

J. M.

Altman

D. G.

. 1999. Measuring agreement in method comparison studies. Statistical Methods in Medical Research 8: 135–160. https://doi.org/10.1177/096228029900800204.

Brindle

Lillis

Barney

Hess

S. Y.

Wessells

K. R.

Ouédraogo

C. T.

Stinca

, et al. 2017. Simultaneous assessment of iodine, iron, vitamin A, malarial antigenemia, and inflammation status biomarkers via a multiplex immunoassay method on a population of pregnant women from Niger. PLOS ONE 12: e0185868. https://doi.org/10.1371/journal.pone.0185868.

Carkeet

2015. Exact parametric confidence intervals for Bland–Altman limits of agreement. Optometry and Vision Science 92: e71–e80. https://doi.org/10.1097/OPX.0000000000000513.

Carkeet

Goh

Y. T.

. 2018. Confidence and coverage for Bland–Altman limits of agreement and their approximate confidence intervals. Statistical Methods in Medical Research 27: 1559–1574. https://doi.org/10.1177/0962280216665419.

Chatfield

2021. tolerance: Stata module to calculate tolerance intervals (normal distribution). Statistical Software Components S459009, Department of Economics, Boston College. https://ideas.repec.org/c/boc/bocode/s459009.html.

Cole

T. J.

2000. Sympercents: Symmetric percentage differences on the 100 log(e) scale simplify the presentation of log transformed data. Statistics in Medicine 19: 3109–3125. https://doi.org/10.1002/1097-0258(20001130)19:22%3C3109::AID-SIM558%3E3.0.CO;2-F.

Cole

T. J.

Altman

D. G.

. 2017. Statistics Notes: What is a percentage difference? BMJ 358: j3663. https://doi.org/10.1136/bmj.j3663.

Cox

N. J.

2018. Speaking Stata: Logarithmic binning and labeling. Stata Journal 18: 262–286. https://doi.org/10.1177/1536867X1801800116.

10.

Cox

N. J.

2020. Software Updates: gr0072_1: Speaking Stata: Logarithmic binning and labeling. Stata Journal 20: 1028–1030. https://doi.org/10.1177/1536867X20976342.

11.

Dewitte

Fierens

Stöckl

Thienpon

L. M.

. 2002. Application of the Bland– Altman plot for interpretation of method-comparison studies: A critical investigation of its practice. Clinical Chemistry 48: 799–801. https://doi.org/10.1093/clinchem/48.5.799.

12.

Doménech

J. M.

Sesma

. 2021. agree: Passing–Bablock and Bland–Altman methods: User-written command agree for Stata. GitHub. https://github.com/rsesma/stata/tree/master/agree.

13.

Francq

B. G.

Berger

Boachie

. 2020. To tolerate or to agree: A tutorial on tolerance intervals in method comparison studies with BivRegBLS R package. Statistics in Medicine 39: 4334–4349. https://doi.org/10.1002/sim.8709.

14.

Gerke

2020. Reporting standards for a Bland–Altman agreement analysis: A review of methodological reviews. Diagnostics 10: 334. https://doi.org/10.3390/diagnostics10050334.

15.

Howe

W. G.

1969. Two-sided tolerance limits for normal populations—Some improvements. Journal of the American Statistical Association 64: 610–620. https://doi.org/10.1080/01621459.1969.10500999.

16.

Kirkwood

B. R.

Sterne

J. A. C.

. 2003. Essential Medical Statistics. 2nd ed. Oxford: Blackwell.

17.

Klein

2018. Implementing a general framework for assessing interrater agreement in Stata. Stata Journal 18: 871–901. https://doi.org/10.1177/1536867X1801800408.

18.

Limpert

Stahel

W. A.

. 2011. Problems with using the normal distribution— And ways to improve quality and efficiency of data analysis. PLOS ONE 6: e21403. https://doi.org/10.1371/journal.pone.0021403.

19.

Linden

2021. rmloa: Stata module to compute limits of agreement for data with repeated measures. Statistical Software Components S458980, Department of Economics, Boston College. https://ideas.repec.org/c/boc/bocode/s458980.html.

20.

Ludbrook

2010. Confidence in Altman–Bland plots: A critical review of the method of differences. Clinical and Experimental Pharmacology and Physiology 37: 143–149. https://doi.org/10.1111/j.1440-1681.2009.05288.x.

21.

Mander

2005. batplot: Stata module to produce Bland–Altman plots accounting for trend. Statistical Software Components S448703, Department of Economics, Boston College. https://ideas.repec.org/c/boc/bocode/s448703.html.

22.

Meeker

W. Q.

Hahn

G. J.

Escobar

L. A.

. 2017. Statistical Intervals: A Guide for Practitioners and Researchers. 2nd ed. Hoboken, NJ: Wiley.

23.

Royston

Matthews

J. N. S.

. 1991. Estimation of reference ranges from normal samples. Statistics in Medicine 10: 691–695. https://doi.org/10.1002/sim.4780100503.

24.

Seed

2000. sbe33: Comparing several methods of measuring the same quantity. Stata Technical Bulletin 55: 2–9. Reprinted in Stata Technical Bulletin Reprints. Vol. 10, pp. 73–82. College Station, TX: Stata Press.

25.

Shieh

2018. The appropriateness of Bland-Altman’s approximate confidence intervals for limits of agreement. BMC Medical Research Methodology 18: 45. https://doi.org/10.1186/s12874-018-0505-y.

26.

Steichen

T. J.

Cox

N. J.

. 1998. sg84: Concordance correlation coefficient. Stata Technical Bulletin 43: 35-39. Reprinted in Stata Technical Bulletin Reprints . Vol. 8, pp. 137–143. College Station, TX: Stata Press.

27.

Taffé

Peng

Stagg

Williamson

. 2017. biasplot: A package to effective plots to assess bias and precision in method comparison studies. Stata Journal 17: 208–221. https://doi.org/10.1177/1536867X1701700111.

28.

Törnqvist

Vartia

Y. O.

. 1985. How should relative changes be measured? American Statistician 39: 43–46. https://doi.org/10.2307/2683905.

29.

Vangel

2005. Tolerance interval. In Encyclopedia of Biostatistics, ed. P. Armitage and T. Colton, 8: 5477–5482, 2nd ed. Chichester, U.K.: Wiley. https://doi.org/10.1002/0470011815.b2a15163.

30.

Vardeman

S. B.

1992. What about the other intervals? American Statistician 46: 193–197. https://doi.org/10.1080/00031305.1992.10475882.

31.

Vock

2016. Intervals for the assessment of measurement agreement: Similarities, differences, and consequences of incorrect interpretations. Biometrical Journal 58: 489–501. https://doi.org/10.1002/bimj.201400234.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.02 MB

0.00 MB

blandaltman: A command to create variants of Bland–Altman plots

Abstract

Keywords

Get full access to this article

References

Supplementary Material