In 1881, Donald MacAlister posed a problem in the Educational Times that remains relevant today. The problem centers on the statistical evidence for the effectiveness of a treatment based on a comparison between two proportions. A brief historical sketch is followed by a discussion of two default Bayesian solutions, one based on a one-sided test between independent rates, and one on a one-sided test between dependent rates. We demonstrate the current-day relevance of MacAlister’s original question with a modern-day example about the effectiveness of an educational program.
DaleA. I. (1999). A history of inverse probability: From Thomas Bayes to Karl Pearson (2nd ed.). New York, NY: Springer.
2.
de Braganca PereiraC. A.SternJ. M. (1999). Evidence and credibility: Full Bayesian significance test for precise hypotheses. Entropy, 1, 99-110.
3.
DickeyJ. M.LientzB. P. (1970). The weighted likelihood ratio, sharp hypotheses about chances, the order of a Markov chain. Annals of Mathematical Statistics, 41, 214-226.
4.
GunelE.DickeyJ. (1974). Bayes factors for independence in contingency tables. Biometrika, 61, 545-557.
5.
HoetingJ. A.MadiganD.RafteryA. E.VolinskyC. T. (1999). Bayesian model averaging: A tutorial. Statistical Science, 14, 382-417.
6.
HowardJ. V. (1998). The 2 × 2 table: A discussion from a Bayesian viewpoint. Statistical Science, 13, 351-367.
7.
JeffreysH. (1935). Some tests of significance, treated by the theory of probability. Proceedings of the Cambridge Philosophy Society, 31, 203-222.
8.
JeffreysH. (1961). Theory of probability (3rd ed.). Oxford, England: Oxford University Press.
9.
JohnsonV. E.RossellD. (2010). On the use of non-local prior densities in Bayesian hypothesis tests. Journal of the Royal Statistical Society, Series B, 72, 143-170.
10.
KassR. E.VaidyanathanS. K. (1992). Approximate Bayes factors and orthogonal parameters, with application to testing equality of two binomial proportions. Journal of the Royal Statistical Society, Series B, 54, 129-144.
11.
KlugkistI.LaudyO.HoijtinkH. (2005). Inequality constrained analysis of variance: A Bayesian approach. Psychological Methods, 10, 477-493.
12.
LiebermeisterC. (1877). Ueber Wahrscheinlichkeitsrechnung in Anwendung auf therapeutische Statistik [On probability theory as applied to therapeutic statistics]. In VolkmannR. (Ed.), Sammlung Klinischer Vortrage No. 110 (Innere Medicin No. 39) (pp. 935-962). Leipzig, Germany: Breitkopf & Härtel.
13.
LindleyD. V. (1985). Making decisions (2nd ed.). London, England: Wiley.
14.
LindleyD. V. (2006). Understanding uncertainty. Hoboken, NJ: Wiley.
15.
ListerJ. (1967). Antiseptic principle in the practice of surgery. British Medical Journal, 2, 9-12. (Original work published 1867)
16.
MoreyR. D.RouderJ. N. (2015). Bayes Factor 0.9.11-1. Comprehensive R Archive Network.
17.
MoreyR. D.WagenmakersE.-J. (2014). Simple relation between Bayesian order-restricted and point-null hypothesis tests. Statistics and Probability Letters, 92, 121-124.
18.
PericchiL. R.LiuG.TorresD. (2008). Objective Bayes factors for informative hypotheses: “Completing” the informative hypothesis and “splitting” the Bayes factor. In HoijtinkH.KlugkistI.BoelenP. A. (Eds.), Bayesian evaluation of informative hypotheses (pp. 131-154). New York, NY: Springer Verlag.
19.
TuckmanB. W.KennedyG. J. (2011). Teaching learning strategies to increase success of first-term college students. Journal of Experimental Education, 79, 478-504.
20.
TverskyA. (1969). Intransitivity of preferences. Psychological Review, 76, 31-48.
21.
WagenmakersE.-J.LodewyckxT.KuriyalH.GrasmanR. (2010). Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method. Cognitive Psychology, 60, 158-189.
22.
WinsorC. P. (1948). Probability and Listerism. Human Biology, 20, 161-169.
23.
WrinchD.JeffreysH. (1921). On certain fundamental principles of scientific inquiry. Philosophical Magazine, 42, 369-390.
24.
ZhuM.LuA. Y. (2004). The counter-intuitive non-informative prior for the Bernoulli family. Journal of Statistics Education, 12, 1-10.
