Stan is a free and open-source C++ program that performs Bayesian inference or optimization for arbitrary user-specified models and can be called from the command line, R, Python, Matlab, or Julia and has great promise for fitting large and complex statistical models in many areas of application. We discuss Stan from users’ and developers’ perspectives and illustrate with a simple but nontrivial nonlinear regression example.
BatesD.MaechlerM.BolkerB.WalkerS. (2014). lme4: Linear mixed-effects models using Eigen and S4[Computer software manual]. Retrieved fromhttp://CRAN.R-project.org/package=lme4(R package version 1.1-7)
2.
BealS.SheinerL.BoeckmannA.BauerR. (1989–2009). NONMEM user’s guides[Computer software manual]. Ellicott City, MD: ICON Development Solutions.
3.
BetancourtM. (2013). Generalizing the no-U-turn sampler to Riemannian manifolds. arXiv, 1304.1920. Retrieved fromhttp://arxiv.org/abs/1304.1920
4.
ByrdR. H.LuP.NocedalJ.ZhuC. (1994). A limited memory algorithm for bound constrained optimization. SIAM Journal on Scientific Computing, 16, 1190–1208.
5.
GayD. M. (2005). Semiautomatic differentiation for efficient gradient computations. In BückerH. M.CorlissG. F.HovlandP.NaumannU.NorrisB. (Eds.), Automatic differentiation: Applications, theory, and implementations (Vol. 50, pp. 147–158). New York, NY: Springer. doi:10.1007/3-540-28438-9_13
6.
GelmanA.CarlinJ. B.SternH. S.DunsonD. B.VehtariA.RubinD. B. (2013). Bayesian data analysis (3rd ed.). London, England: Chapman & Hall/CRC Press.
7.
GelmanA.VehtariA.JylänkiP.RobertC.ChopinN.CunninghamJ. P. (2014). Expectation propagation as a way of life. arXiv, 1412.4869.
8.
GhitzaY.GelmanA. (2014). The great society, Reagan’s revolution, and generations of presidential voting. To be submitted.
9.
GriewankA.WaltherA. (2008). Evaluating derivatives: Principles and techniques of algorithmic differentiation (2nd ed.). Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).
10.
HoffmanM. D.GelmanA. (2014). The No-U-turn sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo. Journal of Machine Learning Research, 15, 1593–1623. Retrieved fromhttp://jmlr.org/papers/v15/hoffman14a.html
11.
KucukelbirA.RanganathR.GelmanA.BleiD. M. (2015). Automatic variational inference in Stan. Neural Information Processing Systems, 2015. [arXiv 1506.03431]
12.
LewandowskiD.KurowickaD.JoeH. (2009). Generating random correlation matrices based on vines and extended onion method. Journal of Multivariate Analysis, 100, 1989–2001.
13.
LunnD.SpiegelhalterD.ThomasA.BestN. (2009). The BUGS project: Evolution, critique and future directions. Statistics in Medicine, 28, 3049–3067.
14.
LunnD.ThomasA.BestN.SpiegelhalterD. (2000). Winbugs—A Bayesian modeling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325–337.
15.
MartinA. D.QuinnK. M.ParkJ. H. (2011). MCMCpack: Markov chain Monte Carlo in R. Journal of Statistical Software, 42, 22. Retrieved fromhttp://www.jstatsoft.org/v42/i09/
16.
MetropolisN.UlamS. (1949). The Monte Carlo method. Journal of the American Statistical Association, 44, 335–341.
NealR. (2011). MCMC using Hamiltonian dynamics. In BrooksS.GelmanA.JonesG. L.MengX.-L. (Eds.), Handbook of Markov chain Monte Carlo (pp. 116–162). Chapman and Hall/CRC, London.
19.
PatilA.HuardD.FonnesbeckC. J. (2010). PyMC: Bayesian stochastic modelling in Python. Journal of Statistical Software, 35, 1–81.
20.
PlummerM. (2003). JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling. In Proceedings of the 3rd international workshop on distributed statistical computing (Vol. 124, p. 125). Technische Universität Wien, Vienna, Austria.
21.
Rabe-HeskethS.SkrondalA.PicklesA. (2005). Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects. Journal of Econometrics, 128, 301–323.
Stan Development Team. (2015). Stan modeling language users guide and reference manual, version 2.6.0[Computer software manual]. Retrieved fromhttp://mc-stan.org/
24.
VanhataloJ.RiihimäkiJ.HartikainenJ.JylänkiP.TolvanenV.VehtariA. (2013). GPstuff: Bayesian modeling with Gaussian proceesses. Journal of Machine Learning Research, 14, 1175–1179.
