Objective: This research is designed to examine demographic differences between the ACTIVE sample and the larger, nationally representative Health and Retirement Study (HRS) sample. Method: After describing some relevant demographics (age, education, sex, and race/ethnicity), we use three statistical methods to determine sample differences—logistic regression modeling (LRM), decision tree analysis (DTA), and post-stratification and raking methods. When some differences are found, we create sample weights that other researchers can use to adjust these differences. Results: The ACTIVE sample is younger, more likely to be female, Black, and more highly educated than the HRS sample. Sample weights were created. Discussion: By using the resulting sample weights, all results of ACTIVE analyses can be said to be nationally representative based on HRS demographics.
BallK.BerchD. B.HelmersK. F.JobeJ. B.LeveckM. D.MarsiskeWillisS. L. (2002). Effects of cognitive training interventions with older adults: A randomized controlled trial. Journal of the American Medical Association, 288, 2271-2281.
2.
BreimanL.FriedmanJ.OlshenR.StoneC. (1984). Classification and regression trees. Pacific Grove, CA: Wadsworth and Brooks/Cole.
3.
ColeS. R.HernanM. A. (2008). Constructing inverse probability weights for marginal structural models. American Journal of Epidemiology, 168, 656-664.
4.
DevilleJ. C.SarndalC. E.SautoryO. (1993). Generalized raking procedures in survey sampling. Journal of the American Statistical Association, 88, 1013-1020.
5.
HauserR. M.WillisR. J. (2005). Survey design and methodology in the health and retirement study and the Wisconsin longitudinal study. In WaiteL. J. (Ed.), Aging, health, and public policy: Demographic and economic perspectives (pp. 209-235). New York, NY: Population Council.
6.
HoltD.SmithT. M. F. (1979). Post stratification. Journal of the Royal Statistical Society. Series A, 142, 33-46.
7.
HornJ. L. (1967). On subjectivity in factor analysis. Educational and Psychological Measurement, 27, 811-820.
8.
HosmerD. W.LemeshowS. (1989). Applied logistic regression. New York, NY: Wiley.
9.
HothornT.HornikK.ZeileisA. (2006). Unbiased recursive partitioning: A conditional inference framework. Journal of Computational and Graphical Statistics, 17, 492-514.
10.
JobeJ. B.SmithD. M.BallK.TennstedtS. L.MarsiskeM.WillisS. L.KleinmanK. (2001). ACTIVE: A cognitive intervention trial to promote independence in older adults. Controlled Clinical Trials, 22, 453-479.
11.
JusterT.SuzmanR. (1995). Overview of the health and retirement study. Journal of Human Resources, 30, S7-56.
12.
KaufmanA. S.KaufmanJ. C.LiuX.JohnsonC. K. (2009). How do educational attainment and gender relate to fluid intelligence, crystallized intelligence, and academic skills at ages 22-90 years?Archives of Clinical Neuropsychology, 24, 153-163.
13.
KishL. (1995). Methods for design effects. Journal of Official Statistics, 11, 55-77.
14.
LittleR. J. A. (1993). Post-stratification: A modeler’s perspective. Journal of the American Statistical Association, 88, 1001-1012.
15.
McArdleJ. J. (2011). Exploratory data mining using CART in the behavioral science. In CooperH.PanterA. (Eds.), Handbook of methodology in the behavioral sciences (pp. 405-421). Washington, DC: APA Books.
16.
McArdleJ. J. (2013). Dealing with longitudinal attrition using logistic regression and decision tree analyses. In McArdleJ. J.RitschardG. (Eds.), Contemporary issues in exploratory data mining in the behavioral sciences (pp. 282-311). New York, NY: Taylor & Francis.
17.
McArdleJ. J.Ferrer-CajaE.HamagamiF.WoodcockR. W. (2002). Comparative longitudinal structural analyses of the growth and decline of multiple intellectual abilities over the life span. Developmental Psychology, 38, 115-142.
18.
McArdleJ. J.FisherG. G.KadlecK. M. (2007). Latent variable analyses of age trends of cognition in the Health and Retirement Study, 1992-2004. Psychology and Aging, 22, 525-545.
19.
McArdleJ. J.HamagamiF. (1994). Logit and multilevel logit modeling studies of college graduation for 1984-85 freshman student athletes. Journal of American Statistical Association, 89, 1107-1123.
20.
McArdleJ. J.PrindleJ. J. (2008). A latent change score analysis of a randomized clinical trial in reasoning training. Psychology and Aging, 23, 702-719.
21.
PuhaniP. A. (2000). The Heckman correction for sample selection and its critique. Journal of Economic Surveys, 14, 53-68.
22.
R Core Team. (2013). R: A language and environment for statistical computing (ISBN 3-900051-07-0). Vienna, Austria: R Foundation for Statistical Computing. Available from http://www.R-project.org/
23.
RebokG. W.CarlsonM. C.LangbaumJ. B. (2007). Training and maintaining memory abilities in healthy older adults: Traditional and novel approaches. Journals of Gerontology. Series B, Psychological Sciences and Social Sciences, 62(Spec. No. 1), 53-61.
24.
SchaieK. W.WillisS. L. (1993). Age difference patterns of psychometric intelligence in adulthood: Generalizability within and across ability domains. Psychology and Aging, 8, 44-55.
25.
StapletonL. M. (2002). The incorporation of sample weights into multilevel structural equation models. Structural Equation Modeling, 9, 475-502.
26.
StroblC.MalleyJ.TutzG. (2009). An introduction to recursive partitioning: Rationale, application, and characteristics of classification and regression trees, bagging, and random forests. Psychological Methods, 14, 323-348.
27.
TherneauT.AtkinsonB.RipleyB. (2012). rpart: Recursive partitioning (R package version 4.1-0).
28.
WillisS. L.TennstedtS. L.MarsiskeM.BallK.EliasJ.KoepkeK. M.WrigntE. (2006). Long-term effects of cognitive training on everyday functional outcomes in older adults. Journal of the American Medical Association, 296, 2805-2814.
29.
ZimprichD.MartinM. (2002). Can longitudinal changes in processing speed explain longitudinal age changes in fluid intelligence?Psychology and Aging, 17, 690-695.
