Restricted accessResearch articleFirst published online 2024-11
Fine-tuned Parallel Piecewise Sequential Confidence Region and Point Estimation Strategies for the Regression Parameters in a Linear Model: Big Data Context
We introduced in our previous paper, fine-tuned parallel piecewise sequential sampling strategies for estimating the mean of a normal population. In this paper, we continue our explorations of sequential experimental designs for statistical inference in the context of big data. We develop fine-tuned parallel piecewise sequential methodologies for estimating the regression parameters in a linear model. Our proposed approaches achieve asymptotic unbiasedness of the stopping variable estimating the optimal fixed-sample size in addition to the operational efficiency with substantial time-savings when it comes to big data as a result of the parallel processing. We present a number of interesting illustrations of the theories and methodologies based on large-scale data analyses from simulated data as well as real data from a health study.
MukhopadhyayN and ZhangC.Fine-tuned parallel piecewise sequential confidence interval and point estimation strategies for the mean of a normal population: big data context. In:StelandA and TsuiK-L(eds)Artificial intelligence, big data and sata science in statistics: challenges and solutions in environmetrics, the natural sciences and technology. Invited chapter on Methodologies and Theoretical Studies, Switzerland:Springer Nature, 2022, pp. 51–84.
2.
MukhopadhyayN and ZhangC.EDA on the asymptotic normality of the standardized sequential stopping times, part-I: parametric models. Seq Anal2018; 37:342–374.
3.
MukhopadhyayN and ZhangC.EDA on the asymptotic normality of the standardized sequential stopping times, part-II: distribution-free models. Seq Anal2020; 39:367–398.
4.
MukhopadhyayN and SenPK.Replicated piecewise stopping numbers and sequential analysis. Seq Anal1993; 12: 179–197.
5.
MukhopadhyayN and AbidA.On fixed-size confidence regions for the regression parameters. Metron1986; 44: 297–306.
6.
GleserLJ.On the asymptotic theory of fixed-size sequential confidence bounds for linear regression parameters. Ann Math Statist1965; 36: 463–467. Corrections: 1966; Ann Math Statist 37: 1053–1055.
7.
AlbertA.Fixed size confidence ellipsoids for linear regression parameters. Ann Math Statist1966; 37: 16021630.
8.
SrivastavaMS.On fixed width confidence bounds for regression parameters and mean vector. J Roy Statist Soc, Ser B1967; 29: 132–140.
9.
SrivastavaMS.On fixed-width confidence bounds for regression parameters. Ann Math Statist1971; 42: 1403–1411.
10.
FinsterM.A frequentist approach to sequential estimation in the general linear model. J Am Statist Assoc1983; 78: 403–407.
11.
FinsterM.Estimation in the general linear model when the accuracy is specified before data collection. Ann Statist1985; 13: 663–675.
12.
MukhopadhyayN and de SilvaBM.Sequential methods and their applications. Boca Raton: Chapman & Hall/CRC, 2009.
13.
ChatterjeeSK.Sequential inference procedures of Stein's type for a class of multivariate regression problems. Ann Math Statist1962; 33: 1039–1064.
14.
ChatterjeeSK.Two-stage and multistage procedures. In:GhoshBK and SenPK(eds)Handbook of sequential analysis. New York: Dekker, 1991, pp. 21–45.
15.
GhoshBK and SenPK.Handbook of sequential analysis. New York: Dekker, 1991.
16.
SinhaBimal K.Multivariate problems. In:GhoshBK and SenPK(eds)Handbook of sequential analysis. New York:Dekker, 1991, pp. 199–227.
17.
MukhopadhyayN.Sequential estimation of regression parameters in Gauss-Markoff setup. J Ind Statist Assoc1974; 12: 39–43.
18.
WoodroofeM.Second-order approximations for sequential point and interval estimation. Ann Statist1977; 5: 984–995.
19.
WoodroofeM.Nonlinear renewal theory in sequential analysis. CBMS #39. Philadelphia:SIAM, 1982.
20.
LaiTL and SiegmundD.A nonlinear renewal theory with applications to sequential analysis I. Ann Statist1977; 5: 946–954.
21.
LaiTL and SiegmundD.A nonlinear renewal theory with applications to sequential analysis II. Ann Statist1979; 7: 60–76.
22.
Wikipedia link. https://en.wikipedia.org/wiki/Computational_complexity_of_mathematical_operations#Matrix_algebra(2020, accessed 4 June 2024).
23.
MATLAB.An expert's answer from MATLAB. https://www.mathworks.com/matlabcentral/answers/348944can-you-give-me-a-mathematical-estimation-about-the-algorithm-complexity-of-matrix-multiplication-an(2017, accessed 4 June 2024).
24.
BehnkeAR and WilmoreJH.Evaluation and regulation of body build and composition. Englewood Cliffs: Prentice-Hall, 1974.
25.
StelandA and ChangY-T.High-confidence nonparametric fixed-width uncertainty intervals and applications to projected high-dimensional data and common mean estimation. Seq Anal2021; 40: 97–124.
