Recent efforts to improve the statistical rigor of both developmental and operational testing include recommendations to consider second-order screening designs. In this paper, we provide a broad review of screening designs and second-order screening designs. We then consider a real-world wind tunnel experiment case study from the recent published literature and use subject matter expertise to consider the viability of second-order screening design, a recently developed design called the DSD+, to sufficiently screen important factors in complex, nonlinear systems of interest using just a single experimental design.
WarnerC. Continuing the emphasis on scientific rigor in test and evaluation. DTIC Document, 2011.
2.
GilmoreJM. A statistically rigorous approach to test and evaluation (T&E). ITEA J2013; 34: 225–229.
3.
GilmoreJM. Best practices for assessing the statistical adequacy of experimental designs used in operational test and evaluation. Washington, DC: Operational Test and Evaluation Command, 2013.
4.
HillRRLeggioDACapehartSR. Examining improved experimental designs for wind tunnel testing using Monte Carlo sampling methods. Qual Reliab Eng Int2011; 27: 795–803.
5.
MontgomeryDC. Design and analysis of experiments. eighth edition, John Wiley & Sons Inc., Hoboken, New Jersey2013.
6.
LawsonJ. One-step screening and process optimization experiments. Am Stat2003; 57: 15–20.
7.
JonesBNachtsheimCJ. A class of three-level designs for definitive screening in the presence of second-order effects. J Qual Tech2011; 43: 1–15.
8.
DoughertySASimpsonJRHillRRPignatielloJJ. effect of heredity and sparsity on second order screening design performance. To appear Qual Reliab Eng Int DOI: 10.1002/qre.15952013.
9.
JohnsonRTHuttoGTSimpsonJR. Designed experiments for the defense community. Qual Eng2012; 24: 60–79.
10.
FreemanLJRyanAGKenslerJLK. A tutorial on the planning of experiments. Qual Eng2013; 25: 315–332.
11.
MyersRHMontgomeryDCAnderson-CookCM. Response surface methodology: Process and product optimization using designed experiments, third edition, John Wiley Sons Inc., Hoboken, New Jersey2009.
12.
PlackettRLBurmanJP. The design of optimum multifactorial experiments. Biometrika1946; 33: 305–325.
13.
GutmanAJ. Construction, analysis and data-driven augmentation of supersaturated designs. Air Force Institute of Technology, 2013.
