Effects of Lockdown Drills on Students’ Fear,Perceived Risk,and Use of Avoidance Behaviors: A Quasi-Experimental Study

Abstract

Although widely used in schools across the United States, little is known about the impact of lockdown drills, particularly related to psychological outcomes such as fear, perceived risk, and avoidance. This study utilized survey data collected over 3 timepoints—baseline, after the first lockdown drill, and following training and a second lockdown drill—from more than 10,000 students in a large urban school district. The results indicate that students were less fearful and perceived lower risk after participating in lockdown drills and emergency response training, although reported avoidance behaviors increased. Perceived school safety predicted less fear, risk, and avoidance, while perceived emergency preparedness predicted less fear and avoidance but higher risk. Implications for broader considerations for school administrators and policymakers related to emergency preparedness preparation, including drills and training, are offered with particular focus given to best practices for trauma mitigation.

Keywords

lockdown drills Standard Response Protocol emergency preparedness school safety fear of crime

Get full access to this article

View all access options for this article.

References

Addington

L. A.

(2003). Students’ fear after Columbine: Findings from a randomized experiment. Journal of Quantitative Criminology, 19(4), 367–387. https://doi.org/10.1023/B:JOQC.0000005440.11892.27

Advanced Law Enforcement Rapid Response Training. (n.d.). ALERRT active attack data. https://www.activeattackdata.org/index.html

Allison

(2014, June 13). Listwise deletion: It’s NOT evil. https://statisticalhorizons.com/listwise-deletion-its-not-evil

Alvarez

Bachman

(1997). Predicting the fear of assault at school and while going to and from school in an adolescent population. Violence and Victims, 12(1), 69–85. https://doi.org/10.1891/0886-6708.12.1.69

Aronowitz

N. W.

(2014, February 14). Fake blood and blanks: Schools stage active shooter drills. NBC News. https://www.nbcnews.com/news/us-news/fake-blood-blanks-schools-stage-active-shooter-drills-n28481

Arum

(2003). Judging school discipline: The crisis of moral authority. Harvard University Press.

Astor

R. A.

Noguera

Fergus

Gadsden

Benbenishty

(2021). A call for the conceptual integration of opportunity structures within school safety research. School Psychology Review, 50(2–3), 172–190. https://doi.org/10.1080/2372966X.2020.1854621

Bachman

Randolph

Brown

B. L.

(2011). Predicting perceptions of fear at school and going to and from school for African American and white students: The effects of school security measures. Youth & Society, 43(2), 705–726. https://doi.org/10.1177/0044118X10366674

Bakst

(2015, March 16). A new guide to school emergency response planning is rolled out. New York State School Board Association. https://www.nyssba.org/news/2015/03/12/on-board-online-march-16-2015/a-new-guide-to-school-emergency-response-planning-is-rolled-out/

10.

Balfanz

Byrnes

(2012). The importance of being in school: A report on absenteeism in the nation’s public schools. Johns Hopkins University Center for Social Organization of Schools. https://new.every1graduates.org/the-importance-of-being-in-school/

11.

Barrett

K. L.

Jennings

W. G.

Lynch

M. J.

(2012). The relation between youth fear and avoidance of crime in schools and academic experiences. Journal of School Violence, 11(1), 1–20. https://doi.org/10.1080/15388220.2011.630309

12.

Bartlett

(1954). Significance test for sphericity of a normal n-variate distribution. Journal of the Royal Statistical Society, 16, 296–298.

13.

Blad

Will

(2019, March 24). “I felt more traumatized than trained”: Active-shooter drills take toll on teachers. Education Week. https://www.edweek.org/ew/articles/2019/03/24/i-felt-more-traumatized-than-trained-active-shooter.html

14.

Bouffard

J. A.

Nobles

M. R.

Wells

(2012). Differences across majors in the desire to obtain a license to carry a concealed handgun on campus: Implications for criminal justice education. Journal of Criminal Justice Education, 23(3), 283–306. https://doi.org/10.1080/10511253.2011.610760

15.

Boulton

M. J.

Trueman

Murray

(2008). Associations between peer victimization, fear of future victimization and disrupted concentration on class work among junior school pupils. British Journal of Educational Psychology, 78(3), 473–489. https://doi.org/10.1348/000709908X320471

16.

Brock

S. E.

Nickerson

A. B.

Reeves

M. A.

Conolly

Jimerson

S. R.

Pesce

R. C.

Lazzaro

(2016). School crisis prevention and intervention: The PREPaRE model (2nd ed.). National Association of School Psychologists.

17.

Chatterjee

(2019, June 5). A look at the impact of active shooter drills. National Public Radio. https://www.npr.org/2019/06/05/730057542/a-look-at-the-impact-of-active-shooter-drills

18.

Christakis

(2019, March 13). Active-shooter drills are tragically misguided. The Atlantic. https://www.theatlantic.com/magazine/archive/2019/03/active-shooter-drills-erika-christakis/580426/

19.

Columbia

Clarke

L. S.

Weber

(2019). Keeping our students safe during crisis. Physical Disabilities: Education and Related Services, 38(1), 1–9. https://doi.org/10.14434/pders.v38i1.27970

20.

Comrey

L. A.

Lee

H. B.

(1992). A first course in factor analysis (2nd ed.). Lawrence Erlbaum.

21.

Connell

N. M.

(2018). Fear of crime at school. Youth Violence and Juvenile Justice, 16(2), 124–136. https://doi.org/10.1177/1541204016680407

22.

Cook

Heath

Thompson

R. L.

(2000). A meta-analysis of response rates in web- and internet-based surveys. Educational and Psychological Measurement, 60(6), 821–836. https://doi.org/10.1177/00131640021970934

23.

Cornell

(2015). Our schools are safe: Challenging the misperception that schools are dangerous places. American Journal of Orthopsychiatry, 85(3), 217–220. https://doi.org/0.1037/ort0000064

24.

Cowan

Kuenster

(1996). To sleep with the angels: The story of a fire. Ivan R. Dee.

25.

Dickson

M. J.

Vargo

K. K.

(2017). Training kindergarten students lockdown drill procedures using behavioral skills training. Journal of Applied Behavior Analysis, 50(2), 407–412. https://doi.org/10.1002/jaba.369

26.

Di Nota

P. M.

Huhta

. (2019). Complex motor learning and police training: Applied, cognitive, and clinical perspectives. Frontiers in Psychology, 10, Article 1797. https://doi.org/10.3389/fpsyg.2019.01797

27.

Elsass

H. J.

Schildkraut

Stafford

M. C.

(2016). Studying school shootings: Challenges and considerations for research. American Journal of Criminal Justice, 41(3), 444–464. https://doi.org/10.1007/s12103-015-9311-9

28.

Erwin

(2019). School safety: Mitigation. National Conference of State Legislatures. https://www.ncsl.org/research/education/school-safety-mitigation.aspx

29.

Everytown for Gun Safety. (2020). The impact of school safety drills for active shootings. https://everytownresearch.org/school-safety-drills/

30.

Fearnow

(2019, November 4). Andrew Yang proposes ending school shooter drills as part of presidential campaign platform. Newsweek. https://www.newsweek.com/andrew-yang-end-active-school-shooter-drills-proposal-gun-safety-mass-shooting-education-1469673

31.

Federal Bureau of Investigation. (2019). Active shooter incidents in the United States in 2018. Federal Bureau of Investigation, Department of Justice and the Advanced Law Enforcement Rapid Response Training Center at Texas State University. https://www.fbi.gov/file-repository/active-shooter-incidents-in-the-us-2018-041019.pdf

32.

Federal Emergency Management Agency. (2020). FEMA—Emergency Management Institute (EMI) Course—IS-362.A: Multi-hazard emergency planning for schools. https://training.fema.gov/is/courseoverview.aspx?code=IS-362.a

33.

Ferraro

K. F.

(1995). Fear of crime: Interpreting victimization risk. State University of New York Press.

34.

Ferraro

K. F.

LaGrange

(1987). The measurement of fear of crime. Sociological Inquiry, 57(1), 70–101. https://doi.org/10.1111/j.1475-682X.1987.tb01181.x

35.

Floyd

D. L.

Prentice-Dunn

Rogers

R. W.

(2000). A meta-analysis of research on protection motivation theory. Journal of Applied Social Psychology, 30(2), 407–429. https://doi.org/10.1111/j.1559-1816.2000.tb02323.x

36.

Fox

J. A.

Friedel

E. E.

(2018). The menace of school shootings in America: Panic and overresponse. In Shapiro

(Ed.), The Wiley handbook on violence in education: Forms, factors, and preventions (pp. 15–36). Wiley/Blackwell Publishers.

37.

Garofalo

(1979). Victimization and the fear of crime. Journal of Research in Crime & Delinquency, 16(1), 80–97. https://doi.org/10.1177/002242787901600107

38.

Gerstmann

(2019, September 7). Why schools should end active shooter drills immediately. Forbes. https://www.forbes.com/sites/evangerstmann/2019/09/07/why-schools-should-end-active-shooter-drills-immediately/#3c0563bb2a92

39.

Gubiotti

(2015). Opposing viewpoints: Preparing students, teachers, and the community for school shootings: Saving lives with active shooter simulations. Children’s Legal Rights Journal, 35(3), 254–255. https://lawecommons.luc.edu/cgi/viewcontent.cgi?article=1109&context=clrj

40.

Herron

(2019, March 22). “It hurt so bad”: Indiana teachers shot with plastic pellets during active shooter training. Indy Star. https://www.indystar.com/story/news/politics/2019/03/21/active-shooter-training-for-schools-teachers-shot-with-plastic-pellets/3231103002/

41.

Hindelang

M. J.

Gottfredson

M. R.

Garofalo

(1978). Victims of personal crime: An empirical foundation for a theory of personal victimization. Ballinger Publishing Company.

42.

Hoekstra

Nichols

A. C.

Guntfest

(2014). How K-12 school district and university officials anticipated and responded to 2011 National Weather Service tornado warnings. International Journal of Mass Emergencies and Disasters, 32(2), 353–374. http://ijmed.org/articles/660/download/

43.

Hughes

M. R.

Gaines

J. S.

Pryor

D. W.

(2015). Staying away from school: Adolescents who miss school due to feeling unsafe. Youth Violence & Juvenile Justice, 13(3), 270–290. https://doi.org/10.1177/1541204014538067

44.

Huskey

M. G.

Connell

N. M.

(2021). Preparation or provocation? Student perceptions of active shooter drills. Criminal Justice Policy Review, 32(1), 3–26. https://doi.org/10.1177/0887403419900316

45.

Johnson

V. A.

Johnston

D. M.

Ronan

K. R.

Peace

(2014). Evaluating children’s learning of adaptive response capacities from ShakeOut, an earthquake and tsunami drill in two Washington State school districts. Journal of Homeland Security and Emergency Management, 11(3), 347–373. https://doi.org/10.1515/jhsem-2014-0012

46.

Jonson

C. L.

Moon

M. M.

Gialopsos

B. M.

(2020). Are students scared or prepared? Psychological impacts of a multi-option active assailant protocol compared to other crisis/emergency preparedness practices. Victims & Offenders, 15(5), 639–662. https://doi.org/10.1080/15564886.2020.1753871

47.

Jonson

C. L.

Moon

M. M.

Hendry

J. A.

(2020). One size does not fit all: Traditional lockdown versus multioption responses to school shootings. Journal of School Violence, 19(2), 154–166. https://doi.org/10.1080/15388220.2018.1553719

48.

Kassam-Adams

Kohser

K. L.

McLaughlin

Winston

Marsac

M. L.

(2019). Evaluating the acceptability and validity of assessing pain and posttraumatic stress symptoms in an adaptable eHealth system for school-age children. Clinical Practice in Pediatric Psychology, 7(1), 9–19. https://doi.org/10.1037/cpp0000261

49.

Keyes

J. M.

(2020, February). The standard reunification method. Presentation conducted at the Winter Briefings, the I Love U Guys Foundation, Wheat Ridge, CO, United States.

50.

Keyes

J. M.

Deffner

(2015). The Standard Response Protocol K-12: Operational guidance for schools, districts, departments and agencies. I Love U Guys Foundation. https://iloveuguys.org/downloads/SRP-K12-2021-Operational-Guidance-V4.0.pdf

51.

Kutsyuruba

Klinger

D. A.

Hussain

(2015). Relationships among school climate, school safety, and student achievement and well-being: A review of the literature. Review of Education, 3(2), 103–135. https://doi.org/10.1002/rev3.3043

52.

Lambert

E. G.

(2004). Assessing the crime and punishment views of criminal justice majors: How are they different from other majors? Criminal Justice Studies, 17(3), 245–257. https://doi.org/10.1080/1478601042000281097

53.

Little

R. J. A.

Rubin

D. B.

(2002). Statistical analysis with missing data (2nd ed.). Wiley.

54.

Liu

Lee

Gershenson

(2019). The short- and long-run impacts of secondary school absences (IZA DP No. 12613). https://www.econstor.eu/bitstream/10419/207438/1/dp12613.pdf

55.

Martaindale

M. H.

Sandel

W. L.

Blair

J. P.

(2017). Active-shooter events in the workplace: Findings and policy implications. Journal of Business Continuity & Emergency Planning, 11(1), 6–20. https://www.ingentaconnect.com/content/hsp/jbcep/2017/00000011/00000001/art00002

56.

May

D. C.

(2001). The effect of fear of sexual victimization on adolescent fear of crime. Sociological Spectrum, 21(2), 141–174. https://doi.org/10.1080/02732170119080

57.

May

D. C.

Dunaway

R. G.

(2000). Predictors of fear of criminal victimization at school among adolescents. Sociological Spectrum, 20(2), 149–168. https://doi.org/10.1080/027321700279938

58.

Musu

Zhang

Wang

Zhang

Oudekerk

B. A.

(2019). Indicators of school crime safety: 2018. U.S. Department of Education and U.S. Department of Justice. https://nces.ed.gov/pubs2019/2019047.pdf

59.

National Association of School Psychologists. (2018). Mitigating negative psychological effects of school lockdowns: Brief guidance for schools. https://www.nasponline.org/assets/Documents/Resources%20and%20Publications/Resources/Crisis/Mitigating_Psychological_Effects_of_Lockdowns.pdf

60.

National Association of School Psychologists. (2021). Best practice considerations armed assailant drills in schools. https://www.nasponline.org/resources-and-publications/resources-and-podcasts/school-climate-safety-and-crisis/systems-level-prevention/best-practice-considerations-for-armed-assailant-drills-in-schools

61.

National Child Traumatic Stress Network. (2018). Creating school active shooter/intruder drills [Brief]. https://www.nctsn.org/sites/default/files/resources/fact-sheet/creating_school_active_shooter_intruder_drills.pdf

62.

Nickerson

A. B.

Schildkraut

(2021). State anxiety prior to and after participating in lockdown drills among students in a rural high school. School Psychology Review. Advance online publication. https://doi.org/10.1080/2372966X.2021.1875790

63.

Pane

L. M.

(2018, May 22). Mass shootings mostly happen in small-town America. South Florida Sun Sentinel. https://www.sun-sentinel.com/news/nationworld/fl-reg-mass-school-shootings-towns-20180522-story.html

64.

Patton

D. U.

Woolley

M. E.

Hong

J. S.

(2012). Exposure to violence, student fear, and low academic achievement: African American males in the critical transition to high school. Children and Youth Services Review, 34(2), 388–395. https://doi.org/10.1016/j.childyouth.2011.11.009

65.

Payne

B. K.

Reidel

(2002). Gun control attitudes and the criminal justice student: Do differences exist? College Student Journal, 36(2), 314–322.

66.

Pierpoint

(2019, March 31). US school shootings: Have drills gone too far? BBC News. https://www.bbc.com/news/uk-47711020

67.

Poland

(2016). Keep schools safe: Planning plays a key role in preventing school violence. American School Board Journal, 203(4), 24–25. https://psychology.nova.edu/news-events/SchoolBoardJournalKeepingSchoolsSafe.pdf

68.

Randa

Wilcox

(2010). School disorder, victimization, and general v. Place-specific student avoidance. Journal of Criminal Justice, 38(5), 854–861. https://doi.org/10.1016/j.jcrimjus.2010.05.009

69.

Randa

Wilcox

(2012). Avoidance at school: Further specifying the influence of disorder, victimization, and fear. Youth Violence & Juvenile Justice, 10(2), 190–204. https://doi.org/10.1177/1541204011423765

70.

Rich

Cox

J. W.

(2018, December 26). What if someone was shooting? The Washington Post. https://www.washingtonpost.com/graphics/2018/local/school-lockdowns-in-america/

71.

Richter

(2019, October 1). Shotgun blanks to be shot inside school today as part of a drill. Dayton Daily News. https://www.daytondailynews.com/news/shotgun-blanks-shot-inside-school-today-part-drill/YzcCV3bXeJA3tM35oZyIHL/

72.

Rountree

P. W.

Land

K. C.

(1996). Perceived risk versus fear of crime: Empirical evidence of conceptually distinct reactions in survey data. Social Forces, 74(4), 1353–1376. https://doi.org/10.1093/sf/74.4.1353

73.

Rubin

D. B.

(1976). Inference and missing data. Biometrika, 63(3), 581–592. https://doi.org/10.1093/biomet/63.3.581

74.

Rygg

(2015). School shooting simulations: At what point does preparation become more harmful than helpful? Children's Legal Rights Journal, 35(3), 215–228. https://lawecommons.luc.edu/cgi/viewcontent.cgi?article=1106&context=clrj

75.

Sandy Hook Advisory Commission. (2015). Final report of the Sandy Hook Advisory Commission. http://www.governor.ct.gov/malloy/lib/malloy/SHAC_Doc_2015.02.13_draft_version_of_final_report.pdf

76.

Schell

(2019, December 18). Ohio active shooter drill goes awry, results in injuries, “chaos.” Fox 19. https://www.fox19.com/2019/12/19/new-richmond-middle-school-armed-shooter-drill-goes-awry-results-injuries-chaos/?outputType=amp

77.

Schildkraut

(2021). Can mass shootings be stopped? To address the problem, we must better understand the phenomenon [Policy brief]. https://rockinst.org/wp-content/uploads/2021/07/Public-Mass-Shootings-Brief.pdf

78.

Schildkraut

Muschert

G. W.

(2019). Columbine, 20 years later and beyond: Lessons from tragedy. Praeger.

79.

Schildkraut

Nickerson

A. B.

(2020). Ready to respond: Effects of lockdown drills and training on school emergency preparedness. Victims & Offenders, 15(5), 619–638. https://doi.org/10.1080/15564886.2020.1749199

80.

Schildkraut

Nickerson

A. B.

Ristoff

(2020). Locks, lights, out of sight: Assessing students’ perceptions of emergency preparedness across multiple lockdown drills. Journal of School Violence, 19(1), 93–106. https://doi.org/10.1080/15388220.2019.170372

81.

Schonfeld

D. J.

Meltzer-Lange

Hashikawa

A. N.

Gorski

P. A.

American Academy of Pediatrics Council on Children and Disasters, Council on Injury, Violence, and Poison Prevention, Council on School Health. (2020). Participation of children and adolescents in live crisis drills and exercises. Pediatrics, 146(3), Article e2020015503. https://doi.org/10.1542/peds.2020-015503

82.

Schreck

C. J.

Miller

J. M.

(2003). Sources of fear of crime in school: What is the relative contribution of disorder, individual characteristics, and school security? Journal of School Violence, 2(4), 57–79. https://doi.org/10.1300/J202v02n04_04

83.

Shusterman

(2011). Muscle memory and the somaesthetic pathologies of everyday life. Human Movement, 12(1), 4–15. https://doi.org/10.2478/v10038-011-0001-2

84.

Simpson

D. M.

(2002). Earthquake drills and simulations in community-based training and preparedness programmes. Disasters, 26(1), 55–69. https://doi.org/10.1111/1467-7717.00191

85.

Skogan

W. G.

Maxfield

M. G.

(1981). Coping with crime: Individual and neighborhood reactions. SAGE.

86.

Swartz

Reyns

B. W.

Henson

Wilcox

(2011). Fear of in-school victimization: Contextual, gendered, and developmental considerations. Youth Violence & Juvenile Justice, 9(1), 59–78. https://doi.org/10.1177/1541204010374606

87.

Tabachnick

B. G.

Fidell

L. S.

(2007). Using multivariate statistics (5th ed.). Allyn & Bacon.

88.

Tavakol

Dennick

(2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2(1), 53–55. http://doi.org/10.5116/ijme.4dfb.8dfd

89.

Texas School Safety Center. (n.d.). K-12 Standard Response Protocol toolkit: 2.2 Lockdown. https://txssc.txstate.edu/tools/srp-toolkit/lockdown

90.

Tillyer

M. S.

Fisher

B. S.

Wilcox

(2011). The effects of school crime prevention on students’ violent victimization, risk perception, and fear of crime: A multilevel opportunity perspective. Justice Quarterly, 28(2), 249–277. https://doi.org/10.1080/07418825.2010.493526

91.

U.S. Department of Education. (2013). Guide for developing high-quality school emergency operations plans. https://rems.ed.gov/docs/REMS_K-12_Guide_508.pdf

92.

U.S. Department of Homeland Security. (2008). Active shooter, how to respond. https://www.dhs.gov/xlibrary/assets/active_shooter_booklet.pdf

93.

U.S. Department of Homeland Security. (2015). FEMA incident action planning guide. https://www.fema.gov/sites/default/files/2020-07/Incident_Action_Planning_Guide_Revision1_august2015.pdf

94.

U.S. Department of Homeland Security. (2020). Homeland Security Exercise and Evaluation Program (HSEEP). https://www.fema.gov/emergency-managers/national-preparedness/exercises/hseep

95.

U.S. Government Accountability Office. (2007). Most school districts have developed emergency management plans, but would benefit from additional federal guidance. https://www.gao.gov/assets/270/261878.pdf

96.

Virginia Tech Review Panel. (2007). Mass shootings at Virginia Tech: Report of the review panel. https://scholar.lib.vt.edu/prevail/docs/VTReviewPanelReport.pdf

97.

Warr

(1984). Fear of victimization: Why are women and the elderly more afraid? Social Science Quarterly, 65(3), 681–702.

98.

Warr

(2000). Fear of crime in the United States: Avenues for research and policy. In Duffee

(Ed.), Criminal justice 2000, Measurement and analysis of crime and justice (Vol. 4, pp. 451–489). National Institute of Justice.

99.

Warr

Stafford

(1983). Fear of victimization: A look at the proximate causes. Social Forces, 61(4), 1033–1043. https://doi.org/10.1093/sf/61.4.1033

100.

Wilcox

May

D. C.

Roberts

S. D.

(2006). Student weapon possession and the “fear and victimization hypothesis”: Unraveling the temporal order. Justice Quarterly, 23(4), 502–529. https://doi.org/10.1080/07418820600985362

101.

Yang

(n.d.). End active shooter drills—Yang2020—Andrew Yang for president. https://www.yang2020.com/policies/end-active-shooter-drills/

102.

Zhe

E. J.

Nickerson

A. B.

(2007). Effects of an intruder drill on children’s knowledge, anxiety, and perceptions of school safety. School Psychology Review, 36(3), 501–508. https://doi.org/10.1080/02796015.2007.12087936

103.

Zraick

(2019, March 22). Indiana teachers were shot with pellets during active shooter drill, union says. The New York Times. https://www.nytimes.com/2019/03/22/us/indiana-teachers-shot.html