Video data analysis (VDA) represents an important methodological framework for contemporary research approaches to the myriad of footage available from cameras, devices, and phones. Footage from police body-worn cameras (BWCs) is anticipated to be a widely available platform for social science researchers to scrutinize the interactions between police and citizens. We examine issues of validity and reliability as related to BWCs in the context of VDA, based on an assessment of the quality of audio and video obtained from that platform. Second, we compare the coding of BWC footage obtained from a sample of police-citizen encounters to coding of the same events by on-scene coders using an instrument adapted from in-person systematic social observations (SSOs). Findings show that there are substantial and systematic audio and video gaps present in BWC footage as a source of data for social science investigation that likely impact the reliability of measures. Despite these problems, BWC data have substantial capacity for judging sequential developments, causal ordering, and the duration of events. Thus, the technology should open theoretical frames that are too cumbersome for in-person observation. Theoretical development with VDA in mind is suggested as an important pathway for future researchers in terms of framing data collection from BWCs and also suggesting areas where triangulation is essential.
AviezerHillelTropeYaacovTodorovAlexander. 2012. “Body Cues, Not Facial Expressions, Discriminate Between Intense Positive and Negative Emotions.” Science (New York, N.Y.)338(6111):1225‐9. doi: 10.1126/science.1224313.
2.
BoivinRemiGendronAnnieFaubertCamillePoulinBruno. 2017. “The Body-worn Camera Perspective Bias.” Journal of Experimental Criminology13(1):125‐42. doi: 10.1007/s11292-016-9270-2.
DaiMengyan.2021. “Training Police for Procedural Justice: an Evaluation of Officer Attitudes, Citizen Attitudes, and Police-Citizen Interactions.” The Police Journal94(4):481‐495. doi: 10.1177/0032258X20960791.
5.
FriisCamilla BankSuonperä LiebstLassePhilpotRichardLindegaardMarie Rosenkrantz. 2020. “Ticket Inspectors in Action: body-Worn Camera Analysis of Aggressive and Nonaggressive Passenger Encounters.” Psychology of Violence10(5):483‐92. doi: 10.1037/vio0000276.
6.
GrimshawAllen D.1982. “Sound-Image Data Records for Research on Social Interaction: some Questions and Answers.” Sociological Methods & Research11(2):121‐44. doi: 10.1177/0049124182011002002.
7.
GwetKilem L.2014. Handbook of Inter-Rater Reliability (4th ed.): The Definitive Guide to Measuring the Extent of Agreement Among Raters. Gaithersburg, MD: Advanced Analytics Press.
8.
GwetKilem L.2021. Handbook of Inter-Rater Reliability (5th ed.), Volume I: Analysis of Categorical Ratings. Gaithersburg, MD: AgreeStat Analytics.
9.
HolladayBeau P.MakinDavid A.. 2021. “Baselining Incivility in One-on-One Police Encounters from BWC Archival Footage: Exploratory Study of Race, Gender and Contact Type Effects.” Police Practice and Research22(6):1618‐36. doi: 10.1080/15614263.2021.1914040.
KleinDaniel.2018. “Implementing a General Framework for Assessing Interrater Agreement in Stata.” Stata Journal18(4):871‐901.
12.
LandisJ. RichardKochGary G.. 1977. “The Measurement of Observer Agreement for Categorical Data.” Biometrics33(1):159‐74. doi: 10.2307/2529310.
13.
LumCynthiaKoperChristopherMerolaLindaSchererAmberReiouxAmanda. 2015. Existing and Ongoing Body Worn Camera Research: Knowledge Gaps and Opportunities. (Report for the Laura and John Arnold Foundation). Fairfax, VA: Center for Evidence-Based Crime Policy, George Mason University.
14.
MakinDavid A.WillitsDale W.BrooksRachael. 2020. “Systematic Social Event Modeling: A Methodology for Analyzing Body-Worn Camera Footage.” International Journal of Social Research Methodology24(2):163‐76. doi: 10.1080/13645579.2020.1766775.
15.
MakinDavid A.WillitsDale W.KoslickiWendyBrooksRachaelDietrichBryce J.BaileyRachel L.. 2019. “Contextual Determinants of Observed Negative Emotional States in Police–Community Interactions.” Criminal Justice and Behavior46(2):301‐18. doi: 10.1177/0093854818796059.
16.
MastrofskiStephen D.ParksRoger B.ReissAlbert J. Jr.WordenRobert E.DeJongChristinaSnipesJeffrey B.TerrillWilliam. 1998. Systematic Observation of Public Police: Applying Field Research Methods to Policy Issues. NCJ 172859. Retrieved from:https://www.ojp.gov/pdffiles/172859.pdf.
17.
MateescuAlexandraRosenblatAlexBoydDanah. 2016. “Dreams of Accountability, Guaranteed Surveillance: The Promises and Costs of Body-Worn Cameras.” Surveillance & Society14(1):122‐27.
18.
McCluskeyJohn D.UchidaCraig D.SolomonShellie E.WooditchAleseConnorChristineRevierLauren. 2019. “Assessing the Effects of Body-Worn Cameras on Procedural Justice in the Los Angeles Police Department.” Criminology; An Interdisciplinary Journal57(2):208‐36. doi: 10.1111/1745-9125.12201.
19.
MellShana M.2016. “The Role of Procedural Justice within Police-Citizen Contacts in Explaining Citizen Behaviors and Other Outcomes.” PhD dissertation, Department of Public Policy & Administration, Virginia Commonwealth University.
20.
NassauerAnneLegewieNicolas M.. 2019. “Analyzing 21st Century Video Data on Situational Dynamics—Issues and Challenges in Video Data Analysis.” Social Sciences8(3):100.
21.
NassauerAnneLegewieNicolas M.. 2021. “Video Data Analysis: A Methodological Frame for a Novel Research Trend.” Sociological Methods & Research50(1):135‐74. doi: 10.1177/0049124118769093.
22.
NassauerAnneLegewieNicolas M.. 2022. Video Data Analysis: How to Use 21st Century Video in the Social Sciences. Thousand Oaks, CA: Sage.
23.
NawazArifTankebeJustice. 2018. “Tracking Procedural Justice in Stop and Search Encounters: Coding Evidence from Body-Worn Video Cameras.” Cambridge Journal of Evidence-Based Policing2(3):139‐63. doi: 10.1007/s41887-018-0029-z.
24.
PollockWendiScottSarahMooreEric. 2021. “Using Problem-Oriented Policing to Address Police Problems Through the Study of Body-worn Camera Footage.” The Police Journal94(2):166‐83.
25.
President’s Task Force on 21st Century Policing. 2015. Final Report of the President’s Task Force on 21st Century Policing. Office of Community Oriented Policing Services, U.S. Department of Justice: Washington, DC.
SolomonShellie E.ConnorChristineSchmitzJennifer. 2021 “Chapter 6. Managing Digital Evidence: The South Florida Collaboration.” Pp. 52–67 in Managing Digital Evidence from Body-Worn Cameras: Case Studies in Seven Sites, edited by UchidaCraig D., et al., Washington, D.C: Bureau of Justice Assistance. https://bwctta.com/sites/default/files/2022-03/1%20DEM%20Final%20Report%2003%2001%2022_CONTENT_0.pdf.
30.
SpanoRichard.2007. “How Does Reactivity Affect Police Behavior? Describing and Quantifying the Impact of Reactivity as Behavioral Change in a Large-Scale Observational Study of Police.” Journal of Criminal Justice35(4):453‐65.
31.
SussJoelRaushelAlexisArmijoAdamWhiteBrian. 2018. “Design Considerations in the Proliferation of Police Body-Worn Cameras.” Ergonomics in Design26(3):17‐22.
32.
SytsmaVictoria A.ChillarVijay F.PizaEric L.. 2021. “Scripting Police Escalation of Use of Force Through Conjunctive Analysis of Body-Worn Camera Footage: A Systematic Social Observational Pilot Study.” Journal of Criminal Justice74:101776. doi: 10.1016/j.jcrimjus.2020.101776.
33.
TerrillWilliam.2003. “Police Use of Force and Suspect Resistance: The Micro Process of the Police-Suspect Encounter.” Police Quarterly6(1):51‐83. doi: 10.1177/1098611102250584.
34.
TerrillWilliamZimmermanLaura. 2022. “Police Use of Force Escalation and De-Escalation: The Use of Systematic Social Observation with Video Footage.” Police Quarterly. doi: 10.1177/10986111211049145.
UchidaCraig D.McCluskeyJohnKringenJonathanKringenAnne LiKatoSeanMelendezHeleanaSchmitzJennifer. 2022. “Police Accounts of Critical Incidents: A Descriptive and Empirical Assessment.” Journal of Crime and Justice. Published online at: https://doi.org/10.1080/0735648X.2022.2080100.
37.
VoigtRobCampNicholas P.PrabhakaranVinodkumarHamiltonWilliam L.HeteyRebecca C.GriffithsCamilla M.JurgensDavidJurafskyDanEberhardtJennifer L.. 2017. “Language from Police Body Camera Footage Shows Racial Disparities in Officer Respect.” Proceedings of the National Academy of Sciences114(25):6521‐6. doi:10.1073/pnas.1702413114.
38.
WhiteMichael D.MalmAili. 2020. Cops, Cameras, and Crisis: The Potential and the Perils of Police Body-Worn Cameras. New York: New York University Press.
39.
WillitsDale W.MakinDavid A.. 2018. “Show Me What Happened: Analyzing Use of Force Through Analysis of Body-Worn Camera Footage.” Journal of Research in Crime and Delinquency55(1):51‐77.
40.
WordenRobert E.McLeanSarah J.BonnerHeidi S.. 2015 “You Can Observe a Lot by Watching: Contributions of Systematic Social Observation to Our Understanding of the Police.” Pp. 46‐73 in Critical Issues in Policing: Contemporary Readings, Seventh Edition, edited by DunhamR. G.AlpertG. P.. Long Grove, IL: Waveland Press, Inc.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
