The Effect of Civilian Oversight on Police Organizational Performance: A Quasi-Experimental Study

Abstract

Although civilian oversight has been introduced to make the police accountable to citizens and perform better, its effectiveness has not been thoroughly investigated yet. To better understand civilian oversight of the police, this study explores its theoretical basis as an accountability mechanism and suggests how it holds police agencies accountable even without direct disciplinary authority. The data from Law Enforcement Management and Administrative Statistics (LEMAS) survey, the Uniform Crime Report (UCR) program, and the Fatal Encounters (FE) database are analyzed to estimate the effect of civilian oversight on police organizational performance, using a propensity score matching analysis. Among the dependent variables included in the analysis as performance indicators, civilian oversight turns out to have a significant influence only on police agencies’ clearance rates. The police agencies with civilian oversight have lower clearance rates by 2.71 percentage points on average compared to those without civilian oversight. The implications of civilian oversight's negative impact on police organizational performance are further discussed.

Keywords

civilian oversight accountability performance administrative procedures citizen participation propensity score matching

Get full access to this article

View all access options for this article.

References

Ali

M. U.

Nicholson-Crotty

(2021). Examining the accountability-performance link: The case of citizen oversight of police. Public Performance & Management Review, 44(3), 523–559. https://doi.org/10.1080/15309576.2020.1806086

Ali

M. U.

Pirog

(2019). Social accountability and institutional change: The case of citizen oversight of police. Public Administration Review, 79(3), 411–426. https://doi.org/10.1111/puar.13055

Alpert

G. P.

Cawthray

Rojek

Ferdik

F. V.

(2016). Citizen oversight in the United States and Canada: Applying outcome measures and evidence-based concepts. In Prenzler

Heyer

(Eds.), Civilian oversight of police: Advancing accountability in law enforcement (pp. 179–204). CRC Press.

Ashforth

B. E.

Mael

(1989). Social identity theory and the organization. Academy of Management Review, 14(1), 20–39. https://doi.org/10.5465/amr.1989.4278999

Attard

Olson

(2013). Overview of civilian oversight of law enforcement in the United States . http://nacole.org/wp-content/uploads/Oversight-in-the-United-States-Attard-and-Olson-2013.pdf

Austin

P. C.

(2011). An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behavioral Research, 46(3), 399–424. https://doi.org/10.1080/00273171.2011.568786

Bovens

(2007). Analysing and assessing accountability: A conceptual framework. European Law Journal, 13(4), 447–468. https://doi.org/10.1111/j.1468-0386.2007.00378.x

Bovens

(2010). Two concepts of accountability: Accountability as a virtue and as a mechanism. West European Politics, 33(5), 946–967. https://doi.org/10.1080/01402382.2010.486119

Bureau of Justice Statistics. (2016). Law Enforcement Management and Administrative Statistics (LEMAS), 2016. Inter-university Consortium for Political and Social Research.

10.

Caliendo

Kopeinig

(2008). Some practical guidance for the implementation of propensity score matching. Journal of Economic Surveys, 22(1), 31–72. https://doi.org/10.1111/j.1467-6419.2007.00527.x

11.

Clarke

(2009). Arrested oversight: A comparative analysis and case study of how civilian oversight of the police should function and how it fails. Columbia Journal of Law and Social Problems, 43(1), 1–49. https://www.proquest.com/scholarlyjournals/ arrested-oversight-comparative-analysis-case/docview/2003018148/se-2?accountid=14166

12.

Day

Klein

(1987). Accountabilities: Five public services. Tavistock.

13.

De Angelis

(2009). Assessing the impact of oversight and procedural justice on the attitudes of individuals who file police complaints. Police Quarterly, 12(2), 214–236. https://doi.org/10.1177/1098611109332425

14.

De Angelis

Rosenthal

Buchner

(2016). Civilian oversight of law enforcement: Assessing the evidence. U.S. Department of Justice, Office of Justice Programs Diagnostic Center.

15.

Dehejia

R. H.

Wahba

(2002). Propensity score-matching methods for nonexperimental causal studies. Review of Economics and Statistics, 84(1), 151–161. https://doi.org/10.1162/003465302317331982

16.

Demerouti

Bakker

A. B.

Nachreiner

Schaufeli

W. B.

(2001). The job demands-resources model of burnout. Journal of Applied Psychology, 86(3), 499–512. https://doi.org/10.1037/0021-9010.86.3.499

17.

EPA. (1999). EPA’s Framework for Community-Based Environmental Protection.

18.

EPA. (2003). Evaluation of Community-Based Environmental Protection Projects: Accomplishments and Lessons Learned.

19.

FBI. (2016a). Uniform crime reporting program data: Arrests by age, sex, and race, summarized yearly, 2016. Inter-university Consortium for Political and Social Research.

20.

FBI. (2016b). Uniform crime reporting program data: Offenses known and clearances by arrest, 2016. Inter-university Consortium for Political and Social Research.

21.

FBI. (2016c). Uniform crime reporting program data: Police employee (LEOKA) data, 2016. Inter-university Consortium for Political and Social Research.

22.

FBI. (2017). Crime in the United States, 2016 . https://ucr.fbi.gov/crime-in-the-u.s/2017

23.

Ferdik

F. V.

Rojek

Alpert

G. P.

(2013). Citizen oversight in the United States and Canada: An overview. Police Practice and Research, 14(2), 104–116. https://doi.org/10.1080/15614263.2013.767089

24.

Finn

(2001). Citizen review of the police: Approaches and implementation. Office of Justice Programs, National Institute of Justice.

25.

Hendrickson

Olson

(2016). Introduction, NACOLE/CJPR special issue: Moving beyond discipline—the role of civilians in police accountability. Criminal Justice Policy Review, 27(5), 447–454. https://doi.org/10.1177/0887403415594844

26.

Holmstrom

Milgrom

(1991). Multitask principal-agent analyses: Incentive contracts, asset ownership and job design. Journal of Law, Economics and Organization, 7(Special Issue), 24–52. https://doi.org/10.1093/jleo/7.special_issue.24

27.

Hong

(2016). Does increasing ethnic representativeness reduce police misconduct? Public Administration Review, 77(2), 195–205. https://doi.org/10.1111/puar.12629

28.

Horwitz

Rabbie

J. M.

(1982). Individuality and membership in the intergroup system. In Tajfel

(Ed.), Social identity and intergroup relations (pp. 241–274). Cambridge University Press.

29.

Imbens

G. W.

(2004). Nonparametric estimation of average treatment effects under exogeneity: A review. The Review of Economics and Statistics, 86(1), 4–29. https://doi.org/10.1162/003465304323023651

30.

Kerstetter

W. A.

(1985). Who disciplines the police? Who should? In Geller

W. A.

(Ed.), Police leadership in America: Crisis and opportunity (pp. 149–182). Praeger.

31.

Kerstetter

W. A.

Rasinski

K. A.

(1994). Opening a window into police internal affairs: Impact of procedural justice reform on third-party attitudes. Social Justice Research, 7(2), 107–127. https://doi.org/10.1007/BF02337294

32.

King

Nielsen

(2019). Why propensity scores should not be used for matching. Political Analysis, 27(4), 435–454. https://doi.org/10.1017/pan.2019.11

33.

King

Nielsen

Coberley

Pope

J. E.

Wells

(2011). Comparative effectiveness of matching methods for causal inference . http://j.mp/2nydGlv

34.

Koppl

Sacks

(2013). The criminal justice system creates incentives for false convictions. Criminal Justice Ethics, 32(2), 126–162. https://doi.org/10.1080/0731129X.2013.817070

35.

(2013). Using the propensity score method to estimate causal effects: A review and practical guide. Organizational Research Methods, 16(2), 188–226. https://doi.org/10.1177/1094428112447816

36.

Libonati

(2021, September 7). Syracuse police release first batch of traffic stop data mandated by reform legislation. The Post-Standard . https://www.syracuse.com/crime/2021/09/syracuse-police-release-first-batch-of-traffic-stop-data-mandated-by-reform-legislation.html

37.

Lipsky

(1980). Street-level bureaucracy: The critical role of street-level bureaucrats. In Shafritz

J. M.

Hyde

A. C.

(Eds.), Classics of public administration (8th ed., pp. 402–409). Cengage Learning.

38.

Lohmann

Libonati

(2020, July 13). Syracuse police took so long on misconduct investigations that some officers can’t be disciplined. The Post-Standard . https://www.syracuse.com/news/2020/07/syracuse-police-took-so-long-on-misconduct-investigations-that-some-officers-cant-be-disciplined.html

39.

Mas

(2006). Pay, reference points, and police performance. The Quarterly Journal of Economics, 121(3), 783–821. https://doi.org/10.1162/qjec.121.3.783

40.

Maslov

(2015). Measuring the performance of the police: The perspective of the public. Public Safety Canada.

41.

McCubbins

M. D.

Noll

R. G.

Weingast

B. R.

(1987). Administrative procedures as instruments of political control. Journal of Law, Economics, & Organization, 3(2), 243–277. https://doi.org/10.1093/oxfordjournals.jleo.a036930

42.

McMurry

T. L.

Blackstone

E. H.

Kozower

B. D.

(2015). Propensity scores: Methods, considerations, and applications in the journal of thoracic and cardiovascular surgery. The Journal of Thoracic and Cardiovascular Surgery, 150(1), 14–19. https://doi.org/10.1016/j.jtcvs.2015.03.057

43.

Moore

M. H.

Braga

A. A.

(2003a). The “bottom line” of policing: What citizens should value (and measure!) in police performance. Police Executive Research Forum.

44.

Moore

M. H.

Braga

A. A.

(2003b). Measuring and improving police performance: The lessons of compstat and its progeny. Policing: An International Journal of Police Strategies & Management, 26(3), 439–453. https://doi.org/10.1108/13639510310489485

45.

Moynihan

D. P.

(2003). Normative and instrumental perspectives on public participation: Citizens summits in Washington, D.C. American Review of Public Administration, 33(2), 164–188. https://doi.org/10.1177/0275074003251379

46.

Mulgan

(2003). Holding power to account: Accountability in modern democracies. Palgrave.

47.

Nabatchi

(2010). Addressing the citizenship and democratic deficits: The potential of deliberative democracy for public administration. American Review of Public Administration, 40(4), 376–399. https://doi.org/10.1177/0275074009356467

48.

Neshkova

M. I.

Guo

(2012). Public participation and organizational performance. Journal of Public Administration Research and Theory, 22(2), 267–288. https://doi.org/10.1093/jopart/mur038

49.

Nicholson-Crotty

O’Toole

L. J. Jr

. (2004). Public management and organizational performance: The case of law enforcement agencies. Journal of Public Administration Research and Theory, 14(1), 1–18. https://doi.org/10.1093/jopart/muh001

50.

Oliver

W. M.

(2015). Depolicing: Rhetoric or reality? Criminal Justice Policy Review, 28(5), 437–461. https://doi.org/10.1177/0887403415586790

51.

Paoline

E. A.

III Gau

J. M.

(2017). Police occupational culture: Testing the monolithic model. Justice Quarterly, 35(4), 670–698. https://doi.org/10.1080/07418825.2017.1335764

52.

Philp

(2009). Delimiting democratic accountability. Political Studies, 57(1), 28–53. https://doi.org/10.1111/j.1467-9248.2008.00720.x

53.

Potoski

Woods

N. D.

(2001). Designing state clean air agencies: Administrative procedures and bureaucratic autonomy. Journal of Public Administration Research and Theory, 11(2), 203–222. https://doi.org/10.1093/oxfordjournals.jpart.a003499

54.

Prenzler

(2011). The evolution of police oversight in Australia. Policing and Society, 21(3), 284–303. https://doi.org/10.1080/10439463.2011.570866

55.

President’s Task Force on 21st Century Policing. (2020). Final report of the President’s task force on 21st century policing. Office of Community Oriented Policing Services.

56.

Roberts

N. C.

(1997). Public deliberation: An alternative approach to crafting policy and setting direction. Public Administration Review, 57(2), 124–132. https://doi.org/10.2307/977060

57.

Scott

(2000). Accountability in the regulatory state. Journal of Law and Society, 27(1), 38–60. https://doi.org/10.1111/1467-6478.00146

58.

Shjarback

J. A.

Pyrooz

D. C.

Wolfe

S. E.

Decker

S. H.

(2017). De-policing and crime in the wake of ferguson: Racialized changes in the quantity and quality of policing among Missouri police departments. Journal of Criminal Justice, 50, 42–52. https://doi.org/10.1016/j.jcrimjus.2017.04.003

59.

Skolnick

J. H.

Fyfe

J. J.

(1993). Police accountability ii: The public. In Skolnick

J. H.

Fyfe

J. J.

(Eds.), Above the law: Police and the excessive use of force (pp. 217–236). Free Press.

60.

Sparrow

M. K.

(2015). Measuring performance in a modern police organization. Psychosociological Issues in Human Resource Management, 3(2), 17–52. https://link.gale.com/apps/doc/A436544001/AONE?u=albanyu&sid=bookmark-AONE&xid=2bbea7cb

61.

StataCorp. (2019). Stata statistical software: Release 16. StataCorp LLC.

62.

Syracuse Police Accountability and Reform Coalition. (2021, September). The people’s agenda for policing. SPAARC . https://spaarc315.org/?page_id=39

63.

Turner

J. C.

(1975). Social comparison and social identity: Some prospects for intergroup behaviour. European Journal of Social Psychology, 5(1), 5–34. https://doi.org/10.1002/ejsp.2420050102

64.

Walker

(2001). Police accountability: The role of citizen oversight. Wadsworth/Thomson Learning.

65.

Walker

(2006). The history of the citizen oversight. In Perino

J. C.

(Ed.), Citizen oversight of law enforcement agencies (pp. 1–10). ABA Book Publishing.

66.

Weisburd

Hasisi

Jonathan

Aviv

(2010). Terrorist threats and police performance: A study of Israeli communities. British Journal of Criminology, 50(4), 725–747. https://doi.org/10.1093/bjc/azp064

67.

Wells

Schafer

J. A.

(2007). Police skepticism of citizen oversight: Officers’ attitudes towards specific functions, processes, and outcomes. Journal of Crime and Justice, 30(2), 1–25. https://doi.org/10.1080/0735648X.2007.9721233

68.

Wilson

Buckler

(2010). The debate over police reform: Examining minority support for citizen oversight and resistance by police unions. American Journal of Criminal Justice, 35(4), 184–197. https://doi.org/10.1007/s12103-010-9079-x

69.

Workman-Stark

A. L.

(2017). Understanding police culture. In Inclusive policing from the inside out (pp. 19–35). Springer.

70.

Worrall

J. L.

(2002). If you build it, they will come: Consequences of improved citizen complaint review procedures. Crime & Delinquency, 48(3), 355–379. https://doi.org/10.1177/0011128702048003001

71.

Worrall

J. L.

(2019). Investigative resources and crime clearances: A group-based trajectory approach. Criminal Justice Policy Review, 30(2), 155–175. https://doi.org/10.1177/0887403416650251

72.

Xanthopoulou

Bakker

A. B.

Demerouti

Schaufeli

W. B.

(2007). The role of personal resources in the job demands-resources model. International Journal of Stress Management, 14(2), 121–141. https://doi.org/10.1037/1072-5245.14.2.121