This study examined episodic measures that assess frequency and magnitude of perceived threat of hate crime over the last six months compared to standard methods that address diffuse threat. Framing effects of question wording, worry- versus fear- versus safety-based, were also assessed. Using Amazon’s Mechanical Turk, a sample of 1,824 adults vulnerable to hate crime completed one of the three randomly assigned survey questionnaires that varied the question wording. Results show that standard measures tend to yield higher levels of perceived threat of hate crime across different bias motivations than episodic measures. Worry- and fear-based questions were also associated with higher odds of perceived threat of hate crime than safety-based questions. Findings, implications, and future directions are discussed.
AltarribaJ.BauerL. M. (2004). The distinctiveness of emotion concepts: A comparison between emotion, abstract, and concrete words. The American Journal of Psychology, 117(3), 389–410.
2.
BandalosD. L. (2018). Measurement theory and applications for the social sciences. Guilford Publications.
3.
BillsM. A.VaughnM. S. (2022). A contemporary review of hate crime legislation in the United States. Criminal Justice Policy Review, 34(2), 115–139.
4.
BoeckmannR. J.Turpin-PetrosinoC. (2002). Understanding the harm of hate crime. Journal of Social Issues, 58(2), 207–225.
ChatawayM. L.HartT. C.BondC. (2019). The social-psychological process of fearing crime: Developing and testing a new momentary model of victimisation worry. Australian & New Zealand Journal of Criminology, 52(4), 462–482.
7.
ChongateraG. (2013). Hate-crime victimization and fear of hate crime among racially visible people in Canada: The role of income as a mediating factor. Journal of Immigrant & Refugee Studies, 11(1), 44–64.
8.
CoppockA.McClellanO. A. (2019). Validating the demographic, political, psychological, and experimental results from a new source of online survey respondents. Research and Politics, 6(1), 1–14.
9.
CossmanJ. S.RaderN. E. (2011). Fear of crime and personal vulnerability: Examining self-reported health. Sociological Spectrum, 31(2), 141–162.
10.
Craig-HendersonK.SloanL. R. (2006). After the hate: Helping psychologists help victims of racist hate crime. Clinical Psychology: Science and Practice, 10(4), 481–490.
11.
EitleD.TaylorJ. (2008). Are Hispanics the new ‘Threat’? Minority group threat and fear of crime in Miami-Dade County. Social Science Research, 37(4), 1102–1115.
12.
EtopioA. L.BerthelotE. R. (2022). Defining and measuring fear of crime: A new validated scale created from emotion theory, qualitative interviews, and factor analyses. Criminology, Criminal Justice, Law & Society, 23(1), 46–67.
13.
FarrallS. (2004) Revisiting crime surveys: Emotional responses without emotions. International Journal of Social Research Methodology7(2), 157–71.
14.
FarrallS.GaddD. (2004). Evaluating crime fears: A research note on a pilot study to improve the measurement of the ‘fear of crime’ as a performance indicator. Evaluation, 10(4), 493–502.
15.
FayR. E.LiJ. (2010). Effects of unbounded interviews, time in sample, and recency on reported crimes in the national crime victimization survey [Conference session]. Proceedings of the Section on Survey Research Methods, American Statistical Association, Alexandria, VA (pp. 1687–1700). http://www.asasrms.org/Proceedings/y2010/Files/306795_57200.pdf
GibsonS.FernandezJ. (2018) Gender diversity and non-binary inclusion in the workplace: The essential guide for employers. Jessica Kingsley.
19.
GoffmanE. (1974). Frame analysis. Harvard University Press.
20.
GrahamA.CullenF. T.PickettJ. T.JonsonC. L. (2021). A new generation of survey research in criminology: Online opt-in surveys. The Criminologist46(6), 5–9.
21.
GrayE.JacksonJ.FarrallS. (2008). Reassessing the fear of crime. European Journal of Criminology, 5(3), 363–380.
22.
GrayE.JacksonJ.FarrallS. (2011). Feelings and functions in the fear of crime: Applying a new approach to victimisation insecurity. British Journal of Criminology, 51(1), 75–94.
23.
HerekG. M.GillisJ. R.CoganJ. C. (1999). Psychological sequelae of hate-crime victimization among lesbian, gay, and bisexual adults. Journal of Consulting and Clinical Psychology, 67(6), 945–951.
24.
HinkleJ. C. (2015). Emotional fear of crime vs. perceived safety and risk: Implications for measuring “fear” and testing the broken windows thesis. American Journal of Criminal Justice, 40(1), 147–168.
25.
IntraviaJ.WolffK. T.PaezR.GibbsB. R. (2017). Investigating the relationship between social media consumption and fear of crime: A partial analysis of mostly young adults. Computers in Human Behavior, 77, 158–168.
26.
JamalJ. (2018). Transphobic hate crime. Palgrave Macmillan.
27.
JacksonJ. (2005). Validating new measures of the fear of crime. International Journal of Social Research Methodology, 8(4), 297–315.
28.
JacksonJ. (2006) Introducing fear of crime to risk research. Risk Analysis, 26(1), 253–64.
29.
KahnemanD.TverskyA. (1984). Choices, values, and frames. American Psychologist, 39(4), 341–350.
30.
KimC.LeeC. S.LimH. (2022). Hate-motivated crime/incidents against Asians in the United States of America: A systematic review. Race and Justice, 13(1), 9–31.
31.
KnauperB. (1998). Filter questions and question interpretation: Presuppositions at work. Public Opinion Quarterly, 62(1), 70–78.
32.
KrulichováE. (2019). The relationship between fear of crime and risk perception across Europe. Criminology & Criminal Justice, 19(2), 197–214.
33.
LambertE. G. (2004). Assessing the crime and punishment views of criminal justice majors: How different are they from other majors?Criminal Justice Studies, 17(3), 245–257.
34.
LantzB.WengerM. R. (2023). Anti-Asian xenophobia, hate crime victimization, and fear of victimization during the COVID-19 pandemic. Journal of Interpersonal Violence, 38, NP1088–NP1116. https://doi.org/10.1177/08862605221086651
35.
LantzB.WengerM. R.MillsJ. M. (2022). Fear, political legitimization, and racism: Examining anti-Asian xenophobia during the COVID-19 pandemic. Race and Justice, 13(1), 80–104.
36.
LeeM.JacksonJ.EllisJ. R. (2020). Functional and dysfunctional fear of crime in inner Sydney: Findings from the quantitative component of a mixed-methods study. Australian & New Zealand Journal of Criminology, 53(3), 311–332.
37.
MadsonL. (2005). Demonstrating the importance of question wording on surveys. Teaching of Psychology, 32(1), 40–43.
38.
MalcomZ. T.LantzB. (2021). Hate crime victimization and weapon use. Criminal Justice and Behavior, 48(8), 1148–1165.
MaxfieldM. G.BabbieE. R. (2018). Research methods for criminal justice and criminology (8th ed.). Cengage Learning.
41.
MayD. C.RaderN. E.GoodrumS. (2010). A gendered assessment of the ‘‘threat of victimization’’: Examining gender differences in fear of crime, perceived risk, avoidance, and defensive behaviors. Criminal Justice Review, 35(2), 159–182.
42.
McDevittJ.IwamaJ. A. (2016). Challenges in measuring and understanding hate crime. In HuebnerB. M.BynumT. S. (Eds.), The handbook of measurement issues in criminology and criminal justice (pp. 131–156). John Wiley & Sons.
43.
MurisP.MerckelbachH.GadetB.MoulaertV. (2000). Fears, worries, and scary dreams in 4- to 12-year-old children: Their content, developmental pattern, and origins. Journal of Clinical Child Psychology, 29(1), 43–52.
44.
MyersW.LantzB. (2020). Reporting racist hate crime victimization to the police in the United States and the United Kingdom: A cross-national comparison. The British Journal of Criminology, 60(4), 1034–1055.
45.
OhG.RenL.HeP. (2019). Social disorder and residence-based fear of crime: The differential mediating effects of police effectiveness. Journal of Criminal Justice, 63, 1–11.
46.
PayneS. L. B. (1951). The art of asking questions. Princeton University Press.
47.
PerryB.AlviS. (2012). “We are all vulnerable” Thein terrorem effects of hate crimes. International Review of Victimology, 18(1), 57–71.
48.
PezzellaF. S.FetzerM. D.KellerT. (2019). The dark figure of hate crime underreporting. American Behavioral Scientist. Advance online publication. https://doi.org/10.1177/0002764218823844
49.
PickettJ. T.GrahamA.CullenF. T. (2022). The American racial divide in fear of the police. Criminology, 60(2), 291–320.
50.
PogarskyG.RocheS. P.PickettJ. T. (2017). Heuristics and biases, rational choice, and sanction perceptions. Criminology, 55(1), 85–111.
51.
PyoJ.MaxfieldM. G. (2021). Cognitive effects of inattentive responding in an MTurk sample. Social Science Quarterly, 102(4), 2020–2039.
52.
RaderN. E. (2004). The threat of victimization: A theoretical reconceptualization of fear of crime. Sociological Spectrum, 24(6), 689–704.
53.
SchuldtJ. P.KonrathS. H.SchwarzN. (2011). “Global warming” or “climate change”? Whether the planet is warming depends on question wording. Public Opinion Quarterly, 75(1), 115–124.
54.
SheehanK. B.PittmanM. (2016). Amazon’s mechanical Turk for academics: The HIT handbook for social science research. Melvin & Leigh, Publishers.
55.
SkoganW. (1981) Issues in the measurement of victimisation. US Department of Justice, US Government Printing Office.
56.
SloanM. M.HanerM.CullenF. T.GrahamA.AydinE.KuligT. C.JonsonC. L. (2021). Using behavioral strategies to cope with the threat of terrorism: A national-level study. Crime & Delinquency, 67(12), 2011–2042.
57.
StaceyM.Carbone-LópezK.RosenfeldR. (2011). Demographic change and ethnically motivated crime: The impact of immigration on anti-Hispanic hate crime in the United States. Journal of Contemporary Criminal Justice, 27(3), 278–298.
58.
SterngoldA.WarlandR. H.HerrmannR. O. (1994). Do surveys overstate public concerns?Public Opinion Quarterly, 58(2), 255–263.
59.
SzabóM. (2007). Do children differentiate worry from fear?Behaviour Change, 24(4), 195–204.
60.
ThomasK. A.CliffordS. (2017). Validity and mechanical Turk: An assessment of exclusion methods and interactive experiments. Computers in Human Behavior, 77, 184–197.
61.
TverskyA.KahnemanD. (1981). The framing of decisions and the psychology of choice. Science, 211(4481), 453–458.
62.
WarrM. (2000). Fear of crime in the United States: Avenues for research and policy. Criminal Justice, 4(4), 451–489.
63.
WengerM. R.LantzB.GallardoG. (2022). The role of hate crime victimization, fear of victimization, and vicarious victimization in COVID-19-related depression. Criminal Justice and Behavior, 49(12), 1746–1762.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
