Psychometric evaluation of the Turkish version of the Work-Related Stress Scale: A study among search and rescue workers responding to the 2023 Kahramanmaraş earthquakes
Restricted accessResearch articleFirst published online October, 2025
Psychometric evaluation of the Turkish version of the Work-Related Stress Scale: A study among search and rescue workers responding to the 2023 Kahramanmaraş earthquakes
This study evaluates the reliability and validity of the Turkish version of the Work-Related Stress Scale (WRSS) among search and rescue workers who responded to the 2023 Kahramanmaraş earthquakes. Data were collected from 275 workers between January and April 2024 using the Personal Information Form and the Turkish version of the WRSS. Language, content, and construct validity were assessed, and reliability was determined using item-total correlation, Cronbach’s alpha, split-half, and test-retest methods. The scale demonstrated strong content validity with a CVI range of 0.9–1.0 and a mean CVI of 0.98. Exploratory factor analysis yielded factor loadings from 0.469 to 0.932, resulting in four factors that explained 75.3% of the variance. The reliability coefficients for the sub-dimensions ranged from 0.833 to 0.900, with an overall Cronbach’s alpha of 0.913. These results indicate that the Turkish WRSS is a valid and reliable tool for assessing stress among search and rescue workers.
AitkenPLeggatPRobertsonAet al. (2009) Health and safety aspects of deployment of Australian Disaster Medical Assistance Team members: Results of a national survey. Travel Medicine and Infectious Disease7(5): 284–290.
2.
BenedekDMFullertonCUrsanoRJ (2007) First responders: Mental health consequences of natural and human-made disasters for public health and public safety workers. Annual Review of Public Health28(1): 55–68.
3.
ÇalışkanCÖzcebeH (2013) Afetlerde enfeksiyon hastalıkları salgınları ve kontrol önlemleri. TAF Preventive Medicine Bulletin12(5): 583.
4.
ChenY-LTzengW-CChaoEet al. (2021) Development and validation of an instrument to measure work-related stress among rescue workers in traumatic mass-casualty disasters. International Journal of Environmental Research and Public Health18(16): 8340.
5.
ConnellyM (2006) IMERT deployment to Baton Rouge, Louisiana in response to hurricane Katrina, September2005. Disaster Management & Response4(1): 4–11.
6.
CookADBShresthaMHtetZB (2018) An assessment of international emergency disaster response to the 2015 Nepal earthquakes. International Journal of Disaster Risk Reduction31: 535–547.
CronbachLJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika16(3): 297–334.
9.
DavisLL (1992) Instrument review: Getting the most from a panel of experts. Applied Nursing Research5(4): 194–197.
10.
de VetHCWMokkinkLBMosmullerDGet al. (2017) Spearman–Brown prophecy formula and Cronbach’s alpha: Different faces of reliability and opportunities for new applications. Journal of Clinical Epidemiology85: 45–49.
11.
FjeldheimCBNöthlingJPretoriusKet al. (2014) Trauma exposure, posttraumatic stress disorder and the effect of explanatory variables in paramedic trainees. BMC Emergency Medicine14(1): 11.
12.
Geronazzo-AlmanLEisenbergRShenSet al. (2017) Cumulative exposure to work-related traumatic events and current post-traumatic stress disorder in New York City’s first responders. Comprehensive Psychiatry74: 134–143.
13.
GorsuchRL (2015) Factor Analysis. New York, NY: Routledge/Taylor & Francis Group.
14.
HairJFBlackWCBabinBJet al. (2010) Multivariate Data Analysis: A Global Perspective, 7th edn.Upper Saddle River, NJ: Pearson Education.
15.
HambletonRKMerendaPFSpielbergerCD (eds) (2004) Adapting Educational and Psychological Tests for Cross-Cultural Assessment. New York, NY: Psychology Press.
16.
HancerliogluSKonakciGAykarFS (2020) Assessing psychometric properties of Turkish version of the stressor scale for emergency nurses. Turkish Journal of Emergency Medicine20(2): 69–74.
17.
HarringtonD (2009) Confirmatory Factor Analysis. New York, NY: Oxford University Press.
18.
IyerRD (2017) Developing and validating a questionnaire to measure some factors of school culture: A psychometric process. Prabandhan: Indian Journal of Management10(11): 7.
19.
KaiserHF (1974) An index of factorial simplicity. Psychometrika39(1): 31–36.
20.
KawashimaYNishiDNoguchiHet al. (2016) Post-traumatic stress symptoms and burnout among medical rescue workers 4 years after the Great East Japan Earthquake: A longitudinal study. Disaster Medicine and Public Health Preparedness10(6): 848–853.
21.
KimH-Y (2013) Statistical notes for clinical researchers: Assessing normal distribution (2) using skewness and kurtosis. Restorative Dentistry & Endodontics38(1): 52.
22.
KınıkKKudayADÇalışkanC (2024) Psychological hardiness and compassion satisfaction among the Turkish Red Crescent: The case of 2023 Kahramanmaras Earthquake. Disaster Medicine and Public Health Preparedness18: e58.
23.
KishoreKJaswalVKulkarniVet al. (2021) Practical guidelines to develop and evaluate a questionnaire. Indian Dermatology Online Journal12(2): 266–275.
24.
KlineRB (2015) Principles and Practice of Structural Equation Modeling. New York, NY: Guilford Press.
25.
KoçakHÇaliskanCKayaEet al. (2015) Determination of individual preparation behaviors of emergency health services personnel towards disasters. Journal of Acute Disease4(3): 180–185.
26.
KoçakHKınıkKÇalışkanCet al. (2021) The science of disaster medicine: From response to risk reduction. Medeniyet Medical Journal36(4): 333–342.
27.
KudayADÖzcanTÇalışkanCet al. (2023) Challenges faced by medical rescue teams during disaster response: A systematic review study. Disaster Medicine and Public Health Preparedness17: e548.
28.
LunauTWahrendorfMMüllerAet al. (2018) Do resources buffer the prospective association of psychosocial work stress with depression? Longitudinal evidence from ageing workers. Scandinavian Journal of Work, Environment & Health44(2): 183–191.
29.
MertSAydin SayilanABaydemirC (2020) Nurse Stress Scale (NSS): Reliability and validity of the Turkish version. Perspectives in Psychiatric Care57(2): 443–454.
30.
NunnallyJCBernsteinIH (1994) Psychometric Theory, 3rd edn.New York, NY: McGraw-Hill.
31.
ÖzelMAltintaşMTatliparmakACet al. (2023) The role of Mangled Extremity Severity Score in amputation triage in a transport health facility with catastrophic earthquake admissions. Injury54(11): 111003.
PolitDFBeckCT (2006) The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health29(5): 489–497.
34.
PolitDFBeckCTOwenSV (2007) Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health30(4): 459–467.
35.
SaijoYUenoTHashimotoY (2007) Job stress and depressive symptoms among Japanese fire fighters. American Journal of Industrial Medicine50(6): 470–480.
36.
SchumackerRELomaxRG (2010) A Beginner’s Guide to Structural Equation Modeling. Mahwah, NJ: Routledge/Taylor & Francis Group.
37.
SehlikogluSYilmaz KaramanIGYastibas KacarCet al. (2023) Earthquake and mental health of healthcare workers: A systematic review. Turkish Journal of Clinical Psychiatry26: 309–318.
38.
ShenWJiangLZhangMet al. (2015) Practical experiences and lessons of medical response to major disasters in China. Hong Kong Journal of Emergency Medicine22(5): 270–280.
39.
TathamPSpensK (2016) Cracking the humanitarian logistic coordination challenge: Lessons from the urban search and rescue community. Disasters40(2): 246–261.
40.
TavakolMDennickR (2011) Making sense of Cronbach’s alpha. International Journal of Medical Education2: 53–55.
41.
TeleşM (2020) Validity and reliability of the Turkish version of the general work stress scale. Journal of Nursing Management29(4): 710–720.
42.
WorthingtonRLWhittakerTA (2006) Scale development research. The Counseling Psychologist34(6): 806–838.
43.
YıldırımMDilekçiÜMarcattoFet al. (2024) Validation of a Turkish translation of the perceived occupational stress scale and measurement invariance across Turkish and Italian workers. Risk Management and Healthcare Policy17: 261–268.
44.
YılmazSKarakayaliOYilmazSet al. (2023) Emergency Medicine Association of Turkey Disaster Committee summary of field observations of February 6th Kahramanmaraş earthquakes. Prehospital and Disaster Medicine38(3): 415–418.
45.
YöndemZDErenA (2008) Deprem Stresi İle Baş Etme Stratejileri Ölçeğinin geçerlik ve güvenirlik çalışmaları. Türk Psikolojik Danışma ve Rehberlik Dergisi3(30): 60–75.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
