Restricted accessResearch articleFirst published online 2025-7
Translation,cultural adaptation and assessment of psychometric properties of the CarMen-Q mental workload questionnaire in Persian language speaking people
Mental workload is known to significantly impact performance and can potentially result in human error, stress, fatigue, and job dissatisfaction. Questionnaires serve as accessible, easy, and valid tools for measuring mental workload.
Objective
This study translated, culturally adapted the CarMen-Q mental workload questionnaire into Persian and evaluated its psychometric properties in Persian workers.
Methods
This cross-sectional study was designed according to the COSMIN checklist. A Persian-speaking population (n = 296, age 38.59 ± 7.61 years, male = 66.2%) was recruited from four industrial and administrative sectors of glass and carton packing companies. Psychometric properties assessed in this study encompassed face validity, content validity, construct validity through correlation with NASA-TLX questionnaire, structural validity; additionally, test-retest reliability (ICC value); and internal consistency (Cronbach's α).
Results
During the translation and adaptation process, minor modifications were identified and made in four items. The Content Validity Index values for each of the items (0.71–1) and its total score (0.914) were acceptable. Internal consistency for the subscales were > 0.8, and the test-retest reliability was ICC (2,1)= 0.90 (95% CI 0.84–0.94). Construct validity showed a moderate to good correlation between the CarMen-Q and NASA task load index NASA-TLX subscales (r = 0.42–0.53). The exploratory factor analysis demonstrated a four-factor structure that explained 47.14% of total variance. No floor/ceiling effects were found except for the performance subscale.
Conclusions
The Persian CarMen-Q mental workload questionnaire demonstrated strong reliability and validity, rendering it potentially suitable for measuring mental workload in Iranian workers across various task conditions.
SalvagioniDAJMelandaFNMesasAE, et al.Physical, psychological and occupational consequences of job burnout: a systematic review of prospective studies. PloS One2017; 12: e0185781.
2.
SchwartzAGerberichSGAlbinT, et al.The association between janitor physical workload, mental workload, and stress: the SWEEP study. Work2020; 65: 837–846.
3.
ZareSHasheminezhadNDeheshT, et al.The relationship between mental workload and prevalence of musculoskeletal disorders among welders of Tehran heavy metal structures company in 2016. J Biol Today's World2016; 5: 218–223.
4.
GhanavatiFKChoobinehAKeshavarziS, et al.Assessment of mental workload and its association with work ability in control room operators. La Medicina del Lavoro2019; 110: 389.
5.
TaoDTanHWangH, et al.A systematic review of physiological measures of mental workload. Int J Environ Res Public Health2019; 16: 2716.
6.
KhandanMMirshekariFKoorsaniE, et al.Subjective workload and musculoskeletal disorders among workers of a manufacturing company in Iran. Biotech Health Sci2018; 5: 1–6.
7.
LongoL (eds) Subjective usability, mental workload assessments and their impact on objective human performance. In: IFIP conference on human-computer interaction, 2017. Springer.
8.
Arana-De las CasasNIDe la Riva-RodríguezJMaldonado-MacíasAA,et al.Cognitive analyses for interface design using dual N-back tasks for mental workload (MWL) evaluation. Int J Environ Res Public Health2023; 20: 1184.
9.
Rubio-ValdehitaSLópez-NúñezMILópez-HigesR,et al.Development of the CarMen-Q questionnaire for mental workload assessment. Psicothema2017; 4: 570–576.
10.
CharlesRLNixonJ. Measuring mental workload using physiological measures: a systematic review. Appl Ergon2019; 74: 221–232.
11.
CainB. A review of the mental workload literature. Toronto, Canada: Defence Research and Development, 2007.
12.
RubioSDíazEMartínJ,et al.Evaluation of subjective mental workload: a comparison of SWAT, NASA-TLX, and workload profile methods. Appl Psychol2004; 53: 61–86.
13.
GawronVJ. Human performance and situation awareness measures. 3rd ed. Boca Raton: CRC Press, 2019.
14.
Ghanbary SartangAAshnagarMHabibiE,et al.Evaluation of rating scale mental effort (RSME) effectiveness for mental workload assessment in nurses. J Occup Health Epidemiol2016; 5: 211–217.
15.
LongoL. A defeasible reasoning framework for human mental workload representation and assessment. Behav Inf Technol2015; 34: 758–786.
16.
LuCHuYFuQ, et al.Physician mental workload scale in China: development and psychometric evaluation. BMJ open2019; 9: e030137.
17.
McKendrickRDCherryE (eds) A deeper look at the NASA TLX and where it falls short. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2018. Los Angeles, CA: Sage Publications Sage CA.
18.
MestreCPM. Adaptação e validação do carga mental questionnaire (CarMen-Q) para uma amostra de trabalhadores portugueses, 2021.
19.
AkcaMYavuzMKüçükoğluMT. Measurement of mental workload: Turkish adaptation of CarMen-Q Questionnaire (in Turkish). Yaşar Üniversitesi E-Dergisi2020; 15: 675–691.
20.
Rodríguez-LópezAMRubio-ValdehitaSDíaz-RamiroEM. Influence of the COVID-19 pandemic on mental workload and burnout of fashion retailing workers in Spain. Int J Environ Res Public Health2021; 18: 83.
21.
AliNQM. Investigation of mental workload and job satisfaction among officer workers at a selected electronic company. Kuala Lumpur: University of Malaya (Malaysia), 2020.
22.
SaidMM. The relationship between musculoskeletal disorders and mental workload among female computer workers at services sector in Shah Alam. Kuala Lumpur: University of Malaya (Malaysia), 2021.
23.
MoosomCSC. Mental workload investigation among employees in a selected oil and gas company. Kuala Lumpur: University of Malaya (Malaysia), 2020.
24.
MokkinkLBPrinsenCPatrickDL, et al. COSMIN Study design checklist for patient-reported outcome measurement instruments. Amsterdam, The Netherlands: Amsterdam Public Health Research Institute, 2019, pp.1–32.
25.
MokhtariniaHRHosseiniZSJShokouhyanSM,et al.Translation, cultural adaptation and assessment of psychometrics properties of the Extended Version of the Nordic Musculoskeletal Questionnaire (NMQ-E) in Persian language speaking people. BMC Musculoskeletal Disord2024; 25: 89.
26.
AnthoineEMoretLRegnaultA, et al.Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health Qual Life Outcomes2014; 12: 2.
27.
HartSGStavelandLE. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv Psychol Elsevier1988; 52: 139–183.
28.
SaidSGozdzikMRocheTR, et al.Validation of the raw national aeronautics and space administration task load Index (NASA-TLX) questionnaire to assess perceived workload in patient monitoring tasks: pooled analysis study using mixed models. J Med Internet Res2020; 22: e19472.
29.
BeatonDEBombardierCGuilleminF,et al.Guidelines for the process of cross-cultural adaptation of self-report measures. Spine2000; 25: 3186–3191.
30.
MokhtariniaHRZareiyanAGabelCP. Cross-cultural adaptation, validity, and reliability of the Persian version of the upper limb functional Index. Hand Ther2021; 26: 43–52.
31.
ShafeeiAMokhtariniaHRMaleki-GhahfarokhiA,et al.Cross-cultural adaptation, validity, and reliability of the Persian version of the orebro musculoskeletal pain screening questionnaire. Asian Spine J2017; 11: 520–530.
32.
RodriguesIBAdachiJDBeattieKA,et al.Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskelet Disord2017; 18: 40.
33.
PolitDFBeckCTOwenSV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health2007; 30: 459–467.
34.
TerweeCBBotSDde BoerMR, et al.Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol2007; 60: 34–42.
35.
Dychawy-RosnerIEklundM. Content validity and clinical applicability of the irena daily activity assessment measuring occupational performance in adults with developmental disability. Occup Ther Int2003; 10: 127–149.
36.
GodwinMPikeABethuneC, et al.Concurrent and convergent validity of the simple lifestyle indicator questionnaire. ISRN Family Med2013; 2013: 529645.
37.
MokhtariniaHRArdakaniMRKEbadiA,et al.Cross cultural adaptation and psychometric evaluation of the short version of smart phone addiction scale in the Persian language. Iran J Psychiatry2023; 18: 35.
38.
MokhtariniaHRHosseiniAMaleki-GhahfarokhiA, et al.Cross-cultural adaptation, validity, and reliability of the Persian version of the spine functional index. Health Qual Life Outcomes2018; 16: 95.
39.
SouzaACDAlexandreNMCGuirardelloEDB. Psychometric properties in instruments evaluation of reliability and validity. Epidemiologia e Servicos de Saude2017; 26: 649–659.
40.
HensonRK. Understanding internal consistency reliability estimates: a conceptual primer on coefficient alpha. Meas Eval Couns Dev2001; 34: 177–189.
41.
FleissJLLevinBPaikMC. Statistical methods for rates and proportions. United States: John Wiley & Sons, 2013.
42.
SupramaniamPIsmailSHAliA, et al.Modified-Malay eating behavior and pattern questionnaire (Malay-EBPQ): translation and validation among Malaysian women. Health Qual Life Outcomes2023; 21: 01.
43.
MeltemAYavuzMKüçükoğluMT. Zihinsel İş yükünün Ölçümü: carMen-Q Ölçeğinin türkçe’ye uyarlaması. Yaşar Üniversitesi E-Dergisi2020; 15: 675–691.
44.
DuarteJBerthelsenHOwenM. Not all emotional demands are the same: emotional demands from Clients’ or co-Workers’ relations have different associations with well-being in service workers. Int J Environ Res Public Health2020; 17: 7738.
45.
Dall’OraCBallJReiniusM,et al.Burnout in nursing: a theoretical review. Hum Resour Health2020; 18: 41.
46.
BergströmGLohela-KarlssonMKwakL, et al.Preventing sickness absenteeism among employees with common mental disorders or stress-related symptoms at work: design of a cluster randomized controlled trial of a problem-solving based intervention versus care-as-usual conducted at the Occupational Health Services. BMC Public Health2017; 17: 1–10.
47.
JaegersLAAhmadSOScheetzG, et al.Total worker health® needs assessment to identify workplace mental health interventions in rural and urban jails. Am J Occup Ther2020; 74: 7403205020p1–p12.
48.
KobayashiYKaneyoshiAYokotaA,et al.Effects of a worker participatory program for improving work environments on job stressors and mental health among workers: a controlled trial. J Occup Health2008; 50: 455–470.
