The emotional management of workers can not only increase the efficiency of work, but also contribute to the improvement of the productivity of a company.
OBJECTIVE:
This scoping review surveyed the literature to identify the relationship between postural expression and emotion during sedentary tasks.
METHODS:
We searched relevant literature published up to December 1, 2019 using seven electronic databases (PubMed, CINAHL, Embase, Web of Science, PsycINFO, IEEE Xplore, and MEDLINE Complete).
RESULTS:
A total of 14 publications were included in this scoping review. It was found that the application of pressure sensor and camera-based measurement equipment was effective. Additionally, it was proposed to predict the emotional state of the worker by using forward and backward movements as the main variable as opposed to left and right movements. The information-based analysis technique was able to further increase the accuracy of workers’ emotion prediction.
CONCLUSIONS:
The emotion prediction of workers based on sitting posture could be confirmed for certain movements, and the information-based technical method could further increase the accuracy of prediction. Expansion of information-based technical research will further increase the possibility of predicting the emotions of workers based on posture, and this will in turn promote safer and more efficient work performance.
ShonD, ImK, ParkJ, LimD, JangB, KimJ. Emotional stress state detection using genetic algorithm-based feature selection on EEG signals, International Journal of Environmental Research and Public Health2018;15(11):2461.
2.
LiQ, GravinaR, FortinoG. Posture and gesture analysis supporting emotional activity recognition. Paper presented at the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). 2018;2742-7.
3.
ArpaiaP, MoccaldiN, PreveteR, SanninoI, TedescoA. A wearable EEG instrument for real-time frontal asymmetry monitoring in worker stress analysis, IEEE Transactions on Instrumentation and Measurement2020;69(10):8335–43.
4.
JebelliH, ChoiB, LeeS. Application of wearable biosensors to construction sites, I: Assessing workers’ stress. Journal of Construction Engineering and Management2019;145(12):04019079.
5.
JebelliH, HwangS, LeeS. EEG-based workers’ stress recognition at construction sites, Automation in Construction2018;93:315–24.
6.
BakkerAB, SchaufeliWB, LeiterMP, TarisTW. Work engagement: An emerging concept in occupational health psychology, Work Stress2008;22:187–200.
7.
KajiwaraY, YonekuraS, KimuraH. Prediction of future mood using majority vote based on certainty factor, Sensors and Materials2018;30:1473–86.
8.
FerreiraE, FerreiraD, KimS, SiirtolaP, RöningJ, et al. Assessing real-time cognitive load based on psychophysiological measures for younger and older adults. 2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB): IEEE. 2014; 39-48.
9.
ChoiJ, AhmedB, Gutierrez-OsunaR. Development and evaluation of an ambulatory stress monitor based on wearable sensors, IEEE Transactions on Information Technology in Biomedicine2011;16(2):279–86.
10.
ShihYN, ChienWH, ChiangHS. Elucidating the relationship between work attention performance and emotions arising from listening to music, Work2016;55(2):489–94.
11.
WahabA, KamaruddinN, PalaniappanLK, LiM, KhosrowabadiR. EEG signals for emotion recognition, Journal of Computational Methods in Sciences and Engineering.-S2010;10(S1):S1–S11.
12.
KalpanaCM, JudeHD. Human emotion recognition using intelligent approaches: A review, Intelligent Decision Technolgies2019;13(4):417–33.
13.
JuliaY, ZhangL, Dilawar KhanD. Emotional intelligence could forge self-efficacy, work effort and career satisfaction, Human Systems Management2017;36(2):141–9.
14.
RiemerV, FrommelJ, LayherG, NeumannH, SchraderC. Identifyingfeatures of bodily expression as indicators of emotional experienceduring multimedia learning, Frontiers in Psychology2017;27(8):1303.
15.
Sarabia-CoboCM, García-RodríguezB, NavasMJ, EllgringH. Emotional processing in patients with mild cognitive impairment: Theinfluence of the valence and intensity of emotional stimuli: Thevalence and intensity of emotional stimuli influence emotionalprocessing in patients with mild cognitive impairment, Journal ofthe Neurological Sciences2015;357(1-2):222–8.
16.
KumarR, BayliffA, DeD, EvansA, DasSK, MakosM. Care-chair:Sedentary activities and behavior assessment with smart sensing onchair backrest, Paper presented at the IEEE InternationalConference on Smart Computing (SMARTCOMP)2016)1–8.
17.
MichishitaA, NaitoT, ShibataT. Analysis and modelling ofaffective japanese sitting postures, Paper presented at the International Conference on Signal-Image Technology &Internet-Based Systems2013)765–70.
18.
ChurchTS, ThomasDM, Tudor-LockeC, KatzmarzykPT, EarnestCP, RodarteRQ, etal. Trends over 5 decades in US occupation-related physical activity and their associations with obesity, PloS one.e2011;6(5):19657.
19.
McVeighJA, WinklerEA, HowieEK, TremblayMS, SmithA, AbbottRA, et al. Objectively measured patterns of sedentary time and physical activity in young adults of the Raine study cohort, International Journal of Behavioral Nutrition and Physical Activity2016;13(1):1–12.
20.
GilsonND, PaveyTG, VandelanotteC, DuncanM, GomersallSR, TrostSG, et al. Chronic disease risks and use of a smartphone application during a physical activity and dietary intervention in Australian truck drivers, Australian and New Zealand Journal of Public Health2016;40(1):91–3.
21.
McVeighJA, WinklerEA, HowieEK, TremblayMS, SmithA, AbbottRA, et al. Objectively measured patterns of sedentary time and physical activity in young adults of the Raine study cohort, International Journal of Behavioral Nutrition and Physical Activity2016;13(1):1–12.
22.
ArkseyH, O’MalleyL. Scoping studies: Towards a methodological framework, International Journal of Social Research Methodology2005;8(1):19–32.
23.
BalzarottiS, PicciniL, AndreoniG, CiceriR. “I know that youknow how I feel”: Behavioral and physiological signals demonstrateemotional attunement while interacting with a computer simulatingemotional intelligence, Journal of Nonverbal Behavior2014;38:283–99.
24.
van den Hoogen, WouterM, IJsselsteijnWA, de KortYA. Exploring behavioral expressions of player experience in digital games. Paper presented at the Proceedings of the Workshop on Facial and Bodily Expression for Control and Adaptation of Games ECAG 2008. 2008;11-9.
25.
GrafsgaardJF, BoyerKE, WiebeEN, LesterJC. Analyzing posture and affect in task-oriented tutoring. Paper presented at the Twenty-Fifth International FLAIRS Conference. 2012.
26.
OosterwijkS, RotteveelM, FischerAH, HessU. Embodied emotionconcepts: How generating words about pride and disappointmentinfluences posture, European Journal of Social Psychology2009;39(3):457–66.
27.
QiuJ, HelbigR. Body posture as an indicator of workload in mentalwork, Human Factors2012;54(4):626–35.
28.
SaneiroM, SantosOC, Salmeron-MajadasS, BoticarioJG. Towards emotion detection in educational scenarios from facial expressions and body movements through multimodal approaches. The Scientific World Journal. 2014; 484873.
29.
GravinaR, LiQ. Emotion-relevant activity recognition based onsmart cushion using multi-sensor fusion, Inform Fusion2019;48:1–10.
30.
ShibataT, KijimaY. Emotion recognition modeling of sitting postures by using pressure sensors and accelerometers. Paper presented at the Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012). 2012;1124-7..
31.
ShibataT, MichishitaA, Bianchi-BerthouzeN. Analysis and modelling of affective japanese sitting postures by japanese and british observers. Paper presented at the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction. 2013;91-6.
32.
GavrilescuM. Recognizing emotions from videos by studying facial expressions, body postures and hand gestures. Paper presented at the 2015 23rd Telecommunications Forum Telfor (TELFOR). 2015;720-3.
33.
Stress management in the construction industry. The IOSH (Institute of Occupational Health and Safety) Hong Kong Annual Safety Conference: Hong Kong; 2015.
34.
TixierAJ, HallowellMR, AlbertA, van BovenL, KleinerBM. Psychological antecedents of risk-taking behavior in construction, Journal of Construction Engineering and Management2014;140(11):04014052.
35.
LeungM, LiangQ, ChanIY. Development of astressors–stress–performance–outcome model forexpatriate construction professionals, Journal of ConstructionEngineering and Management2017;143(5):04016121.
36.
SöderholmC, HäyryE, LaineM, KarraschM. Valence and arousal ratings for 420 Finnish nouns by age and gender, PloS One2013;8(8):e72859.
37.
FehrR, FulmerA, AwtreyE, MillerJA. The grateful workplace: A multilevel model of gratitude in organizations, Academy of Management Review2017;42(2):361–81.
38.
GanderF, ProyerRT, RuchW. Positive psychology interventions addressing pleasure, engagement, meaning, positive relationships, and accomplishment increase well-being and ameliorate depressive symptoms: A randomized, placebo-controlled online study, Frontiers Psychology2016;20(7):686.
39.
HodginsM, DadichA. Positive emotion in knowledge creation, Journal of Health Organization and Management2017;31(2):162–74.
40.
PradhanRK, JenaLK, SinghSK. Examining the role of emotional intelligence between organizational learning and adaptive performance in indian manufacturing industries, Journal of Workplace Learning2017;29(3):235–47.
41.
MethotJR, MelwaniS, RothmanNB. The space between us: A social-functional emotions view of ambivalent and indifferent workplace relationships, Journal of Management2017;43(4):1789–819.
42.
ShenVRL, LaiHY, LaiAF. The implementation of a smartphone-based fall detection system using a high-level fuzzy petri net, Applied Soft Computing2015;26:390–400.
43.
ChengJ, ChenX, ShenM. A framework for daily activity monitoring and fall detection based on surface electromyography and accelerometer signals, IEEE Journal of Biomedical and Health Informatics2013;17(1):38–45.
44.
NashwaEB, TanQ, PivotFC, AnthonyL. Fall detection and prevention for the elderly: A review of trends and challenges, International Journal on Smart Sensing and Intelligent Systems2013;6(3):1230–66.
45.
FengW, LiuR, ZhuM. Fall detection for elderly person care in a vision-based home surveillance environment using a monocular camera, Signal, Image and Video Processing2014;8:1129–38.
46.
DelahozYS, LabradorMA. Survey on fall detection and fall prevention using wearable and external sensors, Sensors2014;14:19806–42.
47.
RougierC, MeunierJ, St-ArnaudA, RousseauJ. 3D head tracking for fall detection using a single calibrated camera, Image and Vision Computing2013;31(3):246–54.
48.
SokolovaMV, Fernandez-CaballeroA. Fuzzy decision making model for human fall detection and inactivity monitoring, Intelligent Decision Technologies2013;24(2):215–28.
49.
WebsterD, CelikO. Systematic review of Kinect applications in elderly care and stroke rehabilitation, Journal of Neuroengineering and Rehabilitation2014;11:108.
50.
KwolekB, KepskiM. Improving fall detection by the use of depth sensor and accelerometer, Neurocomputing2015;30:637–45.
51.
PoluSK. Human activity recognition on smartphones using machine learning algorithms, International Journal for Innovative Research in Science & Technology2018;5(6):31–7.
52.
HaselmanM, HauckS. The future of integrated circuits: A survey of nanoelectronics Proceedings of the IEEE2010;98(1):11–38.
53.
BianZP, HouJ, ChauLP, Magnenat-ThalmannN, Fall detection based on body part tracking using a depth camera, IEEE Journal of Biomedical and Health Informatics2015;19(2):430–9.
54.
ZagoM, KleinerAFR, FederolfPA. Editorial: Machine learning approaches to human movement analysis, Frontier in Bioengineering and Biotechnology2021;22:638793.
55.
ZhouL, FischerE, TuncaC, BrahmsCM, ErsoyC, GranacherU, et al. How we found our imu: Guidelines to IMU selection and a comparison of seven IMUs for pervasive healthcare applications, Sensors2020;20:1–28.
56.
MichalakJ, MischnatJ, TeismannT. Sitting posture makes a difference-embodiment effects on depressive memory bias, Clinical Psychology & Psychotherpy2014;21:519–24.
57.
SchiopuAF. Workplace emotions and job satisfaction, International Journal of Economic Theory2015;5:277–82.
58.
SchwartzB, KapelluschJM, SchrempfA, ProbstK, HallerM, BacaA. Effect of alternating postures on cognitive performance for healthy people performing sedentary work, Ergonomics2018;61(6):778–95.
59.
BailensonJN, PontikakisED, MaussIB, GrossJJ, JabonME, HutchersonCAC, et al. Real-time classification of evoked emotions using facial feature tracking and physiological responses, International Journal of Human-Computer Studies2008;66(5):303–17.
60.
MorganB, D’MelloS. The effect of positive vs. negative emotion on multitasking. Paper presented at the Proceed- ings of theHumanFactors and Ergonomics Society Annual Meeting. 2013;848-52.
61.
PinheiroPG, RamosJJ, DonizeteVL, PicancoP, De OliveiraGH. Workplace emotion Monitoring-An emotionoriented system hidden behind a receptionist robot. Mechatronics and Robotics Engineering for Advanced and Intelligent Manufacturing. 2017;407-20.
62.
WallT, RussellJ, MooreN. Positive emotion in workplace impact, Journal of Work-Applied Management2017;9(2):129–46.
63.
LauraP, LixinJ. Buring out? Watch your won incivility and the emotions you spread, Work2019;64(4):671–83.
64.
MutsumiT, MakotoK. Structural relationships among occupational dysfunction, stress coping, and occupational participation for healthcare workers, Work2019;64(4):833–41.
65.
ZhangJ, YinZ, ChenP, NicheleS. Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review, Information Fusion2020;59:103–26.
