Safety perception and pedestrian dynamics: Experimental results towards affective agents modeling

Abstract

The modeling of a new generation of agent-based simulation systems supporting pedestrian and crowd management taking into account affective states represents a new research frontier. Pedestrian behaviour involves human perception processes, based on subjective and psychological aspects. Following the concept of pedestrian environmental awareness, each walker adapts his/her crossing behaviour according to environmental conditions and his/her perception of safety. Different pedestrian behaviours can be related to subjective mobility and readiness to respond, and these factors are strongly dependent on the subjective interaction with the environment. Having additional inputs about pedestrian behaviour related to their perception processes could be useful in order to develop a more representative pedestrian dynamic model. In particular, the subjective perception of the safeness of crossing should be taken into consideration. In order to focus on the pedestrians’ perception of safe road crossing and walking, an experiment in an uncontrolled urban scenario has been carried out. Besides more conventional self-assessment questionnaires, physiological responses have been considered to evaluate the affective state of pedestrians during the interaction with the urban environment. Results from the analysis of the collected data show that physiological responses are reliable indicators of safety perception while road crossing and interacting with real urban environment, suggesting the design of agent-based models for pedestrian dynamics simulations taking in account the representation of affective states.

Keywords

Agent modeling experimental approach pedestrians physiological data

Get full access to this article

View all access options for this article.

References

Adam,

Canal,

Gaudou,

H.T.

Vinh,

Taillandieret al., Simulation of the emotion dynamics in a group of agents in an evacuation situation, in: International Conference on Principles and Practice of Multi-Agent Systems, Springer, 2010, pp. 604–619.

Alhagry,

A.A.

Fahmy and

R.A.

El-Khoribi, Emotion recognition based on EEG using LSTM recurrent neural network, Emotion8(10) (2017), 355–358.

Bandini,

Fontana,

Gasparini and

Sorrenti, Interaction autonomous vehicle–pedestrian: Dynamic vehicle behaviour as a function of subjective safety perception, in: IEEE International Conference on Robot & Human Interactive Communication ROMAN-2020, 2020.

Bandini and

Gasparini, Towards affective walkability for healthy ageing in the future of the cities, in: Proc. 5th Workshop on Artificial Intelligence for Ambient Assisted Living (AIxIA 2019), Vol. 2559, CEUR-WS, 2020.

Boltes,

Chraibi,

Holl,

Kemloh Wagoum,

Lämmel,

Liao,

Mehner,

Tordeux and

Zhang, Experimentation, data collection, modeling and simulation of pedestrian dynamics, in: Statistics, Probability and Numerical Analysis, 2014, pp. 49–60.

Burns,

E.P.

Doheny,

B.R.

Greene,

Foran,

Leahy,

O’Donovan and

M.J.

McGrath, SHIMMER™: An extensible platform for physiological signal capture, in: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, IEEE, 2010, pp. 3759–3762. doi:10.1109/IEMBS.2010.5627535.

Y.S.

Can,

Arnrich and

Ersoy, Stress detection in daily life scenarios using smart phones and wearable sensors: A survey, Journal of Biomedical Informatics (2019), 103139. doi:10.1016/j.jbi.2019.103139.

Colombi and

Scianna, Modelling human perception processes in pedestrian dynamics: A hybrid approach, Royal Society Open Science4(3) (2017), 160561. doi:10.1098/rsos.160561.

Colombi,

Scianna and

Alaia, A discrete mathematical model for the dynamics of a crowd of gazing pedestrians with and without an evolving environmental awareness, Computational and Applied Mathematics36(2) (2017), 1113–1141. doi:10.1007/s40314-016-0316-x.

10.

Dedovic,

Renwick,

N.K.

Mahani,

Engert,

S.J.

Lupien and

J.C.

Pruessner, The Montreal Imaging Stress Task: Using functional imaging to investigate the effects of perceiving and processing psychosocial stress in the human brain, Journal of Psychiatry and Neuroscience30(5) (2005), 319.

11.

Feliciani,

Crociani,

Gorrini,

Vizzari,

Bandini and

Nishinari, A simulation model for non-signalized pedestrian crosswalks based on evidence from on field observation, Intelligenza Artificiale11(2) (2017), 117–138. doi:10.3233/IA-170110.

12.

Feliciani,

Gorrini,

Crociani,

Vizzari,

Nishinari and

Bandini, Calibration and validation of a simulation model for predicting pedestrian fatalities at unsignalized crosswalks by means of statistical traffic data, Journal of Traffic and Transportation Engineering (English Edition)7(1) (2020), 1–18.

13.

Fu,

Song,

Lv,

Liu and

Lo, Multi-grid simulation of counter flow pedestrian dynamics with emotion propagation, Simulation Modelling Practice and Theory60 (2016), 1–14. doi:10.1016/j.simpat.2015.09.007.

14.

Gasparini,

Giltri and

Bandini, Discriminating affective state intensity using physiological responses, Multimedia Tools and Applications (2020), 1–21.

15.

Gasparini,

Grossi,

Nishinari and

Bandini, EMG for walkability assessment: A comparison between elderly and young adults, in: Proc. Workshop on Artificial Intelligence for an Ageing Society (AIxAS 2020), CEUR-WS, 2020.

16.

Gasparini,

Toffanin,

Campioni,

DiMarla,

Borghi and

Bandini, In-vivo experiments for walkability assessment in elderly people, in: Proc. Workshop on Artificial Intelligence for an Ageing Society (AIxAS 2020), CEUR-WS, 2020.

17.

Ghaderi,

Frounchi and

Farnam, Machine learning-based signal processing using physiological signals for stress detection, in: 2015 22nd Iranian Conference on Biomedical Engineering (ICBME), IEEE, 2015, pp. 93–98. doi:10.1109/ICBME.2015.7404123.

18.

Gorrini,

Crociani,

Vizzari and

Bandini, Observation results on pedestrian–vehicle interactions at non-signalized intersections towards simulation, Transportation Research Part F: Traffic Psychology and Behaviour59 (2018), 269–285. doi:10.1016/j.trf.2018.09.016.

19.

Hernandez,

R.R.

Morris and

R.W.

Picard, Call center stress recognition with person-specific models, in: International Conference on Affective Computing and Intelligent Interaction, Springer, 2011, pp. 125–134. doi:10.1007/978-3-642-24600-5_16.

20.

Hernando-Gallego and

Artés-Rodríguez, Individual performance calibration using physiological stress signals, arXiv preprint, arXiv:1507.03482, 2015.

21.

Hollmann,

Lawrence and

Galea, Introducing emotion modelling to agent-based pedestrian circulation simulation, in: Pedestrian and Evacuation Dynamics, Springer, 2011, pp. 799–803. doi:10.1007/978-1-4419-9725-8_77.

22.

E.G.

Kehoe,

J.M.

Toomey,

J.H.

Balsters and

A.L.

Bokde, Personality modulates the effects of emotional arousal and valence on brain activation, Social Cognitive and Affective Neuroscience7(7) (2012), 858–870. doi:10.1093/scan/nsr059.

23.

Kim and

André, Emotion recognition based on physiological changes in music listening, IEEE Transactions on Pattern Analysis and Machine Intelligence30(12) (2008), 2067–2083. doi:10.1109/TPAMI.2008.26.

24.

R.S.

Lazarus and

Folkman, Stress, Appraisal, and Coping, Springer Publishing Company, 1984.

25.

Leite,

M.S.

Dias,

Eloy,

Freitas,

Marques,

Pedro and

Ourique, Physiological arousal quantifying perception of safe and unsafe virtual environments by older and younger adults, Sensors19(11) (2019), 2447.

26.

Liu,

Zeng,

Chen and

Wu, A microscopic simulation model for pedestrian–pedestrian and pedestrian–vehicle interactions at crosswalks, PLoS One12(7) (2017). doi:10.1371/journal.pone.0236654.

27.

Ortony,

G.L.

Clore and

Collins, The Cognitive Structure of Emotions, Cambridge University Press, 1990.

28.

Pelechano,

J.M.

Allbeck and

N.I.

Badler, Controlling individual agents in high-density crowd simulation, 2007.

29.

Pelechano,

O’Brien,

Silverman and

Badler, Crowd simulation incorporating agent psychological models, roles and communication, Technical Report, Pennsylvania Univ. Philadelphia Center for Human Modeling and Simulation, 2005.

30.

R.W.

Picard, Affective Computing, MIT Press, 2000.

31.

Pudane,

Lavendelis and

M.A.

Radin, Human emotional behavior simulation in intelligent agents: Processes and architecture, Procedia Computer Science104 (2017), 517–524. doi:10.1016/j.procs.2017.01.167.

32.

Riaz and

M.A.

Niazi, Enhanced emotion enabled cognitive agent-based rear-end collision avoidance controller for autonomous vehicles, Simulation94(11) (2018), 957–977. doi:10.1177/0037549717742203.

33.

T.F.

Rodrigues Lucena,

S.R.

Fleury Rosa,

C.J.

Miosso,

da Silva Torres,

Krueger and

D.M.G.

Domingues, Walking and health: An enactive affective system, Digital Creativity27(4) (2016), 314–333. doi:10.1080/14626268.2016.1262430.

34.

Rosenberg, The association between self-esteem and anxiety, Journal of Psychiatric Research (1962).

35.

Sakellariou,

Kefalas,

Savvidou,

Stamatopoulou and

Ntika, The role of emotions, mood, personality and contagion in multi-agent system decision making, in: IFIP International Conference on Artificial Intelligence Applications and Innovations, Springer, 2016, pp. 359–370. doi:10.1007/978-3-319-44944-9_31.

36.

Sano and

R.W.

Picard, Stress recognition using wearable sensors and mobile phones, in: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, IEEE, 2013, pp. 671–676. doi:10.1109/ACII.2013.117.

37.

Santamaria-Granados,

Munoz-Organero,

Ramirez-Gonzalez,

Abdulhay and

Arunkumar, Using deep convolutional neural network for emotion detection on a physiological signals dataset (AMIGOS), IEEE Access7 (2018), 57–67. doi:10.1109/ACCESS.2018.2883213.

38.

Setz,

Arnrich,

Schumm,

La Marca,

Tröster and

Ehlert, Discriminating stress from cognitive load using a wearable EDA device, IEEE Transactions on Information Technology in Biomedicine14(2) (2009), 410–417. doi:10.1109/TITB.2009.2036164.

39.

Shi,

M.H.

Nguyen,

Blitz,

French,

Fisk,

De la Torre,

Smailagic,

D.P.

Siewiorek,

al’Absi,

Ertinet al., Personalized stress detection from physiological measurements, in: International Symposium on Quality of Life Technology, 2010, pp. 28–29.

40.

Sioni and

Chittaro, Stress detection using physiological sensors, Computer48(10) (2015), 26–33. doi:10.1109/MC.2015.316.

41.

Subramanian,

Wache,

M.K.

Abadi,

R.L.

Vieriu,

Winkler and

Sebe, ASCERTAIN: Emotion and personality recognition using commercial sensors, IEEE Transactions on Affective Computing9(2) (2018), 147–160. doi:10.1109/TAFFC.2016.2625250.

42.

Thiel-Clemen,

Köster and

Sarstedt, Walk-emotion-based pedestrian movement simulation in evacuation scenarios, in: Simulation in Umwelt-und Geowissenschaften: Workshop, Shaker Verlag, Berlin, Germany, 2011, pp. 103–112.

43.

Tonacci,

Dellabate,

Dieni,

Bachi,

Sansone,

Conte and

Billeci, Can machine learning predict stress reduction based on wearable sensors’ data following relaxation at workplace? A pilot study, Processes8(4) (2020), 448. doi:10.3390/pr8040448.

44.

Tsai,

Fridman,

Bowring,

Brown,

Epstein,

G.A.

Kaminka,

Marsella,

Ogden,

Rika,

Sheelet al., ESCAPES: Evacuation simulation with children, authorities, parents, emotions, and social comparison, in: AAMAS, 2011, pp. 457–464.

45.

Valenza,

Lanata and

E.P.

Scilingo, The role of nonlinear dynamics in affective valence and arousal recognition, IEEE Transactions on Affective Computing3(2) (2011), 237–249. doi:10.1109/T-AFFC.2011.30.

46.

von Scheve and

Salmella, Collective Emotions, OUP, Oxford, 2014.

47.

Ward,

Marsden,

Cahill and

Johnson, Physiological responses to well-designed and poorly designed interfaces, in: Proceedings of CHI 2002 Workshop on Physiological Computing, 2002.

48.

World Health Organization, Global Age-Friendly Cities: A Guide, World Health Organization, 2007.

49.

Xia,

de Godoy Peixoto,

Islam,

M.T.

Islam,

Nirjon,

P.R.

Kinget and

Jiang, Improving pedestrian safety in cities using intelligent wearable systems, IEEE Internet of Things Journal6(5) (2019), 7497–7514. doi:10.1109/JIOT.2019.2903519.

50.

A.K.

Yetisen,

J.L.

Martinez-Hurtado,

Ünal,

Khademhosseini and

Butt, Wearables in medicine, Advanced Materials30(33) (2018), 1706910. doi:10.1002/adma.201706910.

51.

Zoumpoulaki,

Avradinis and

Vosinakis, A multi-agent simulation framework for emergency evacuations incorporating personality and emotions, in: Hellenic Conference on Artificial Intelligence, Springer, 2010, pp. 423–428.