The rapid development of automated vehicles offers promising avenues to enhance user experience and safety by integrating empathic in-vehicle interfaces. The report from the workshop Emotion GaRage series, held during the AutomotiveUI ’23 conference, investigates the potential of employing generative artificial intelligence (AI) to develop these empathic interfaces. Our workshop emphasized the importance of emotion recognition and regulation for passengers in driving contexts and the role of future in-vehicle empathic interfaces. Through collaborative design sessions, participants developed personalized in-vehicle agents to address drivers’ emotional states to improve safety and enjoyment. We explored insights by investigating the potential and possibilities of using generative AI in the design process. This report discusses the significance of empathic displays in facilitating the adoption of automated vehicles and explores the potential and limitations of using generative AI in the design phases.
AlawidaM.MejriS.MehmoodA.ChikhaouiB.AbiodunO. I. (2023). A comprehensive study of ChatGPT: Advancements, limitations, and ethical considerations in natural language processing and cybersecurity. Information, 14(8), 462.
2.
AlsaidA.LeeJ. D.NoejovichS. I.ChehadeA. (2023). The effect of vehicle automation styles on drivers’ emotional state. IEEE Transactions on Intelligent Transportation Systems, 24(4), 3963–3973.
3.
BoschE.KäthnerD.JippM.DrewitzU.IhmeK. (2023). Fifty shades of frustration: Intra-and interindividual variances in expressing frustration. Transportation Research Part F: Traffic Psychology and Behaviour, 94, 436–452.
4.
BoschE.OehlM.JeonM.AlvarezI.HealeyJ.JuW.JallaisC. (2018). Emotional GaRage: A workshop on in-car emotion recognition and regulation. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (pp. 44–49).
5.
BraunM.WeberF.AltF. (2021). Affective automotive user interfaces—Reviewing the state of driver affect research and emotion regulation in the car. ACM Computing Surveys, 54(7), 1–26.
6.
ChoeM.JeonM. (2023). “I see you”: Comparing the effects of affective empathy and cognitive empathy on drivers’ affective states and driving behavior in frustrating driving contexts. Adjunct proceedings of the 15th international conference on automotive user interfaces and interactive vehicular applications (pp. 121–126). ACM.
7.
ChoeM.BoschE.DongJ.AlvarezI.OehlM.JallaisC.AlsaidA.NadriC.JeonM. (2023). Emotion GaRage Vol. IV: Creating empathic in-vehicle interfaces with generative AIs for automated vehicle contexts. Adjunct proceedings of the 15th international conference on automotive user interfaces and interactive vehicular applications (pp. 234–236). ACM.
8.
DevlinJ.ChangM.-W.LeeK.ToutanovaK. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 4171–4186). Association for Computational Linguistics.
9.
DongJ.NadriC.AlvarezI.DielsC.LeeM.LiJ.LiaoP. H.MangerC.SadeghianS.SchussM.JeonM. (2023). Play your anger: A report on the empathic in-vehicle interface workshop. Adjunct proceedings of the 15th international conference on automotive user interfaces and interactive vehicular applications (pp. 168–173). ACM.
10.
HermannE. (2022). Artificial intelligence and mass personalization of communication content—An ethical and literacy perspective. New Media & Society, 24(5), 1258–1277.
11.
HuberA.WeissA.RauhalaM. (2016). The ethical risk of attachment: How to identify, investigate and predict potential ethical risks in the development of social companion robots. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (pp. 367–374). IEEE.
12.
InturriG.Le PiraM.GiuffridaN.IgnaccoloM.PluchinoA.RapisardaA.D’AngeloR. (2019). Multi-agent simulation for planning and designing new shared mobility services. Research in Transportation Economics, 73, 34–44.
13.
JeonM.WalkerB. N. (2011). What to detect?: Analyzing factor structures of affect in driving contexts for an emotion detection and regulation system. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 55(1), 1889–1893.
14.
LiX.ZhangT. (2017). An exploration on artificial intelligence application: From security, privacy and ethic perspective. In 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA) (pp. 416–420). IEEE.
15.
LiuJ. (2022). Artificial intelligence humor in service recovery. Annals of Tourism Research, 95, 103439.
16.
LuxtonD. D. (2014). Recommendations for the ethical use and design of artificial intelligent care providers. Artificial Intelligence in Medicine, 62(1), 1–10.
17.
MaghsudiS.LanA.XuJ.van Der SchaarM. (2021). Personalized education in the artificial intelligence era: What to expect next. IEEE Signal Processing Magazine, 38(3), 37–50.
18.
McDuffD.CzerwinskiM. (2018). Designing emotionally sentient agents. Communications of the ACM, 61(12), 74–83.
NadriC.LiJ.BoschE.OehlM.AlvarezI.BraunM.JeonM. (2020). Emotion GaRage Vol. II: A workshop on affective in-vehicle display design. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (pp. 106–108). ACM.
21.
NadriC.AlvarezI.BoschE.OehlM.BraunM.HealeyJ.JallaisC.JuW.LiJ.JeonM. (2022). Empathic vehicle design: Use cases and design directions from two workshops. In Extended abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (Article 456, pp. 1–7). ACM.
22.
OehlM.IhmeK.PapeA.-A.VukelićM.BraunM. (2020). Affective use cases for empathic vehicles in highly automated driving: Results of an expert workshop. In HCI in mobility, transport, and automotive systems: Automated driving and in-vehicle experience design (pp. 89–100). Springer.
23.
OpenAI. (2023a). ChatGPT: Language model (Version GPT-4). Retrieved from https://www.openai.com
OppenlaenderJ. (2022). The creativity of text-to-image generation. In Proceedings of the 25th International Academic Mindtrek Conference (pp. 192–202). ACM.
26.
RyanM. (2020). In AI we trust: Ethics, artificial intelligence, and reliability. Science and Engineering Ethics, 26(5), 2749–2767.
27.
SAE On-Road Automated Driving (ORAD) Committee. (2021). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles (SAE Standard J3016_202104).
28.
WangS.CorreiaG. H. A.LinH. X. (2019). Exploring the performance of different on-demand transit services provided by a fleet of shared automated vehicles: An agent-based model. Journal of Advanced Transportation, 2019, Article ID 7878042.
29.
YinH.ZhangZ.LiuY. (2023). The exploration of integrating the Midjourney artificial intelligence generated content tool into design systems to direct designers towards future-oriented innovation. Systems, 11(12), 566.
30.
ZiegerS.DongJ.TaylorS.SanfordC.JeonM. (2023). Happiness and high reliability develop affective trust in in-vehicle agents. Frontiers in Psychology, 14, 1129294.
