As generative AI technologies advance, understanding their capability to emulate human-like experiences in marketing communication becomes crucial. This research examines whether generative AI can create experiential narratives that resonate with humans in terms of embodied cognition, affect, and lexical diversity. An automated text analysis reveals that while reviews generated by ChatGPT 3.5 exhibit lower levels of embodied cognition and lexical diversity compared with reviews by human experts, they display more positive affect (Study 1a). However, human raters struggle to notice these differences, rating half of the selected reviews from AI higher in embodied cognition and usefulness (Study 1b). Instances of hallucination in AI-generated content were detected by human raters. For social media posts, the more sophisticated ChatGPT 4 model demonstrates superior perceived lexical diversity and leads to higher purchase intentions in unbranded content compared with human copywriters (Study 2). This research evaluates the performance of large language models in generating experiential marketing narratives. The comparative studies reveal the models’ strengths in presenting positive emotions and influencing purchase intent while identifying limitations in embodied cognition and lexical diversity compared with human-authored content. The findings have implications for marketers and policy makers in understanding generative AI's potential and risks in marketing.
AlAfnanMohammad AwadMohdZukiSiti Fatimah (2023), “Do Artificial Intelligence Chatbots Have a Writing Style? An Investigation into the Stylistic Features of ChatGPT-4,” Journal of Artificial Intelligence and Technology, 3 (3), 85–94.
2.
AndersonMichael L.RichardsonMichael J.ChemeroAnthony (2012), “Eroding the Boundaries of Cognition: Implications of Embodiment,” Topics in Cognitive Science, 4 (4), 717–30.
3.
BankerSachinKhetaniSalil (2019), “Algorithm Overdependence: How the Use of Algorithmic Recommendation Systems Can Increase Risks to Consumer Well-Being,” Journal of Public Policy & Marketing, 38 (4), 500–515.
4.
BarsalouLawrence W. (2008), “Grounded Cognition,” Annual Review of Psychology, 59 (2008), 617–45.
5.
BergerJonahMilkmanKatherine L. (2012), “What Makes Online Content Viral?” Journal of Marketing Research, 49 (2), 192–205.
6.
BeverlandMichael B.FarrellyFrancis J. (2010), “The Quest for Authenticity in Consumption: Consumers’ Purposive Choice of Authentic Cues to Shape Experienced Outcomes,” Journal of Consumer Research, 36 (5), 838–56.
7.
BoydRyan L.AshokkumarAshwiniSerajSarahPennebakerJames W. (2022), The Development and Psychometric Properties of LIWC-22. University of Texas at Austin.
8.
BrakusJ. JoškoSchmittBernd H.ZarantonelloLia (2009), “Brand Experience: What Is It? How Is It Measured? Does It Affect Loyalty?” Journal of Marketing, 73 (3), 52–68.
9.
CaoYihanLiSiyuLiuYixinYanZhilingDaiYutongYuPhilip S.SunLichao (2023), “A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT,” arXiv, http://arxiv.org/abs/2303.04226.
10.
CardonaJuan F.KargiemanLucilaSinayVladimiroGershanikOscarGelorminiCarlosAmorusoLuciaRocaMaríaPinedaDavidTrujilloNataliaMichonMaëvaGarcíaAdolfo M.SzenkmanDanielaBekinschteinTristánManesFacundoIbáñezAgustín (2014), “How Embodied Is Action Language? Neurological Evidence from Motor Diseases,” Cognition, 131 (2), 311–22.
11.
Cascio RizzoGiovanni LucaBergerJonahDe AngelisMatteoPozharlievRumen (2023), “How Sensory Language Shapes Influencer’s Impact,” Journal of Consumer Research, 50 (4), 810–25.
12.
DarmawanIdaHuhJisu (2022), “The Effects of Message Type and Sponsorship Disclosure in Influencer Marketing of Prescription Drugs,” Journal of Global Marketing, 35 (1), 21–36.
13.
DavenportThomasGuhaAbhijitGrewalDhruvBressgottTimna (2020), “How Artificial Intelligence Will Change the Future of Marketing,” Journal of the Academy of Marketing Science, 48 (1), 24–42.
14.
De FreitasJulianUğuralpAhmet KaanOğuz-UğuralpZelihaPuntoniStefano (2024), “Chatbots and Mental Health: Insights into the Safety of Generative AI,” Journal of Consumer Psychology, 34 (3), 481–91.
15.
Di DomenicoGiandomenicoNunanDanielPitardiValentina (2022), “Marketplaces of Misinformation: A Study of How Vaccine Misinformation Is Legitimized on Social Media,” Journal of Public Policy & Marketing, 41 (4), 319–35.
16.
DigutschJanKosinskiMichal (2023), “Overlap in Meaning Is a Stronger Predictor of Semantic Activation in GPT-3 Than in Humans,” Scientific Reports, 13 (1), 1–7.
17.
DownesWilliam (2000), “The Language of Felt Experience: Emotional, Evaluative and Intuitive,” Language and Literature, 9 (2), 99–121.
18.
DziriNouhaMiltonSivanYuMoZaianeOsmarReddySiva (2022), “On the Origin of Hallucinations in Conversational Models: Is It the Datasets or the Models?” arXiv, http://arxiv.org/abs/2204.07931.
19.
EcklerPetyaBollsPaul (2011), “Spreading the Virus,” Journal of Interactive Advertising, 11 (2), 1–11.
20.
ElderRyan S.KrishnaAradhna (2011), “The ‘Visual Depiction Effect’ in Advertising: Facilitating Embodied Mental Simulation Through Product Orientation,” Journal of Consumer Research, 38 (6), 988–1003.
21.
EscalasJennifer Edson (2004), “Narrative Processing: Building Consumer Connections to Brands,” Journal of Consumer Psychology, 14 (1), 168–80.
22.
EU Artificial Intelligence Act (2024), “Article 50: Transparency Obligations for Providers and Deployers of Certain AI Systems,” Regulation (EU) 2024/1689, Official Journal version (June 13), interinstitutional file 2021/0106(COD), https://artificialintelligenceact.eu/article/50/.
23.
EulerichMarcSanatizadehAidaVakilzadehHamidWoodDavid A. (2023), “Is It All Hype? ChatGPT’s Performance and Disruptive Potential in the Accounting and Auditing Industries,” SSRN (November 17), https://papers.ssrn.com/abstract=4452175.
GoliAliSinghAmandeep (2024), “Frontiers: Can Large Language Models Capture Human Preferences?” Marketing Science, 43 (4), 709–22.
26.
HerboldSteffenHautli-JaniszAnnetteHeuerUteKiktevaZlataTrautschAlexander (2023), “A Large-Scale Comparison of Human-Written Versus ChatGPT-Generated Essays,” Scientific Reports, 13 (1), 18617.
27.
HolidayStevenHayesJameson L.ParkHaseonLyuYuanweiZhouYang (2023), “A Multimodal Emotion Perspective on Social Media Influencer Marketing: The Effectiveness of Influencer Emotions, Network Size, and Branding on Consumer Brand Engagement Using Facial Expression and Linguistic Analysis,” Journal of Interactive Marketing, 58 (4), 414–39.
28.
HuangMing-HuiRustRoland T. (2018), “Artificial Intelligence in Service,” Journal of Service Research, 21 (2), 155–72.
29.
JarvisScott (2013), “Capturing the Diversity in Lexical Diversity,” Language Learning, 63 (s1), 87–106.
30.
JohnsonWendell (1944), “Studies in Language Behavior: A Program of Research,” Psychological Monographs, 56 (2), 1–15.
KimDonggyuWangZituo (2023), “The Ethics of Virtuality: Navigating the Complexities of Human-Like Virtual Influencers in the Social Media Marketing Realm,” Frontiers in Communication, 8, 1205610.
33.
KrishnaAradhnaSchwarzNorbert (2014), “Sensory Marketing, Embodiment, and Grounded Cognition: A Review and Introduction,” Journal of Consumer Psychology, 24 (2), 159–68.
34.
KumarAshishBezawadaRamRishikaRishikaJanakiramanRamkumarKannanP.K. (2016), “From Social to Sale: The Effects of Firm-Generated Content in Social Media on Customer Behavior,” Journal of Marketing, 80 (1), 7–25.
35.
KwonMinaAdavalRashmi (2018), “Going Against the Flow: The Effects of Dynamic Sensorimotor Experiences on Consumer Choice,” Journal of Consumer Research, 44 (6), 1358–78.
36.
Lermann HenestrosaAngelicaGrevingHannahKimmerleJoachim (2023), “Automated Journalism: The Effects of AI Authorship and Evaluative Information on the Perception of a Science Journalism Article,” Computers in Human Behavior, 138, 107445.
37.
LiPeiyaoCasteloNoahKatonaZsoltSarvaryMiklos (2024), “Frontiers: Determining the Validity of Large Language Models for Automated Perceptual Analysis,” Marketing Science, 43 (2), 254–66.
38.
LiangGongboGuerreroJesusZhengFengboAlsmadiIzzat (2023), “Enhancing Neural Text Detector Robustness with μAttacking and RR-Training,” Electronics, 12 (8), 1948.
39.
LiangPaul PuWuChiyuMorencyLouis-PhilippeSalakhutdinovRuslan (2021), “Towards Understanding and Mitigating Social Biases in Language Models,” Proceedings of the 38th International Conference on Machine Learning, PMLR, 139, 6565–76, https://proceedings.mlr.press/v139/liang21a.html.
40.
LibaiBarakBartYakovGenslerSonjaHofackerCharles F.KaplanAndreasKötterheinrichKimKrollEike Benjamin (2020), “Brave New World? On AI and the Management of Customer Relationships,” Journal of Interactive Marketing, 51 (1), 44–56.
41.
Liu-ThompkinsYupingOkazakiShintaroLiHairong (2022), “Artificial Empathy in Marketing Interactions: Bridging the Human-AI Gap in Affective and Social Customer Experience,” Journal of the Academy of Marketing Science, 50 (6), 1198–218.
42.
LiuXiaohuiJiangNaZhaoHaipingLimEricTanChee-Wee (2023), “Describing Your Podcasts: Disentangling the Effects of Linguistic Features in Bolstering Online Learners’ Engagement with Podcasters,” PACIS 2023 Proceedings, 194, https://aisel.aisnet.org/pacis2023/194.
43.
LiuAngela XiaXieYingZhangJurui (2019), “It’s Not Just What You Say, But How You Say It: The Effect of Language Style Matching on Perceived Quality of Consumer Reviews,” Journal of Interactive Marketing, 46 (1), 70–86.
44.
LovettMitchell J.PeresRenanaShacharRon (2013), “On Brands and Word of Mouth,” Journal of Marketing Research, 50 (4), 427–44.
45.
LynchChristopher J.JensenErik J.ZamponiVirginiaO’BrienKevinFrydenlundErikaGoreRoss (2023), “A Structured Narrative Prompt for Prompting Narratives from Large Language Models: Sentiment Assessment of ChatGPT-Generated Narratives and Real Tweets,” Future Internet, 15 (12), 375.
46.
MaLiyeSunBaohong (2020), “Machine Learning and AI in Marketing – Connecting Computing Power to Human Insights,” International Journal of Research in Marketing, 37 (3), 481–504.
47.
MahowaldKyleIvanovaAnna A.BlankIdan A.KanwisherNancyTenenbaumJoshua B.FedorenkoEvelina (2023), “Dissociating Language and Thought in Large Language Models,” arXiv, http://arxiv.org/abs/2301.06627.
48.
MalekiNegarPadmanabhanBalajiDuttaKaushik (2024), “AI Hallucinations: A Misnomer Worth Clarifying,” arXiv, http://arxiv.org/abs/2401.06796.
49.
McCarthyPhilip M.JarvisScott (2010), “MTLD, Vocd-D, and HD-D: A Validation Study of Sophisticated Approaches to Lexical Diversity Assessment,” Behavior Research Methods, 42 (2), 381–92.
50.
MendeMartinUbalValentina O.CozacMarinaVallenBethBerryChristopher (2024), “Fighting Infodemics: Labels as Antidotes to Mis- and Disinformation?!” Journal of Public Policy & Marketing, 43 (1), 31–52.
51.
MishraChinmayaVerdonschotRinusHagoortPeterSkantzeGabriel (2023), “Real-Time Emotion Generation in Human-Robot Dialogue Using Large Language Models,” Frontiers in Robotics and AI, 10, 1271610.
52.
MoraPierreMoscarolaJean (2010), “Representations of the Emotions Associated with a Wine Purchasing or Consumption Experience,” International Journal of Consumer Studies, 34 (6), 674–83.
53.
NunesJoseph C.OrdaniniAndreaValsesiaFrancesca (2015), “The Power of Repetition: Repetitive Lyrics in a Song Increase Processing Fluency and Drive Market Success,” Journal of Consumer Psychology, 25 (2), 187–99.
RahamanMd. SaidurTahmid AhsanM.M.AnjumNishathTeranoHarold Jan R.Mizanur RahmanMd. (2023), “From ChatGPT-3 to GPT-4: A Significant Advancement in Ai-Driven NLP Tools,” Journal of Engineering and Emerging Technologies, 2 (1), 1–11.
58.
RawteVipulaShethAmitDasAmitava (2023), “A Survey of Hallucination in Large Foundation Models,” arXiv, http://arxiv.org/abs/2309.05922.
59.
RayPartha Pratim (2023), “ChatGPT: A Comprehensive Review on Background, Applications, Key Challenges, Bias, Ethics, Limitations and Future Scope,” Internet of Things and Cyber-Physical Systems, 3, 121–54.
60.
RocklageMatthew D.FazioRussell H. (2020), “The Enhancing Versus Backfiring Effects of Positive Emotion in Consumer Reviews,” Journal of Marketing Research, 57 (2), 332–52.
61.
RocklageMatthew D.RuckerDerek D.NordgrenLoran F. (2021), “Emotionally Numb: Expertise Dulls Consumer Experience,” Journal of Consumer Research, 48 (3), 355–73.
62.
RussellJames A. (2003), “Core Affect and the Psychological Construction of Emotion,” Psychological Review, 110 (1), 145–72.
SrivastavaAarohiRastogiAbhinavRaoAbhishekShoebAbu Awal MdAbidAbubakarFischAdamBrownAdam R.SantoroAdamGuptaAdityaGarriga-AlonsoAdriàKluskaAgnieszkaLewkowyczAitorAgarwalAkshatPowerAletheaRayAlexWarstadtAlexKocurekAlexander W.SafayaAliTazarvAliXiangAlice, et al. (2022), “Beyond the Imitation Game: Quantifying and Extrapolating the Capabilities of Language Models,” arXiv, https://doi.org/10.48550/arXiv.2206.04615.
66.
TakAla N.GratchJonathan (2023), “Is GPT a Computational Model of Emotion? Detailed Analysis,” arXiv, http://arxiv.org/abs/2307.13779.
67.
TakagiSoshiWatariTakashiErabiAyanoSakaguchiKota (2023), “Performance of GPT-3.5 and GPT-4 on the Japanese Medical Licensing Examination: Comparison Study,” JMIR Medical Education, 9 (1), e48002.
68.
TsengRaydenVerberneSuzanvan der PuttenPeter (2023), “ChatGPT as a Commenter to the News: Can LLMs Generate Human-Like Opinions?” in Disinformation in Open Online Media, CeolinDavideCaselliTommasoTulinMarina, eds. Springer Nature, 160–74.
69.
UllmanTomer (2023), “Large Language Models Fail on Trivial Alterations to Theory-of-Mind Tasks,” arXiv, http://arxiv.org/abs/2302.08399.
WebbTaylorHolyoakKeith J.LuHongjing (2023), “Emergent Analogical Reasoning in Large Language Models,” Nature Human Behaviour, 7 (9), 1526–41.
72.
WeberT.J.HydockChrisDingWilliamGardnerMerylJacobPradeepMandelNaomiSprottDavid E.Van SteenburgEric (2021), “Political Polarization: Challenges, Opportunities, and Hope for Consumer Welfare, Marketers, and Public Policy,” Journal of Public Policy & Marketing, 40 (2), 184–205.
XuQihuiPengYingyingNastaseSamuel A.ChodorowMartinWuMinghuaLiPing (2023), “Does Conceptual Representation Require Embodiment? Insights from Large Language Models,” arXiv, http://arxiv.org/abs/2305.19103.
75.
ZhouXinyueYanXiaoJiangYuwei (2023), “Making Sense? The Sensory-Specific Nature of Virtual Influencer Effectiveness,” Journal of Marketing, 88 (4), 84–106.
76.
ZhuFengZhangXiaoquan (Michael) (2010), “Impact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics,” Journal of Marketing, 74 (2), 133–48.
77.
ZhuangYanLiuQiNingYutingHuangWeizheLvRuiHuangZhenyaZhaoGuanhaoZhangZhengMaoQingyangWangShijinChenEnhong (2023), “Efficiently Measuring the Cognitive Ability of LLMs: An Adaptive Testing Perspective,” arXiv, http://arxiv.org/abs/2306.10512.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
