ChatGPT as the Ultimate Travel Buddy or Research Assistant: A Study on Perceived Attitudes and Usability

Abstract

The purpose of this study was to investigate participants’ perceived attitudes and usability with OpenAI’s ChatGPT AI chatbot. Participants were asked to watch screen recorded videos of a researcher exploring the AI’s ability to create a quantum mechanics experiment and to plan a trip to New York City. Thirty percent of participants had previously used the AI before the study. Attitudes towards the AI were in the middle of the scale, and prior use did not affect these attitudes. Additionally, ratings on usability were higher for planning a trip compared to creating an experiment, but no differences were found depending on prior use. Future research should examine attitudes and usability when participants interact with the AI chatbot directly in different scenarios. The study also emphasizes the need to examine the potential effects of AI on user experience, and safety, given the prevalence of ChatGPT in the general population.

Keywords

artificial intelligence usability attitudes ChatGPT

Get full access to this article

View all access options for this article.

References

Brooke

(1996). SUS-A quick and dirty usability scale. Usability evaluation in industry, 189(194), 4-7.

Brown

Mann

Ryder

Subbiah

Kaplan

J. D.

Dhariwal

… Amodei

(2020). Language models are few-shot learners. Advances in neural information processing systems, 33, 1877-1901.

Cerullo

(2023, February 1). Chatgpt is growing faster than TikTok. CBS News. Retrieved February 24, 2023, from https://www.cbsnews.com/news/chatgpt-chatbot-tiktok-ai-artificial-intelligence/

Cookup AI. (2023). CHATGPT use cases. Cookup AI. Retrieved February 24, 2023, from https://cookup.ai/chatgpt/usecases/

DeGusta

(2012, May 9). Are smart phones spreading faster than any technology in human history? MIT Technology Review. Retrieved February 27, 2023, from https://www.technologyreview.com/2012/05/09/186160/are-smart-phones-spreading-faster-than-any-technology-in-human-history/

Forbes. Retrieved February 25, 2023, from https://www.forbes.com/sites/lanceeliot/2023/02/23/is-it-true-that-generative-ai-chatgpt-will-flood-the-internet-with-infinite-content-asks-ai-ethics-and-ai-law/?sh=763657364893

Glikson

Woolley

A. W.

(2020). Human trust in artificial intelligence: Review of empirical research. Academy of Management Annals, 14(2), 627-660.

Experiment . (2023). YouTube. Retrieved February 25, 2023, from https://youtu.be/HDj7ehlkO9U.

Hallur

G. G.

Prabhu

Aslekar

(2021). Entertainment in era of AI, big data & IoT. Digital Entertainment: The Next Evolution in Service Sector, 87-109.

10.

Harborth

Kreuz

(2020). Exploring the attitude formation process of individuals towards new technologies: the case of augmented reality. International Journal of Technology Marketing, 14(2), 125-153.

11.

Harmon

S. A.

Sanford

T. H.

Turkbey

E. B.

Roth

… Turkbey

(2020). Artificial intelligence for the detection of COVID-19 pneumonia on chest CT using multinational datasets. Nature communications, 11(1), 4080.

12.

Ikkatai

Hartwig

Takanashi

Yokoyama

H. M.

(2022). Octagon measurement: Public attitudes toward AI ethics. International Journal of Human–Computer Interaction, 38(17), 1589-1606.

13.

Karsh

B. T.

(2004). Beyond usability: designing effective technology implementation systems to promote patient safety. BMJ Quality & Safety, 13(5), 388-394.

14.

McLellan

Muddimer

Peres

S. C.

(2012). The effect of experience on system usability scale ratings. Journal of usability studies, 7(2), 56-67.

15.

Milmo

(2023, February 2). CHATGPT reaches 100 million users two months after launch. The Guardian. Retrieved February 24, 2023, from https://www.theguardian.com/technology/2023/feb/02/chatgpt-100-million-users-open-ai-fastest-growing-app

16.

OpenAI. (2021, June 18). OpenAI. Retrieved February 25, 2023, from https://openai.com/

17.

Ortiz

(2023, February 24). What is Microsoft’s New Bing with CHATGPT? Here’s everything we know. ZDNET. Retrieved February 27, 2023, from https://www.zdnet.com/article/what-is-microsofts-new-bing-with-chatgpt-heres-everything-we-know/

18.

Osoba

O. A.

Welser

IV . (2017). An intelligence in our image: The risks of bias and errors in artificial intelligence. Rand Corporation.

19.

Petkauskas

(2023, February 17). Chatgpt’s answers could be nothing but a hallucination. Cybernews. Retrieved February 28, 2023, from https://cybernews.com/tech/chatgpts-bard-ai-answers-hallucination/

20.

Pinto dos Santos

Giese

Brodehl

Chon

S. H.

Staab

Kleinert

… Baeßler

(2019). Medical students’ attitude towards artificial intelligence: a multicentre survey. European radiology, 29, 1640-1646.

21.

Prolific. (2014). Quickly find research participants you can trust. Retrieved 2022, from https://www.prolific.co/

22.

Rainie

Funk

Anderson

Tyson

(2022, March 18). 1. How Americans think about artificial intelligence. Pew Research Center: Internet, Science & Tech. Retrieved February 25, 2023, from https://www.pewresearch.org/internet/2022/03/17/how-americans-think-about-artificial-intelligence/

23.

Sauro

(2011). Does prior experience affect perceptions of usability? Retrieved February 2023 from https://measuringu.com/prior-exposure/

24.

Schepman

Rodway

(2020). Initial validation of the general attitudes towards Artificial Intelligence Scale. Computers in human behavior reports, 1, 100014.

25.

Sonderegger

Sauer

(2010). The influence of design aesthetics in usability testing: Effects on user performance and perceived usability. Applied ergonomics, 41(3), 403-410.

26.

Stephanidis

Salvendy

Antona

Chen

J. Y.

Dong

Duffy

V. G.

… Zhou

(2019). Seven HCI grand challenges. International Journal of Human–Computer Interaction, 35(14), 1229-1269.

27.

Stoneman

Battisti

(2010). The diffusion of new technology. In Handbook of the Economics of Innovation (Vol. 2, pp. 733-760). North-Holland.

28.

Travels . (2023). YouTube. Retrieved February 25, 2023, from https://youtu.be/pa_emVpXZgM.