Sage Journals: Discover world-class research

Abstract

The emergence of Generative Artificial Intelligence (GAI) has caused significant disruption to the traditional educational teaching ecosystem. GAI possesses remarkable capabilities in generating human-like text and boasts an extensive knowledge repository, thereby paving the way for potential collaboration with humans. However, current research on collaborating with GAI within the educational context remains insufficient and the methods are relatively limited. This study aims to utilize methods such as Lag Sequential Analysis (LSA) and Epistemic Network Analysis (ENA) to unveil the “black box” of the human-machine collaborative process. In this research, 22 students engaged in collaborative tasks with GAI to refine instructional design schemes within an authentic classroom setting. The results show that the participants significantly improved the quality of instructional design. Leveraging the improvement demonstrated in students’ instructional design performance, we categorized them into high- and low-performance groups. Through the analysis of learning behavior, it was observed that the high-performance group adhered to a structured GAI content application framework: “generate → monitor → apply → evaluate.” Moreover, they adeptly employed communication strategies emphasizing exercising cognitive agency and actively cultivating a collaborative environment. The conclusions drawn from this research may serve as a reference for a series of practical applications in human-machine collaboration and provide directions for subsequent studies.

Keywords

generative artificial intelligence instructional design human-computer collaboration lag sequence analysis epistemic network analysis

Get full access to this article

View all access options for this article.

References

Alkaissi

McFarlane

S. I.

(2023). Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus, 15(2), e35179. https://doi.org/10.7759/cureus.35179

Bakeman

Quera

(2011). Sequential analysis and observational methods for the behavioral sciences. Cambridge University Press.

Bašić

Ž.

Banovac

Kružić

Jerković

(2023). ChatGPT-3.5 as writing assistance in students’ essays. Humanities and Social Sciences Communications, 10(1), 750–755. https://doi.org/10.1057/s41599-023-02269-7

Brown

Mann

Ryder

Subbiah

Kaplan

J. D.

Dhariwal

, et al. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.

Carvalho

Martinez-Maldonado

Tsai

Y.-S.

Markauskaite

De Laat

(2022). How can we design for learning in an AI world? Computers and Education: Artificial Intelligence, 3(1), 100053. https://doi.org/10.1016/j.caeai.2022.100053

Chen

Tan

J. S.

(2021). The spiral model of collaborative knowledge improvement: An exploratory study of a networked collaborative classroom. International Journal of Computer-Supported Collaborative Learning, 16(1), 7–35. https://doi.org/10.1007/s11412-021-09338-6

Dillenbourg

Järvelä

Fischer

(2009). The Evolution of Research on Computer-Supported Collaborative Learning. In Balacheff

Ludvigsen

de Jong

Lazonder

Barnes

(Eds.), Technology-Enhanced Learning. Dordrecht: Springer. https://doi.org/10.1007/978-1-4020-9827-7_1

Eysenbach

(2023). The role of ChatGPT, generative language models, and artificial intelligence in medical education: A conversation with ChatGPT and a call for papers. JMIR Medical Education, 9(1), e46885. https://doi.org/10.2196/46885

Farrokhnia

Banihashem

S. K.

Noroozi

Wals

(2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education & Teaching International, 1–15. https://doi.org/10.1080/14703297.2023.2195846

10.

X. Q.

Y. L.

Hao

X. J.

(2023). Is AGl approaching: Rethinking the development of Al and future education in the context of the ChatGPT craze. Journal of East China Normal University(Educational Sciences) (in Chinese), 41(7), 117–130. https://doi.org/10.16382/j.cnki.1000-5560.2023.07.011

11.

Hsu

T. C.

Abelson

Patton

Chen

S. C.

Chang

H. N.

(2021). Self-efficacy and behavior patterns of learners using a real-time collaboration system developed for group programming. International Journal of Computer-Supported Collaborative Learning, 1-24. https://doi.org/10.1007/s11412-021-09357-3

12.

Jayagopal

Lubin

Chasins

S. E.

(2022, October 29 - 2022, November 2). Exploring the learnability of program synthesizers by novice programmers [Conference session]. 35th Annual ACM Symposium on user Interface software and technology, Oregon, USA. https://doi.org/10.1145/3526113.3545659

13.

Kanabar

(2023). An Empirical Study of Student Perceptions When Using ChatGPT in Academic Assignments. In Zlateva

Tuparov

(Eds.), Computer Science and Education in Computer Science. CSECS 2023. Lecture Notes of the Institute for Computer Sciences. Springer. https://doi.org/10.1007/978-3-031-44668-9_30

14.

Koehler

Mishra

(2009). What is technological pedagogical content knowledge (TPACK)? Contemporary Issues in Technology and Teacher Education, 9(1), 60–70. https://www.learntechlib.org/primary/p/29544/

15.

Moore

Nguyen

H. A.

Bier

Domadia

Stamper

(2022). Assessing the Quality of Student-Generated Short Answer Questions Using GPT-3. In Hilliger

Muñoz-Merino

P. J.

De Laet

(Eds.), Educating for a New Future: Making Sense of Technology-Enhanced Learning Adoption. EC-TEL 2022. Lecture Notes in Computer Science. Springer. https://doi.org/10.1007/978-3-031-16290-9_18

16.

Rudolph

Tan

(2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1), 342–363. https://doi.org/10.37074/jalt.2023.6.1.9

17.

Sabzalieva

Valentini

(2023). ChatGPT and artificial intelligence in higher education: Quick start guide. UNESCO International Institute for Higher Education in Latin America and the Caribbean. https://unesdoc.unesco.org/ark:/48223/pf0000385146

18.

Sarsa

Denny

Hellas

Leinonen

(2022, August 7-11). Automatic generation of programming exercises and code explanations using large language models [Conference session]. ACM Conference on International computing education research. Lugano and Virtual Event. https://doi.org/10.1145/3501385.3543957

19.

Srinivasan

(2022). AI & learning: A preferred future. Computers and Education: Artificial Intelligence, 3(1), 100062. https://doi.org/10.1016/j.caeai.2022.100062

20.

Walter

(2024). Embracing the future of artificial intelligence in the classroom: The relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21(1), 15. https://doi.org/10.1186/s41239-024-00448-3

21.

Wang

(2017). Flexible scripting to facilitate knowledge construction in computer-supported collaborative learning. In Perspectives on rethinking and reforming education. Springer Singapore. https://doi.org/10.1007/978-981-10-4020-7

22.

Wang

Y. M.

Wang

Liang

W. Y.

Liu

C. C.

(2023). “Aladdin’s lamp” or “Pandora’s box”: The potential and risks of ChatGPT’s educational application. Modern Distance Education Research, 35(2), 48–56. (in Chinese).

23.

Watanobe

Rahman

M. M.

Amin

M. F. I.

Kabir

(2023). Identifying algorithm in program code based on structural features using CNN classification model. Applied Intelligence, 53(10), 12210–12236. https://doi.org/10.1007/s10489-022-04078-y

24.

Yilmaz

Karaoglan Yilmaz

F. G.

(2023). The effect of generative artificial intelligence (AI)-based tool use on students’ computational thinking skills, programming self-efficacy and motivation. Computers and Education: Artificial Intelligence, 4(1), 100147. https://doi.org/10.1016/j.caeai.2023.100147

Collaboration with Generative Artificial Intelligence: An Exploratory Study Based on Learning Analytics

Abstract

Keywords

Get full access to this article

References