This study explored the potential of artificial intelligence (ChatGPT) to generate lesson plans for music classes that were indistinguishable from music lesson plans created by humans, with current music teachers as assessors. Fifty-six assessors made a total of 410 ratings across eight lesson plans, assigning a quality score to each lesson plan and labeling if they believed each lesson plan was created by a human or generated by AI. Despite the human-made lesson plans being rated higher in quality as a group (p < .01, d = 0.44), assessors were unable to accurately label if a lesson plan was created by a human or generated by AI (55% accurate overall). Labeling accuracy was positively predicted by quality scores on human-made lesson plans and previous personal use of AI, while accuracy was negatively predicted by quality scores on AI-generated lesson plans and perception of how useful AI will be in the future. Open-ended responses from 42 teachers suggested assessors used three factors when making evaluations: specific details, evidence of classroom knowledge, and wording. Implications provide suggestions for how music teachers can use prompt engineering with a GPT model to create a virtual assistant or Intelligent Tutor System (ITS) for their classroom.
ArizaC. (2009). The interrogator as critic: The Turing test and the evaluation of generative music systems. Computer Music Journal, 33(2), 48–70. https://doi.org/10.1162/comj.2009.33.2.48
2.
AvdeeffM. (2019). Artificial intelligence & popular music: SKYGGE, flow machines, and the audio uncanny valley. Arts (Basel), 8(4), 130. https://doi.org/10.3390/arts8040130
ChenM. (2020). Imagination machines, Dartmouth-based Turing-tests, & a potted history of responses, AI & Society, 35, 283–287. https://doi.org/10.1007/s00146-018-0855-3
5.
ClanceyW. J.HoffmanR. R. (2021). Methods and standards for research on explainable artificial intelligence: Lessons from intelligent tutoring systems. Applied AI Letters, 2(4), e53. https://doi.org/10.1002/ail2.53
6.
CooperP. K. (2016). Examining correlations when using amabile’s consensual assessment technique to support validity of teachers as expert judges. In BugosJ. A. (Ed.), Contemporary research in music learning across the lifespan: Music education and human development (pp. 137–150). Routledge.
7.
CopeD. (2005). Computer models of musical creativity. MIT Press.
8.
CopeD.HofstadterD. R. (2001). Virtual music: Computer synthesis of musical style. MIT Press.
9.
Della VenturaM. (2019). Exploring the impact of artificial intelligence in music education to enhance the dyslexic student’s skills. In UdenL.LiberonaD.SanchezG.Rodríguez-GonzálezS. (Eds.), Learning technology for education challenges (pp. 14–22). Springer. https://doi.org/10.1007/978-3-030-20798-4_2
10.
FordM. (2015). The rise of the robots: Technology and the threat of mass unemployment. Oneworld Publications.
11.
FreyC. B.OsborneM. A. (2017). The future of employment: How susceptible are jobs to computerisation?Technological Forecasting & Social Change, 114, 254–280. https://doi.org/10.1016/j.techfore.2016.08.019
12.
FüttererT.FischerC.AlekseevaA.ChenX.TateT.WarschauerM.GerjetsP. (2023). ChatGPT in education: Global reactions to AI innovations. Scientific Reports, 13(1), 15310–15310. https://doi.org/10.1038/s41598-023-42227-6
13.
HarariY. N. (2018). 21 lessons for the 21st century. National Geographic Books.
14.
JauhiainenJ. S.GuerraA. G. (2023). Generative AI and ChatGPT in school children’s education: Evidence from a school lesson. Sustainability (Basel, Switzerland), 15(18), 14025. https://doi.org/10.3390/su151814025
15.
KangS.YooH. (2021). Elementary students’ music compositions with notation-based software and handwritten notation assisted by classroom instruments. Bulletin of the Council for Research in Music Education, 227, 29–44. https://doi.org/10.5406/bulcouresmusedu.227.0029
16.
LiP.WangB. (2023). Artificial intelligence in music education. International Journal of Human-Computer Interaction. Advance online publication. https://doi.org/10.1080/10447318.2023.2209984
17.
LinY.DingJ. (2020). Application of music artificial intelligence in preschool music education. IOP Conference Series. Materials Science and Engineering, 750(1), 012101. https://doi.org/10.1088/1757-899X/750/1/012101
18.
RohwerD. (2023). Research-to-resource: ChatGPT as a tool in music education research. Update: Applications of Research in Music Education. Advance online publication. https://doi.org/10.1177/87551233231210875
19.
RuizJ. V.CooperP. K.MuhammedJ. N. (2020). Can they hear a difference? Professional digital composition and the ability of music students to discriminate deep-sampled vs. acoustic instrumental performance recordings. Journal of Popular Music Education, 4(1), 81–99. https://doi.org/10.1386/jpme_00015_1
20.
SchubertE.CanazzaS.De PoliG.RodàA. (2017). Algorithms can mimic human piano performance: The deep blues of music. Journal of New Music Research, 46(2), 175–186. https://doi.org/10.1080/09298215.2016.1264976
21.
TegmarkM. (2017). Life 3.0: Being human in the age of artificial intelligence (1st ed.). Alfred A. Knopf.
van den BergG.du PlessisE. (2023). ChatGPT and generative AI: Possibilities for its contribution to lesson planning, critical thinking and openness in teacher education. Education Sciences, 13(10), 998. https://doi.org/10.3390/educsci13100998
24.
VicsekL. (2021). Artificial intelligence and the future of work: Lessons from the sociology of expectations. International Journal of Sociology and Social Policy, 41(7/8), 842–861. https://doi.org/10.1108/IJSSP-05-2020-0174
25.
WarwickK.ShahH. (2015). Human misidentification in Turing tests. Journal of Experimental & Theoretical Artificial Intelligence, 27(2), 123–135. https://doi.org/10.1080/0952813X.2014.921734
26.
YuX.MaN.ZhengL.WangL.WangK. (2023). Developments and applications of artificial intelligence in music education. Technologies (Basel), 11(2), 42. https://doi.org/10.3390/technologies11020042
27.
YuanS. (2020). Application and study of musical artificial intelligence in music education field. Journal of Physics. Conference Series, 1533(3), 32033. https://doi.org/10.1088/1742-6596/1533/3/032033
28.
ZhangY.SongW. (2023). Design of an online interactive teaching platform for rural music education based on artificial intelligence. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/amns.2023.2.00944
