Sage Journals: Discover world-class research

Abstract

Introduction

Artificial intelligence (AI) presents challenges and opportunities for higher education. The challenge is to incorporate the benefits of AI while minimizing its potential for misuse and undermining of learning. The opportunity is that AI allows instructors to assess learning authentically by fostering creative, engaging, realistic, and reflective assessments.

Statement of the Problem

Drawing on some of the current practices of AI use in the classroom, I discuss how authentic assessment can be achieved while incorporating AI.

Literature Review

First, I review what authentic assessment is, how it is implemented, and some of its positive outcomes. Then, I present sample activities that use AI to design, implement, and evaluate assessments to serve the APA Learning Goals for the Undergraduate Psychology Major.

Teaching Implications

The activities and assessments here and in the online Supplemental Materials (Miserandino, 2024, May 23) help fulfill additional learning goals and build academic skills (e.g., critical thinking, reading, writing).

Conclusion

By using these activities and assessments or drawing on them to create their own, instructors can improve their teaching and student learning outcomes.

Keywords

active learning assessment evaluation/testing experiential learning instructional methods

Get full access to this article

View all access options for this article.

References

American Psychological Association. (2023). APA Guidelines for the undergraduate psychology major. https://www.apa.org/about/policy/undergraduate-psychology-major.pdf

Ashford-Rowe

Herrington

Brown

(2014). Establishing the critical elements that determine authentic assessment. Assessment & Evaluation in Higher Education, 39(2), 205–222. https://doi.org/10.1080/02602938.2013.819566

Atenas

(2023). Understanding gender bias in AI: A critical reflection exercise. In C. Nerantzi, S. Abegglen, M. Karatsiori, & A. Martinez-Arboleda (Eds.), 101 Creative ideas to use AI in education. A collection curated by #creativeHE (p. 12). Graphic Design by Bushra Hashim. CC-BY-NC-SA 4.0. https://zenodo.org/doi/10.5281/zenodo.8072949

Barrett

(2023). Promptcraft 33: Photo altering sparks debate. Promptcraft Newsletter. https://edte.ch/blog/promptcraft-33-photo-altering-sparks-debate/?v=3a1ed7090bfa

Bosco

A. M.

Ferns

(2014). Embedding of authentic assessment in work-integrated learning curriculum. Asia-Pacific Journal of Cooperative Education, 15(4), 281–290.

Carless

Boud

(2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/10.1080/02602938.2018.1463354

Dahmani

Bohbot

V. D.

(2020). Habitual use of GPS negatively impacts spatial memory during self-guided navigation. Scientific Reports, 10, 6310. https://doi.org/10.1038/s41598-020-62877-0

Entwistle

(2009). Teaching for understanding at university: Deep approaches and distinctive ways of thinking (Universities into the 21st century). Palgrave Macmillian.

Fink

M. C.

Reitmeier

Stadler

Siebeck

Fischer

M. R.

(2021). Assessment of diagnostic competences with standardized patients versus virtual patients: Experimental study in the context of history taking. Journal of Medical Internet Research, 23(3), e21196. https://doi.org/10.2196/21196

10.

Fong

(2023). AI can do your homework. Now what? Vox. https://www.youtube.com/watch?v=bEJ0_TVXh-I

11.

Fowler

G. A.

(2023). 1 in 10 teens already use ChatGPT for school. Here’s how to guide them. The Washington Post. https://www.washingtonpost.com/technology/2023/11/16/ai-kids-app-review/

12.

Furze

(2023). Rethinking assessment for generative AI: Beyond the essay. LeonFurze.com. https://leonfurze.com/2023/10/04/rethinking-assessment-for-generative-ai-beyond-the-essay/

13.

Guterman

(2002). Toward dynamic assessment of reading: Applying metacognitive awareness guidance to reading assessment tasks. Journal of Research in Reading, 25(3), 283–298. https://doi.org/10.1111/1467-9817.00176

14.

Hartley

(2023). Critical analysis across AI tools & stereotypes. AI Pedagogy Project. https://aipedagogy.org/assignment/critical-analysis-across-ai-tools-stereotypes/

15.

Hwang

W.-Y.

Purba

S. W. D.

Liu

Y.-F.

Zhang

Y.-Y.

Chen

N.-S.

(2019). An investigation of the effects of measuring authentic contexts on geometry learning achievement. IEEE Transactions on Learning Technologies, 12(3), 291–302. https://doi.org/10.1109/TLT.2018.2853750

16.

Jopp

(2020). A case study of a technology enhanced learning initiative that supports authentic assessment. Teaching in Higher Education, 25(8), 1–17. https://doi.org/10.1080/13562517.2019.1613637

17.

Kahn

(2023). ChatGPT-proof your assignments by challenging students with higher level thinking. Magic School. https://www.magicschool.ai/blog-posts/chatgpt-proof-your-assignments-by-challenging-students-with-higher-level-thinking

18.

Keenan

(2023). The black GPT: Introducing the AI model trained with diversity and inclusivity in mind. POCIT: People of Color in Tech. https://peopleofcolorintech.com/front/the-black-gpt-introducing-the-ai-model-trained-with-diversity-and-inclusivity-in-mind/

19.

Kennette

L. N.

Lin

P. S.

(2023). ChatGPT and your assessments: Do they need to change? E-xcellence in Teaching Blog. https://teachpsych.org/E-xcellence-in-Teaching-Blog/13218113

20.

Lawson

T. J.

Jordan-Fleming

M. K.

Bodle

J. H.

(2015). Measuring psychological critical thinking: An update. Teaching of Psychology, 42(3), 248–253. https://doi.org/10.1177/0098628315587624

21.

Lee

Syam

Yarki

(2023). Large language models in education today. AI x Education. https://aixeducation.substack.com/p/large-language-models-in-education

22.

Liu

Bridgeman

(2023). What to do about assessments if we can’t out-design or out-run AI? https://educational-innovation.sydney.edu.au/teaching@sydney/what-to-do-about-assessments-if-we-cant-out-design-or-out-run-ai/

23.

Lodge

J. M.

Howard

Bearman

Dawson

Agostinho

Buckingham Shum

Deneen

Ellis

Fawns

Gniel

Harper

Henderson

Liu

(2023). Assessment reform for the age of artificial intelligence. Tertiary Education Quality and Standards Agency.

24.

Medland

(2016). Assessment in higher education: Drivers, barriers and directions for change in the UK. Assessment & Evaluation in Higher Education, 41(1), 81–96. https://doi.org/10.1080/02602938.2014.982072

25.

Miserandino

(2024). Authentic Assessment with AI. https://osf.io/wxdp3/

26.

Mollick

E. R.

Mollick

(2023). Assigning AI: Seven approaches for students, with prompts. SSRN. https://ssrn.com/abstract=4475995 or https://doi.org/10.2139/ssrn.4475995

27.

Montagnino

(2023). Six ways to maximize authentic learning in the AI era. Fierce Education. https://www.fierceeducation.com/student-engagement/six-ways-maximize-authentic-learning-ai-era

28.

National Science Foundation. (2023). Notice to research community: Use of generative artificial intelligence technology in the NSF merit review process. https://new.nsf.gov/news/notice-to-the-research-community-on-ai

29.

Neely

Tucker

(2012). Using business simulations as authentic assessment tools. American Journal of Business Education, 5(4), 449–456. https://doi.org/10.19030/ajbe.v5i4.7122

30.

Nicol

Thomson

Breslin

(2014). Rethinking feedback practices in higher education: A peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102–122. https://doi.org/10.1080/02602938.2013.795518

31.

Pitchford

Owen

Stevens

(2021). A handbook for authentic learning in higher education. Routledge. https://doi.org/10.4324/9780429242854.

32.

Rawson

Dunlosky

Sciartellli

(2013). The power of successive relearning: Improving performance on course exams and long-term retention. Educational Psychology Review, 25, 523–548. https://doi.org/10.1007/s10648-013-9240-4

33.

Short

(2023). Enhancing employability with AI-driven authentic assessments. In C. Nerantzi, S. Abegglen, M. Karatsiori, & A. Martinez-Arboleda (Eds.), 101 Creative ideas to use AI in education. A collection curated by #creativeHE (p. 12). Graphic Design by Bushra Hashim. CC-BY-NC-SA 4.0. https://zenodo.org/doi/10.5281/zenodo.8072949

34.

Spector

(2023). What do AI chatbots really mean for students and cheating? Stanford Graduate School of Education. https://ed.stanford.edu/news/what-do-ai-chatbots-really-mean-students-and-cheating

35.

Swisher

Els

(Fall 2023/Winter 2024). Rethinking assessment in light of generative AI. C2C Digital Magazine by Colleague 2 Colleague. https://scalar.usc.edu/works/c2c-digital-magazine-fall-2023–winter-2024/rethinking-assessment-in-light-of-generative-ai

36.

Tai

Ajjawi

Boud

Dawson

Panadero

(2017). Developing evaluative judgement: Enabling students to make decisions about the quality of work. Higher Education, 76, 467–481. https://doi.org/10.1007/s10734-017-0220-3

37.

Villarroel

Bloxham

Bruna

Herrera-Seda

(2018). Authentic assessment: Creating a blueprint for course design. Assessment & Evaluation in Higher Education, 43(5), 840–854. https://doi.org/10.1080/02602938.2017.1412396

38.

Villarroel

Boud

Bloxham

Bruna

(2020). Using principles of authentic assessment to redesign written examinations and tests. Innovations in Education and Teaching International, 57(1), 38–49. https://doi.org/10.1080/14703297.2018.1564882

Authentic and Creative Assessment in a World with AI

Abstract

Introduction

Statement of the Problem

Literature Review

Teaching Implications

Conclusion

Keywords

Get full access to this article

References