Data Mining of Assessments to Generate Learner Remediation Teams: Method,Efficacy,and Perceptions in an Undergraduate Engineering Pilot Offering

Abstract

This research developed an approach to integrate the complementary benefits of digitized assessments and peer learning. Its basic premise and associated hypotheses are that by using student assessments of correct and incorrect quiz answers using a fine-grained resolution to pair them into remediation peer-learning cohorts is an effective means of learning. Delivered and scored in a computer-based testing center, the assessment of digitized formative quizzes paired students whose scores indicated a different knowledge skill level so that by the end of the same week as the quiz, the paired students cooperatively took an in-class quiz during a remediation session to determine if there were any learning improvements. This research article discusses this research approach and presents the findings.

Keywords

learning analytics computer-based testing peer teaching and learning

Get full access to this article

View all access options for this article.

References

Anderson

L. W.

Krathwohl

D. R.

Bloom

B. S.

(2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. Allyn & Bacon.

Chen

DeMara

R. F.

Salehi

Hartshorne

(2017). Elevating learner achievement using formative electronic lab assessments in the engineering laboratory: A viable alternative to weekly lab reports. IEEE Transactions on Education, PP(99), 1–10. https://doi.org/10.1109/TE.2017.2706667

Craven

Cooper

B. S.

(2016). The supervision and mentoring of science teachers: Building capacity in the absence of expertise in classroom science supervisors. CLEARvoz Journal, 3(2), 9–14.

Deibel

(2005). Team formation methods for increasing interaction during in-class group work. SIGCSE Bulletin, 37(3), 291–295. https://doi.org/10.1145/1151954.1067525

DeMara

R. F.

Chen

Hartshorne

Zand

(2017a). Digitizing and remediating engineering assessments: An immersive and transportable faculty development workshop. Paper presented at the 2017 ASEE Annual Conference & Exposition, Columbus, OH, June.

DeMara

R. F.

Khoshavi

Pyle

Edison

Hartshorne

Chen

Georgiopoulos

(2016, June 26–29). Redesigning computer engineering gateway courses using a novel remediation hierarchy. Paper presented at the American Association for Engineering Education National Conference (ASEE-16), New Orleans, LA.

DeMara

F., Salehi

Chen

Hartshorne

(2017b). GLASS: Group learning at significant scale via WiFi-enabled learner design teams in an ECE flipped classroom. Paper presented at the American Society for Engineering Education (ASEE) Annual Conference & Exposition, Columbus, OH, June.

DeMara

R. F.

Salehi

Khoshavi

Hartshorne

Chen

(2016). Strengthening STEM laboratory assessment using student-narrative portfolios interwoven with online evaluation. Paper presented at the American Association for Engineering Education Southeastern Conference (ASEE-SE-16), Auburn, AL, 13-15 March.

DeMara

R. F.

Salehi

Muttineni

(2016, March 13–15). Exam preparation through directed video blogging using electronically-mediated realtime classroom interaction. Paper presented at the American Association for Engineering Education Southeastern Conference, Tuscaloosa, AL.

10.

Epstein

M. L.

Lazarus

A. D.

Calvano

T. B.

Matthews

K. A.

(2002). Immediate feedback assessment technique promotes learning and corrects inaccurate first responses. The Psychological Record, 52(2), 187.

11.

Heffernan

N. T.

Heffernan

C. L.

(2014). The ASSISTments ecosystem: Building a platform that brings scientists and teachers together for minimally invasive research on human learning and teaching. International Journal of Artificial Intelligence in Education, 24(4), 470–497.

12.

Heller

Hollabaugh

(1992). Teaching problem solving through cooperative grouping. Part 2: Designing problems and structuring groups. American Journal of Physics, 60(7), 637–644. https://doi.org/10.1119/1.17118

13.

Heller

Keith

Anderson

(1992). Teaching problem solving through cooperative grouping. Part 1: Group versus individual problem solving. American Journal of Physics, 60(7), 627–636. https://doi.org/10.1119/1.17117

14.

Henry

(2013). Creating effective student groups: An introduction to groupformation.org. Paper presented at the Proceeding of the 44th ACM technical symposium on Computer science education, Denver, CO, USA, March.

15.

Jansson

P. M.

Ramachandran

R. P.

Schmalzel

J. L.

Mandayam

(2010). Creating an agile ECE learning environment through engineering clinics. IEEE Transactions on Education, 53(3), 455–462.

16.

Karbalaei

Turgut

Dagley

Vasquez

Cho

H. J.

(2018). Collaborative multidisciplinary engineering design experiences in IoT (Internet of Things) for teachers through summer research site program. Paper presented at ASME 2018 International Mechanical Engineering Congress and Exposition, November. Pittsburgh, Pennsylvania.https://doi.org/10.1115/IMECE2018-87491

17.

Koedinger

K. R.

Aleven

(2007). Exploring the assistance dilemma in experiments with cognitive tutors. Educational Psychology Review, 19(3), 239–264.

18.

Kulik

J. A.

Kulik

C.-L. C.

(1988). Timing of feedback and verbal learning. Review of Educational Research, 58(1), 79–97.

19.

Lin

J.-W.

Lai

Y.-C.

(2013). Harnessing collaborative annotations on online formative assessments. Journal of Educational Technology & Society, 16(1), 263–274.

20.

Loughry

M. L.

Ohland

M. W.

Woehr

D. J.

(2013). Assessing teamwork skills for assurance of learning using CATME team tools. Journal of Marketing Education, 36(1), 5–19. https://doi.org/10.1177/0273475313499023

21.

Meyer

(2009). OptAssign-A web-based tool for assigning students to groups. Computers & Education, 53(4), 1104–1119. https://doi.org/10.1016/j.compedu.2009.05.022

22.

Michaelsen

L. K.

Knight

A. B.

Fink

L. D.

(2004). Team-based learning: A transformative use of small groups in college teaching (1st Pbk. ed.). Stylus Publishing.

23.

Muuro

M. E.

Oboko

R. O.

Wagacha

P. W.

(2016). Evaluation of intelligent grouping based on learners’ collaboration competence level in online collaborative learning environment. The International Review of Research in Open and Distributed Learning, 17(2), 40–64.

24.

National Academy of Sciences, National Academy of Engineering, & Institute of Medicine (2007). Rising above the gathering storm: Energizing and employing America for a brighter economic future. The National Academies Press. https://doi.org/10.17226/11463

25.

Rawson

K. A.

(2015). The status of the testing effect for complex materials: Still a winner. Educational Psychology Review, 27(2), 327–331.

26.

Razzaq

Heffernan

N. T.

(2006, June). Scaffolding vs. hints in the Assistment System. Paper presented at the International Conference on Intelligent Tutoring Systems, Jhongli, Taiwan.

27.

Roediger

H. L.

Karpicke

J. D.

(2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249–255. http://doi.org/10.1111/j.1467-9280.2006.01693.x

28.

Schurmeier

K. D.

Shepler

C. G.

Lautenschlager

G. J.

Atwood

C. H.

(2011). Using item response theory to identify and address difficult topics in general chemistry. In D. M. Bunce (Ed.), Investigating classroom myths through research on teaching and learning (pp. 137–176). ACS Publications.

29.

Squire

Patterson

(2010). Games and simulations in informal science education (WCER Working Paper No. 2010-14). http://www.wcer.wisc.edu/publications/workingPapers/papers.php

30.

Srba

Bieliková

(2012). Encouragement of collaborative learning based on dynamic groups. In A. Ravenscroft, S. Lindstaedt, C.D. Kloos , D. Hernández-Leo (Eds.), 21st Century Learning for 21st Century Skills. EC-TEL 2012. Lecture Notes in Computer Science, vol 7563. Springer.

31.

Srba

Bieliková

(2015). Dynamic group formation as an approach to collaborative learning support. IEEE Transactions on Learning Technologies, 8(2), 173–186. https://doi.org/10.1109/TLT.2014.2373374

32.

Teacher Advisory Council. (2009). Engineering in K-12 education: Understanding the status and improving the prospects. National Academies Press.

33.

Thomas

A. S.

Bonner

S. M.

Everson

H. T.

Somers

J. A.

(2015). Leveraging the power of peer-led learning: Investigating effects on STEM performance in urban high schools. Educational Research and Evaluation, 21(7–8), 537–557.

34.

Turgut

Massi

Bacanli

S. S.

Bidoki

N. H.

(2017, June). Multidisciplinary undergraduate research experience in the internet of things: Student outcomes, faculty perceptions, and lessons learned. Paper presented at 2017 ASEE Annual Conference & Exposition, Columbus, OH.

35.

Vasquez

Dagley

Karbalaei

Cho

H. J.

Turgut

(2019). Collaborative multidisciplinary engineering design experiences for teachers (CoMET) train the trainer model of supports. Paper presented at ASEE Annual Conference & Exposition, Tampa, FL, June.

36.

Watkins

Mazur

(2013). Retaining students in science, technology, engineering, and mathematics (STEM) majors. Journal of College Science Teaching, 42(5), 36–41.

37.

Webb

J. M.

Stock

W. A.

McCarthy

M. T.

(1994). The effects of feedback timing on learning facts: The role of response confidence. Contemporary Educational Psychology, 19(3), 251–265.

38.

Xiong

Beck

J. B.

(2015). Improving long-term retention level in an environment of personalized expanding intervals. Paper presented at the Educational Data Mining, June. Madrid,Spain.

39.

Xiong

Beck

J. E.

(2014). A study of exploring different schedules of spacing and retrieval interval on mathematics skills in ITS environment. In S. Trausan-Matu,

K. E.

Boyer ,

Cros , K. Panourgia (Eds.), Intelligent Tutoring Systems. ITS 2014. Lecture Notes in Computer Science, vol 8474. Cham: Springer. https://doi.org/10.1007/978-3-319-07221-0_63

40.

Xiong

Wang

Beck

(2015). Improving students’ long-term retention performance: A study on personalized retention schedules. Paper presented at the Learning Analytics, March. NY: Poughkeepsie.

41.

Zilles

Deloatch

R. T.

Bailey

Khattar

B. B.

Fagen-Ulmschneider

Heeren

Mussulman, D., & West

(2015, June). Computerized testing: A vision and initial experiences. Paper presented at 2015 ASEE Annual Conference & Exposition,Seattle, Washington, DC, 14 June 2015. https://doi.org/10.18260/p.23726