Sage Journals: Discover world-class research

Abstract

This study developed and evaluated a STEM-based digital learning module on the Anti-lock braking system (ABS) for Technical and Vocational Education and Training (TVET), implemented in a Light Vehicle Engineering (LVE) program. This pilot study uses a Research and Development (R&D) approach guided by the ADDIE (Analysis, Design, Development, Implementation, and Evaluation) model. Prior to implementation, expert review was conducted to establish media and content quality. Media experts rated the module at 86.95%, highlighting strengths in interface design, software, and usefulness. Content experts rated the module at 79.68%, indicating satisfactory conceptual accuracy and pedagogical usefulness for supporting automotive competency learning, while identifying curricular alignment as the primary area requiring further improvement. The module was then piloted with 35 vocational students using a one-group pre-post test design. Learning outcomes demonstrated a statistically significant improvement in ABS knowledge, with the average score increasing from 51.49 on the pre-test to 71.81 on the post-test. The average gain was 20.32 points, representing a 39.46% improvement relative to the pre-test mean, with a very large effect size (Cohen's d = 3.67). Assuming a maximum score of 100, the normalized gain was 0.42, indicating a moderate learning gain. Overall, these results provide quantitative evidence that a STEM-oriented digital ABS module can enhance learning outcomes and support structured, interactive, and industry-relevant instruction in vocational automotive education.

Keywords

Anti-lock braking system stem-based module digital module vocational education tvet

Introduction

Technical and Vocational Education and Training (TVET) plays a vital role globally in preparing skilled workers who can adapt to rapid technological changes in industry. Recent studies highlight that countries such as Finland, Germany, and Singapore have successfully aligned their TVET systems with Industry 4.0 demands by implementing competency-based and technology-integrated learning models.^1–3 These advancements demonstrate the global shift from traditional technical instruction toward digital, innovation-driven, and problem-based learning environments. Moreover, new technologies should be tailored to the practices and requirements of the specific domain.⁴ However, in many developing contexts, including Indonesia, the integration of digital pedagogy into TVET remains uneven and often limited to theoretical instruction rather than practice-based learning.^5–7 Therefore, it is essential to strengthen TVET learning strategies that foster students’ technological, analytical, and problem-solving competencies through innovative and interactive digital learning tools.

Learning media are central to improving instructional quality in vocational education, as they facilitate conceptual knowledge and bridge the gap between theory and practice. Numerous studies have demonstrated that interactive and multimedia-based learning materials enhance engagement, retention, and skill acquisition among vocational students.^8–11 The integration of digital media has also been shown to support self-paced and inquiry-driven learning environments that align well with modern industry needs. Despite this, the implementation of STEM-based digital modules in vocational education remains scarce,¹² particularly in automotive subjects where practical simulations and problem-solving tasks are essential. Thus, there is a pressing need to design and validate STEM-based learning media that can support TVET students in mastering both theoretical and applied concepts.

The Anti-lock braking system (ABS) represents an important modern automotive technology designed to enhance safety by preventing wheel lock during braking. Understanding how ABS functions requires integrated knowledge of science (physics of motion), technology (electronic sensors),¹³ engineering (mechanical and hydraulic components), and mathematics (force–friction relationships and wheel slip calculations), making ABS a strong fit for a STEM-based learning approach. Recent research suggests that STEM-integrated instruction can deepen conceptual understanding and strengthen learners’ ability to apply interdisciplinary knowledge to technical problem solving.^14,15 Importantly, braking-related topics are also widely recognized as conceptually challenging for learners; for example, the “braking car problem” has been used to surface persistent misconceptions and test students’ understanding of fundamental mechanics principles.¹⁶ At the same time, prior work shows that braking contexts are well-suited for simulation- and design-oriented learning activities, supporting the pedagogical value of interactive visualization.¹⁷ However, conventional automotive education still relies heavily on teacher-centered explanations and printed manuals, offering limited opportunities for students to explore ABS systems interactively. Consequently, there is an urgent need for a STEM-based digital module that contextualizes ABS learning through simulation and visualization.

Building upon these challenges and opportunities, the present study aims to develop and evaluate a STEM-based digital learning module on the ABS for vocational automotive education. Specifically, this study seeks to determine: (a) the feasibility of the module based on expert validation of content and media design, and (b) the extent to which the digital module improves students’ understanding of ABS after implementation in this pilot study. By combining STEM pedagogy with digital interactivity, this research contributes to the enhancement of competency-based learning in automotive TVET. Furthermore, the study provides empirical evidence in support of integrating STEM-oriented digital modules into vocational classrooms. Overall, the outcomes are expected to inform educators and policymakers about innovative strategies for embedding technological literacy and innovation in vocational education.

Literature review

Anti-lock brake system in vocational education

The brake system components are a crucial system in an automotive vehicle.^18,19 ABS have emerged in the automotive industry as a key active safety technology. As Industry 4.0 pushes vehicle systems toward higher electronic integration, TVET institutions are expected to mirror these technological shifts in their curricula. Recent analyses of TVET responsiveness to industrial change indicate that many countries are updating technical programs to reflect digitalized and sensor-based systems, enabling graduates to operate and service modern vehicles.²⁰ In the automotive field, this means moving beyond conventional hydraulic brakes to systems governed by electronic control units, wheel-speed sensors, and modulator valves—technologies now standard in workshops. However, studies also note that TVET in developing contexts often lags behind industry adoption, creating a skills gap between what students learn at school and what garages or dealerships actually use (Magagula & Awodiji, 2024). This gap highlights the need for structured learning resources that explicitly transfer ABS technology from industrial practice to vocational classrooms.

Within vocational automotive education, up-to-date vehicle technologies are taught to ensure graduates can diagnose, repair, and explain safety systems such as ABS, electronic brake force distribution, and stability control. Training devices and simulators for ABS have been shown to help learners visualize the hydraulic–electronic interaction and practice fault-finding procedures similar to those in real workshop conditions.^21,22 At the same time, road-safety research confirms that ABS contributes to vehicle control and crash-injury reduction when users understand how the system operates, underscoring the importance of instruction that links theory to actual braking behaviour.^23,24 Yet in many vocational schools, ABS is still delivered mainly through teacher explanation and printed manuals, with limited interactive or problem-based materials. This indicates a pedagogical gap between existing ABS teaching practices and the kinds of digitally supported, practice-oriented learning that current vehicles demand.

Because ABS inherently combines physics of motion, sensor technology, hydraulic/mechanical engineering, and quantitative analysis, it is an excellent candidate for a STEM-integrated digital module in TVET. STEM-based approaches in automotive and engineering vocational programs have been shown to improve problem-solving, multidisciplinary thinking, and students’ ability to apply concepts to realistic technical tasks.^25–28 A digital STEM module can make ABS operation visible (science), show how electronic control units process signals (technology), connect components and system architecture (engineering), and guide learners through braking-force or wheel-speed calculations (mathematics). However, existing ABS resources tend to focus either on mechanical description or on stand-alone training benches, and rarely on a validated, curriculum-ready STEM digital module for vocational automotive students. Therefore, developing and testing a STEM-based digital ABS module becomes a logical next step to close the gap between industry-level braking technology and school-level instructional practice.

STEM-based digital module in education

STEM-based digital modules have become a prominent approach for making integrated science, technology, engineering, and mathematics learning more accessible, interactive, and student-centered. Systematic reviews on STEM integration show that teachers recognize the value of STEM but often lack concrete, ready-to-use materials that support authentic and interdisciplinary tasks in digital form.²⁹ Digital STEM environments such as interactive e-modules, virtual field trips, and simulation-based activities have been shown to increase engagement and support inquiry processes by allowing students to visualize abstract concepts and connect them to real-world problems.³⁰ Meta-analytic evidence also suggests that STEM learning achievement and motivation improve when it is delivered through digital or game-based platforms compared to traditional instruction.^30,31 However, much of this research is situated in general K–12 science or mathematics classrooms, indicating a gap in STEM-based digital modules designed for vocational or technical education.

Furthermore, recent discussions on e-learning in STEM education emphasize that digital modules are most effective when they include problem-solving, engineering design, and data interpretation tasks rather than simply digitizing textbook content.³² Such modules make disciplinary connections explicit by linking physics principles to sensor readings or mathematics to system optimization, which is highly relevant for learners with technical and engineering backgrounds. Studies in technology-enhanced STEM learning environments also report that structured digital modules help teachers implement integrated STEM even when their pedagogical confidence is limited, as the modules already contain scaffolds, multimedia resources, and assessment tools.^29,31 Despite these advantages, there remains limited documentation of STEM-based digital modules developed for specific technical systems, such as automotive braking, CNC machining, or mechatronics that vocational students encounter in industry. This highlights the need for context-specific STEM-oriented digital modules, such as one focusing on the ABS, that align with vocational curricula and industrial technologies.

Methodology

This pilot study employed a Research and Development (R&D) approach using the ADDIE model. According to Branch,³³ the ADDIE approach consists of five stages: Analysis, Design, Development, Implementation, and Evaluation. The strength of the ADDIE model lies in its systematic and iterative process, which allows for continuous improvement at each stage. This makes it highly relevant to the present study, which focuses on developing and assessing the feasibility of a STEM-based digital module on the ABS while measuring students’ learning improvement. The pilot project used purposive sampling, involving vocational students in the automotive field in Indonesia.

Participants

The participants of this study were 12th-grade students majoring in Light Vehicle Engineering (LVE) at an Indonesian vocational high school who had completed the course on the ABS. The population consisted of 72 students, divided into two classes, with 36 students selected as the research sample. Class A was used for validity instruments, whereas Class B was assigned for a try-out assessment, including both a pre-test and post-test, which received the same learning treatment. This sample was chosen because the developed e-module is intended for use by teachers as a learning resource in teaching the ABS on automotive vehicles.

Procedures

The ABS digital module was developed using FlipHTML5 over a period of three months. It can be accessed easily through a web-based platform, allowing students to learn flexibly and interactively using smartphones, computers, laptops, or tablets. The use of FlipHTML5 was chosen because it is an open-access, user-friendly technology that supports multimedia integration and interactive design. ABS. Figure 1 shows the interface of the STEM-based digital ABS module.

Figure 1.

The design interface of STEM-based digital modules in the Indonesian language.

The ABS digital module was developed to address the limited availability of technology-based learning media in vocational education, particularly within automotive engineering programs, and it is not intended to function as a static digital book. In addition to presenting ABS concepts in a structured format, the module was designed with interactive and instructional features that support active learning, including non-linear navigation, embedded multimedia to visualize system operation, hyperlinks to supporting resources, and guided learning tasks and short formative checks that prompt students to apply concepts rather than only read explanations. To consolidate learning and provide immediate feedback, the module includes a quiz at the end that students complete after working through the content.

In this module, science explains the principles of motion, friction, and hydraulic pressure that influence braking performance. Technology is reflected in the digital sensors and control systems within the ABS, showing how electronic components enhance vehicle safety. Engineering connects these scientific and technological principles to the design and functioning of braking components in real vehicles. Finally, Mathematics supports the analysis and calculation of braking forces, wheel speed, and sensor data, helping students understand the system quantitatively. The developed module was evaluated through expert review and a limited try-out in a vocational high school to assess its feasibility and to examine preliminary learning gains following its use.

Research instruments

Expert instruments

The expert instrument was used to gather data on the validity and feasibility of the e-module learning material for the ABS. Content experts (CE) and media experts (ME) completed this instrument to assess the appropriateness of the developed ABS e-module for use in the learning process. The content expert validators consisted of teachers who teach the ABS braking system at vocational high schools, lecturers from higher education institutions, and practitioners from the automotive industry. Meanwhile, the media expert validator came from the Educational Media Development Center in Semarang, Indonesia. Table 1 and Table 2 present the blueprint of the media expert and material expert instruments developed based on the Ministry of National Education (2008:28):

Table 1.

Media expert questions (MEQ) for the ABS STEM-based digital learning module.

Code	Statements	Aspect
MEQ1	The E-module is easy to operate.	Ease of Use and Navigations
MEQ2	The instruction page facilitates the smooth operation of the E-module.
MEQ3	The content in the E-module is presented systematically.
MEQ4	The menu selection in the E-module is easy to navigate.
MEQ5	All buttons and interactive features of the E-module function properly.
MEQ6	The developed E-module is fully compatible with the application used.	Software
MEQ7	The E-module can operate independently without requiring other supporting software.
MEQ8	The system access speed of the E-module is optimal and efficient.
MEQ9	The visual-text integration of menu and button layout in the E-module is consistent throughout.	Visual-text Integration
MEQ10	The visual-text integration of fonts and styles used in the E-module are consistent.
MEQ11	The overall visual-text integration of layout and design of the E-module are consistent.
MEQ12	The text in the E-module is easy to read.	Language and readability
MEQ13	The information presented in the E-module is clear and understandable.
MEQ14	The language in the E-module complies with standard spelling and grammar rules.
MEQ15	The language used in the E-module is effective and efficient.
MEQ16	The fonts (type and size) used in the E-module are visually appropriate.	Interface Design
MEQ17	The layout or page design of the E-module is well-organized.
MEQ18	The animations, images, videos, and audio in the E-module are clear and of good quality.
MEQ19	The visual design of the E-module display is attractive and coherent.
MEQ20	The colors of interface well design
MEQ21	The E-module supports independent learning for students.	Usefulness
MEQ22	The E-module assists teachers in facilitating the learning process.
MEQ23	The developed E-module reflects current educational and technological developments.

Table 2.

Content expert questions (CEQ) for the ABS STEM-based digital learning module.

Code	Statement	Aspect
CEQ1	The E-module clearly articulates the conceptual description of the Anti-lock brake system (ABS).	Content or Conceptual Accuracy
CEQ2	The E-module presents and identifies the components of the Anti-lock braking system (ABS) clearly.
CEQ3	The E-module provides clear explanations of the classifications or types of Anti-lock braking system (ABS).
CEQ4	The E-module clearly describes the operational principles or working mechanisms of the Anti-lock braking system (ABS).
CEQ5	The E-module clearly outlines the maintenance procedures for the Anti-lock braking system (ABS).
CEQ6	The E-module clearly explains the periodic or preventive maintenance activities for the Anti-lock braking system (ABS).
CEQ7	The content of the E-module aligns with the core curriculum competencies .	Curricular Alignment
CEQ8	The title of the E-module is clear and accurately represents the content.
CEQ9	The content of the E-module is relevant to students’ developmental level.
CEQ10	The E-module content is appropriate to the needs of the learning material.
CEQ11	The E-module is relevant to current technological and industrial developments.
CEQ12	The E-module is useful for broadening students’ knowledge and insights.
CEQ13	The content of the E-module aligns with moral and social values.
CEQ14	The learning objectives in the E-module are clearly stated.	Presentation
CEQ15	The sequence of content presentation in the E-module is logical and coherent.
CEQ16	The E-module provides motivation and enhances learning engagement.
CEQ17	The E-module includes feedback through evaluation activities.
CEQ18	The evaluation in the E-module effectively measures mastery of the learning material.
CEQ19	The presentation style of the E-module is communicative and easy to understand.
CEQ20	The E-module facilitates independent learning.	Pedagogical Usefulness
CEQ21	The E-module assists teachers in the teaching and learning process.
CEQ22	The developed E-module reflects current educational and technological developments.

ABS knowledge instruments

The student test instrument was used to measure the level of knowledge of the ABS material before and after the learning process using the ABS e-module. Prior to data collection, the test instrument was first tested for validity and reliability to ensure its quality. The test instrument used in this study consisted of multiple-choice questions. During data collection, the test items were developed based on the blueprint of the ABS braking system material. Table 3 presents the blueprint of the test instrument for the ABS course.

Table 3.

Blueprint of the test instrument for the ABS.

Basic competency	Indicator	Mastery level	Test items
3.8 Apply the maintenance procedures of the Anti-lock braking system (ABS).	• Able to explain the definition and function of the Anti-lock braking system (ABS).• Able to identify all components of the Anti-lock braking system (ABS).• Able to explain in detail the function of each component in the Anti-lock braking system (ABS).• Able to identify the different types of Anti-lock braking system (ABS).• Able to explain the working principles of the Anti-lock braking system (ABS).	C2, C2, C2, C2, C3	1–3; 4–10; 11–17; 18–21; 22–24
4.8 Perform periodic maintenance on the Anti-lock braking system (ABS).	• Able to explain the procedures for diagnosing malfunctions in the Anti-lock braking system (ABS).• Able to explain in detail the periodic maintenance procedures of the Anti-lock braking system (ABS).	C4, C4	25–29; 30–35
Total			35

Data analysis

The experts involved in the validation stage were selected using purposive sampling rather than random selection, as the evaluation required specialized knowledge of vocational pedagogy, automotive competencies, and digital learning media. Specifically, experts were recruited from four stakeholder groups to ensure content, curriculum, and media perspectives were adequately represented: vocational school teachers with direct experience teaching automotive systems, vocational teacher training lecturers with expertise in curriculum and pedagogy, industry practitioners familiar with ABS related workplace standards and applications, and personnel from an Educational Media Development Center with professional experience in reviewing the quality of digital instructional materials. Selection was based on documented professional roles and experience in vocational education and training. All experts evaluated the module using a standardized instrument to enhance consistency and transparency in the review process.

Instrument testing in this study comprised both validity and reliability analyses. In validation studies, the Pearson Product Moment correlation coefficient is widely used to examine the relationship between each item score and the total test score; an item is deemed valid when the obtained correlation coefficient (r-count) is greater than the critical value in the r-table, which is determined by the sample size and the chosen significance level (typically p < .05).^34,35 In this study, item validity was analyzed using IBM SPSS Statistics 25. Reliability was then tested using Cronbach's alpha in the same software. A Cronbach's alpha value above 0.70 indicates acceptable internal consistency, and values above 0.80 are generally considered good, which is consistent with recommendations in the measurement literature.³⁶

The feasibility of the e-module was interpreted using the percentage criteria. Based on these criteria, an e-module that obtains a feasibility score between 76% and 100% is categorized as valid and considered highly feasible for use in learning. A score between 51% and 75% is classified as reasonably valid and regarded as feasible, although minor revisions may be needed. Scores in the range of 26% to 50% fall into the less valid category, indicating that the e-module is less feasible and requires substantial improvement. Meanwhile, a score below 26% is categorized as invalid and therefore not feasible to use as a learning resource. This interpretation follows the assessment guideline proposed by Sugiyono.³⁷

To determine whether the STEM-based ABS digital module led to a significant improvement in students’ knowledge, a paired-samples t-test was conducted. This test is appropriate when the same group of students is measured twice, before (pre-test and after (post-test) an instructional intervention, and the aim is to test whether the mean difference is statistically different from zero.³⁸ Before conducting the t-test, the normality of the difference scores was examined (e.g., using the Shapiro–Wilk test) because the paired t-test assumes that these difference scores are approximately normally distributed. When this assumption is met, the paired t-test is a powerful and commonly used procedure in educational research to evaluate a learning intervention.³⁹ Moreover, previous studies have demonstrated that parametric tests, such as the t-test, are reasonably robust to mild deviations from normality, particularly when sample sizes are comparable to those in this study.⁴⁰ In the event of noticeable variance or distributional issues, literature also notes that adjusted or alternative t-procedures can be considered.⁴¹ A statistically significant result (e.g., p < .001) in this context indicates that the ABS digital module produced a meaningful learning gain.

In addition, learning improvement was quantified using gain scores, calculated as the difference between post-test and pre-test scores, and normalized gain was computed to account for the maximum possible score using $g = (p o s t - p r e) / (m a x - p r e)$ .⁴² Additionally, normalized gain values were interpreted using Hake's thresholds: low for $g < 0.30$ , medium for $0.30 \leq g < 0.70$ , and high for $g \geq 0.70$ .⁴²

Results

Feasibility of STEM-based digital ABS module

Feasibility of STEM-based digital ABS module by Media experts

The media validation was carried out by three ME with backgrounds in education and vocational training. Each expert independently assessed the quality and feasibility of the developed digital module. Table 4 presents the evaluation scores as determined by media experts.). Three media experts evaluated the module in six aspects.

Table 4.

The evaluation of STEM-based digital ABS by media experts.

Aspects	Question code	Media expert score			SUM in aspect	Mean
Aspects	Question code	ME 1	ME 2	ME3	SUM in aspect	Mean
Ease of Use and Navigations	MEQ1	4	4	4	52	3.47
	MEQ2	3	2	4
	MEQ3	4	4	2
	MEQ4	4	3	3
	MEQ5	4	4	3
Software	MEQ6	4	4	3	33	3.67
	MEQ7	4	4	3
	MEQ8	4	4	3
Visual-text Integration	MEQ9	4	4	3	29	3.22
	MEQ10	4	2	2
	MEQ11	4	3	3
Language and readability	MEQ12	4	4	3	41	3.42
	MEQ13	4	4	3
	MEQ14	3	3	3
	MEQ15	3	4	3
Interface Design	MEQ16	2	3	3	52	3.50
	MEQ17	3	4	3
	MEQ18	4	4	4
	MEQ19	4	4	4
	MEQ20	3	4	3
Usefulness	MEQ21	4	2	4	33	3.67
	MEQ22	4	4	3
	MEQ23	4	4	4
Total		85	82	73	240

Based on Table 4, the STEM-based ABS digital module was evaluated positively overall, with consistently high scores across most aspects, while also revealing several item-specific areas for improvement. The strongest area was Software, with a mean of 3.67, indicating solid technical performance and reliable functionality, as most items were rated 3 to 4 by all experts. Ease of use and navigation in the second set also achieved a mean of 3.67, suggesting that the module is generally easy to operate; however, a lower rating on MEQ21 from a single expert indicates that a navigation element or user flow still needs refinement. Interface design was rated well, with a mean of 3.50, supported by uniformly high scores on key items such as MEQ18 and MEQ19. However, a comparatively low score on MEQ16 indicates that one specific layout or visual component should be improved to increase consistency and clarity. Ease of use and navigation in the first set obtained a mean of 3.47 and was generally strong, yet variability on items such as MEQ2 and MEQ3 suggests that some instructions or navigation cues may not be equally intuitive for all users. Language and readability reached a mean of 3.42, indicating that the text is largely clear and accessible. However, repeated ratings of 3 on several items suggest that terminology consistency and phrasing could be further refined. The aspect requiring the most attention is visual text integration, with the lowest mean of 3.22, as lower scores on items such as MEQ10 indicate that the alignment between visuals and explanations should be strengthened through clearer labeling, better placement of figures, and tighter links between diagrams and the accompanying instructional text.

Table 5 shows the three media experts awarded total scores of 85, 82, and 73, resulting in a combined score of 240 out of a maximum possible 276, which corresponds to 86.95%. This percentage indicates that the STEM-based ABS digital module achieved a high level of media quality and is generally considered feasible for classroom use, reflecting strong performance in key design and usability criteria. Although Media Expert 3 provided a comparatively lower score than the other two experts, the overall agreement still indicates a positive evaluation, suggesting the module is well-developed while leaving room for targeted refinements based on the more critical feedback to further improve consistency and user experience.

Table 5.

Media expert validation results for the STEM-based digital ABS module.

Media expert	Total score
Media Expert 1	85
Media Expert 2	82
Media Expert 3	73
Total Score	240
Maximum Possible Score	276
Percentage (%)	86.95%

Media expert evaluation and refinement

As summarized in Table 6, nine recommendations were provided, and all were implemented in the revised version of the e-module. The refinements focused on improving text accuracy and readability, strengthening academic credibility through proper citation, enhancing visual consistency and clarity, and supporting student use through additional navigation aids and tool guidance. Collectively, these revisions enhanced the module's professional appearance and user experience by ensuring that written content was more readable, visual elements were clearer and more consistent, and students could access supplementary information through embedded links when needed. The completed modification is provided in Appendix 1.

Table 6.

Media expert suggestions and implemented refinements.

Media expert suggestions	Revision action	Status
Writing needs improvement	Revised wording and corrected text	Implemented
Include citation sources	Added citation sources for quotations and referenced materials	Implemented
Improve image size and clarity	Resized images and replaced low-resolution visuals	Implemented
Use images with backgrounds that contrast with the module background	Selected images with higher contrast and clearer backgrounds	Implemented
Add links in the e-module to address application limitations and improve visibility for users	Embedded hyperlinks to original sources and supporting materials where appropriate	Implemented
Add a tools usage page	Added a page explaining how to use module tools/features	Implemented
Standardize font size	Standardized font sizes across all sections	Implemented
Increase letter spacing	Adjusted letter spacing to improve readability	Implemented

Feasibility of STEM-based digital ABS module by content experts

The feasibility of the e-module for teaching the ABS was assessed by two content experts with backgrounds in vocational automotive education and mechanical engineering, as shown in Table 7. They evaluated the content in terms of accuracy, alignment with the learning objectives, clarity of explanations, and suitability for vocational high school students. Overall, the material aspect of the e-module received a positive evaluation, indicating that the content can be used to support learning with only minor improvements if needed.

Table 7.

The evaluation of STEM-based digital ABS by content experts.

Aspects	Question code	Content expert (CE) score		SUM in aspect	Mean
Aspects	Question code	CE 1	CE 2	SUM in aspect	Mean
Content or Conceptual Accuracy	CEQ1	3	4	42	3.50
	CEQ2	3	3
	CEQ3	4	4
	CEQ4	3	3
	CEQ5	3	4
	CEQ6	4	4
Curricular Alignment	CEQ7	2	2	42	3.00
	CEQ8	3	4
	CEQ9	3	3
	CEQ10	3	3
	CEQ11	3	4
	CEQ12	3	3
	CEQ13	3	3
Presentation	CEQ14	2	2	49	3.06
	CEQ15	3	3
	CEQ16	3	3
	CEQ17	3	4
	CEQ18	3	4
	CEQ19	4	3
	CEQ20	3	3
	CEQ21	3	3
Pedagogical Usefulness	CEQ22	3	4	20	3.33
	CEQ23	3	3
	CEQ24	3	4
		73	80	153

Based on the Table 7, the STEM-based ABS digital module was judged to be strongest in content quality, with Content or Conceptual Accuracy achieving the highest mean score of 3.50. This suggests that the ABS concepts are generally correct, scientifically sound, and consistently explained across sections, as several items received ratings of 4 from both experts. Pedagogical usefulness was also rated positively with a mean of 3.33, indicating that the module is considered helpful for supporting learning through activities, explanations, and competency-oriented tasks, although some items remained at level 3, implying that instructional guidance or learning supports could be strengthened further. In contrast, curricular alignment received the lowest mean score of 3.00, mainly due to consistently low ratings on CEQ7 with scores of 2 from both experts, which signals a clear weakness in how explicitly the module maps to curriculum standards, learning objectives, or assessment indicators and suggests the need for clearer links to competencies and lesson outcomes. The presentation was rated slightly above adequate, with a mean of 3.06. However, the low scores on CEQ14 from both indicate that specific presentation elements, such as organization, sequencing, or the clarity of content structure, should be improved to enhance readability and instructional flow. Overall, the scoring pattern indicates that the module's main strengths lie in conceptual accuracy and instructional usefulness, while refinements are most needed to make curriculum alignment more explicit and improve selected aspects of presentation and structure.

Based on Table 8, the two content experts assigned total scores of 73 and 80, resulting in a combined score of 153 out of a maximum possible 192, which corresponds to 79.68%. This result indicates that the STEM-based ABS digital module demonstrates a good level of content quality and is generally appropriate for instructional use, particularly in terms of conceptual coverage and relevance. The difference between the two experts’ totals suggests some variation in judgment, implying that while the module is acceptable overall, certain elements may require refinement to achieve stronger agreement and higher quality, such as improving the clarity of curriculum mapping, strengthening instructional sequencing, or enhancing the presentation of key concepts based on the more critical feedback.

Table 8.

Content experts validation results for the STEM-based digital ABS module.

Content expert	Total score
Content Expert 1	73
Content Expert 2	80
Total Score	153
Maximum Possible Score	192
Percentage (%)	79.68%

Content experts evaluation and refinement

Beyond the numerical scores, the experts’ open-ended comments led to three concrete refinements implemented before the classroom try-out: adding the Basic Competencies and learning objectives to strengthen curricular transparency, adding an ABS electrical wiring diagram to improve technical completeness, and increasing the use of self-developed animations to enhance instructional coherence and originality. Table 9 summarizes the major recommendations and the corresponding revisions made in the final version of the module. The completed modification is provided in Appendix 1.

Table 9.

Content experts recommendations and implemented refinements.

Content experts suggestions	Revision/Action taken	Implementation status
Add Basic Competencies (Kompetensi Dasar/KD) and learning objectives	Added a section specifying KD and learning objectives to clarify targeted indicators and expected outcomes	Implemented
Add the electrical wiring diagram for the ABS system	Inserted an ABS wiring schematic and integrated it into the relevant explanation section	Implemented
Use more self-produced animations rather than relying entirely on YouTube	Added self-developed animations and improved visual cues to support key process explanations	Implemented

The improvement of vocational students’ knowledge of ABS through the digital module

Before evaluating students’ understanding of ABS through the digital module, we first conducted an instrument validity test to ensure that the questions were appropriate for collecting research data. The test consisted of 35 multiple-choice items, which were administered to 35 students in the LVE program at the vocational high school. The results of the validity analysis are presented in Table 10.

Table 10.

The validity of the instrument of ABS knowledge.

Item	r-table	r-count	Validity	Item	r-table	r-count	Validity
1	0.334	0.348	Valid	18	0.334	0.369	Valid
2	0.334	0.468	Valid	19	0.334	0.611	Valid
3	0.334	0.348	Valid	20	0.334	0.468	Valid
4	0.334	0.349	Valid	21	0.334	0.402	Valid
5	0.334	0.418	Valid	22	0.334	0.573	Valid
6	0.334	0.43	Valid	23	0.334	0.109	Not Valid
7	0.334	0.002	Not Valid	24	0.334	0.338	Valid
8	0.334	0.49	Valid	25	0.334	0.339	Valid
9	0.334	0.402	Valid	26	0.334	0.545	Valid
10	0.334	0.406	Valid	27	0.334	0.031	Not Valid
11	0.334	0.108	Not Valid	28	0.334	0.37	Valid
12	0.334	0.491	Valid	29	0.334	0.364	Valid
13	0.334	0.384	Valid	30	0.334	0.345	Valid
14	0.334	0.454	Valid	31	0.334	0.342	Valid
15	0.334	0.015	Not Valid	32	0.334	0.546	Valid
16	0.334	0.558	Valid	33	0.334	0.642	Valid
17	0.334	0.462	Valid	34	0.334	0.696	Valid
				35	0.334	0.568	Valid

The validity test results showed that several items were identified as invalid, namely items 7, 11, 15, 23, and 27. An item was classified as invalid because its r-count value was lower than the r-table value. These items were then re-examined against the test blueprint that had been developed. Item 7 was mapped to the indicator “identifying the components of the Anti-lock brakig system (ABS),” for which seven items were created, so six valid items remained. Items 11 and 15 were linked to the indicator “understanding the function of ABS components,” which consisted of seven items, leaving five valid items. Item 23 was connected to the indicator “understanding the working principle of the ABS,” which had three items, leaving two valid items. Item 27 was linked to the indicator “identifying faults in the ABS,” which had five items, leaving four valid items. Based on the test blueprint for the competency of maintaining the ABS, 30 valid questions were selected from the total of valid items to measure students’ knowledge competence in ABS maintenance, serving as instruments for both the pre-test and post-test evaluations. Furthermore, a reliability test was conducted using Cronbach's alpha, which yielded a reliability coefficient of 0.83, indicating that the test items had good internal consistency and were reliable for use in the study.

Students’ knowledge of the ABS concept was evaluated through the digital module using a test. Pre- and post-tests were administered to determine the difference in students’ knowledge of ABS material after using the digital module. The Shapiro–Wilk test indicated that the difference scores (p = .158) were not significantly different from a normal distribution. Therefore, the normality assumption was met, and paired-sample t-tests were deemed appropriate for analyzing the differences between the pre- and post-tests. A paired-sample t-test was then conducted to evaluate the ABS digital module's impact on improving vocational students’ knowledge. (Table 11)

Table 11.

A paired-sample t-test of ABS knowledge.

Variables	M (Pre)	SD (Pre)	M (Post)	SD (Post)	Mean difference	t	df	p	Cohen's d	Gain
ABS Digital Module	51.49	12.32	71.81	10.01	−20.33	−21.72	34	< .001	3.67	0.42

The results indicated that the pilot study improve students’ knowledge after using the ABS Digital Module, with scores increasing from pre-test (M = 51.49, SD = 12.32) to post-test (M = 71.81, SD = 10.01), t(34) = −20.33, p < .001. The mean difference of −9.72 suggests a substantial gain in performance, supported by a large effect size (Cohen's d = 3.67). Assuming a maximum score of 100, the normalized gain was g 0.42, which falls in the moderate range and indicates that students achieved about 42% of the possible improvement beyond their pre-test level. These findings demonstrate that the STEM-based ABS Digital Module had a substantial positive impact on students’ learning outcomes in vocational automotive education.

Discussion

Feasibility of STEM-based digital ABS module

The results of the media expert validation showed that the STEM-based digital ABS module achieved a score of 86.95%, placing it in the “Highly Feasible” category, which indicates that the layout, navigation, and multimedia elements were considered appropriate for vocational students. This aligns with the view that media or instructional design validation is a critical stage in R&D-based learning product development because it ensures that the digital environment supports cognitive processing and does not overload learners.^33,43 Studies on technology-enhanced learning similarly report that expert review of interface, readability, and interactivity improves user acceptance and learning performance, especially when students access content through multiple devices such as smartphones and laptops.^44,45 In the context of vocational education, where students often prefer practice-oriented and visual materials, media validation helps ensure that simulations, images, and step-by-step displays align with workshop practices (Cheng & Tsai, 2019). Thus, the high feasibility score from media experts confirms that the module is ready for classroom use with only minor refinement; however, it also highlights the need for future usability testing with students to complement expert judgment.

The content expert validation yielded an average score of 79.68%, also falling within the “Highly Feasible” category, indicating that the material on ABS was deemed accurate, relevant to vocational automotive curricula, and clearly presented. Content validation is particularly important in technical subjects because misconceptions about hydraulic circuits, sensor functions, or Electronic Control Unit (ECU) logic can easily be transmitted to learners if materials are not checked by practitioners or subject specialists.^25,46 Prior research on module and e-textbook development in TVET shows that involving both school teachers and higher education or industry experts strengthens alignment with competency standards and actual workplace technology.^29,47 Moreover, Expert-validated content is a prerequisite for subsequent learning-outcome testing because it helps ensure that observed score changes are less likely to be driven by inaccurate or poorly aligned materials. However, attributing gains to an intervention requires an appropriate comparison condition (Campbell & Stanley, 1963; Shadish et al., 2002). Therefore, the positive validation from content experts supports the claim that the STEM-based digital ABS module is pedagogically sound and technically accurate, while also highlighting a common gap in the literature: few studies report both media and content validation data together for STEM-oriented vocational digital modules.

The improvement of vocational students’ knowledge of ABS through the digital module

Paired-samples t-test results indicated that students’ post-test scores were higher than their pre-test scores following the implementation of the STEM-based digital ABS module. The average score increased from 51.49 (SD = 12.32) on the pre-test to 71.81 (SD = 10.01) on the post-test. The mean difference was −20.32, corresponding to an average gain of 20.32 points (39.46% relative to the pre-test mean) and a very large effect size, Cohen's d = 3.67. Because the study used a one-group pre-test/post-test design without a comparison group, the observed gain should be interpreted as preliminary and cannot be attributed uniquely to the module (Campbell & Stanley, 1963; Shadish et al., 2002). This result aligns with previous studies that demonstrate the enhancement of conceptual knowledge in technical and vocational education settings through interactive and multimedia-based learning resources, supporting their future work.^43,47–49 Similar improvements have been reported in digital STEM modules across mechanical and electrical engineering education,^50,51 where learners demonstrated better retention and transfer of complex technical concepts.^30,31

Furthermore, the observed pre-post gain suggests that the instructional sequence that incorporated the digital module was associated with higher short-term ABS test performance and may support integrated thinking across science, technology, engineering, and mathematics domains. This interpretation is consistent with research indicating that STEM-based learning can promote analytical reasoning, problem solving, and system-level understanding in vocational contexts, and aligns with calls for digital transformation in vocational education (UNESCO, 2023) The module activities encouraged students to connect motion and friction concepts with technological control systems, which resonates with experiential learning perspectives emphasizing contextualized, hands-on learning.⁵² Nevertheless, because the implementation did not include a comparison group, the results do not provide evidence of causal effectiveness or added value over conventional instruction (Campbell & Stanley, 1963; Shadish et al., 2002). Future research should employ quasi-experimental or experimental comparisons and include longer-term retention and performance-based assessments to examine whether gains are sustained in vocational settings.

Limitations and future directions

This study was limited by the sample size and single-site implementation, which may restrict the generalizability of the findings to other vocational contexts or technical subjects. In addition, the classroom evaluation employed a one-group pre-test/post-test design without a comparison group; therefore, the observed score gains cannot be attributed uniquely to the digital module and may reflect factors such as maturation, teacher explanation, repetition, or the test itself. The study primarily focused on short-term cognitive outcomes and did not examine psychomotor skills or real-world workshop performance. Additionally, long-term retention and transfer of learning were not measured. Future research should involve larger and more diverse samples, including multiple vocational institutions, and employ quasi-experimental or experimental comparisons with conventional instruction or alternative learning resources to examine the module's added value. Further investigations could integrate practical performance assessments and learning analytics to support formative feedback and personalization.

Conclusion

The development and validation of the STEM-based digital ABS module indicate that it is pedagogically and technically feasible for use in vocational automotive education. Media and content expert evaluations confirmed the quality, clarity, and relevance of the learning materials, aligning with digital learning standards for TVET. In this pilot study, the students’ post-test scores were higher than their pre-test scores after using the module, suggesting short-term learning gains during implementation. However, because the study did not include a comparison group, it cannot establish that the observed gains were caused by the module or that the module provides added value relative to conventional instruction. This study provides design and feasibility evidence, as well as initial learning-outcome data, that can inform future controlled evaluations of STEM-oriented digital modules in vocational automotive education.

Supplemental Material

sj-docx-1-ijj-10.1177_03064190261420832 - Supplemental material for Developing and evaluating anti-lock braking systems (ABS) through a STEM-based digital learning module for vocational automotive education

Supplemental material, sj-docx-1-ijj-10.1177_03064190261420832 for Developing and evaluating anti-lock braking systems (ABS) through a STEM-based digital learning module for vocational automotive education by Andri Setiyawan and Muhammad Syamsuddin Nurul Iman in International Journal of Mechanical Engineering Education

Footnotes

ORCID iD

Andri Setiyawan

Ethical approval

Ethical research approval was obtained from the Ethics Committee of the IRB at the Faculty of Engineering, Universitas Negeri Semarang, under Reference Number 47/15/UN37.1.5/KM/2022. This study is part of a broader research project in collaboration with Johannes Kepler University and Universitas Negeri Semarang. The research was conducted in accordance with the ethical principles outlined in the Declaration of Helsinki and complies with the requirements set by the Ministry of Research and Higher Education in Indonesia. Data, including participant information, were handled with confidentiality, and the anonymity of the collected data was ensured to protect participants’ privacy.

Informed consent

For the realization of the research, permission (consent) was sought from university students. Participation in the study was voluntary. The data was collected, saved and analyzed anonymously.

Consent for publication

All authors have read and approved the final version of the article.

Research involving human participants - rights

The study involved human participants who voluntarily chose to participate in the research. All research participants are guaranteed privacy and anonymity.

Credit authorship contribution statement

AS: Conceptualization, Methodology, Validation, Visualization, Writing - original draft, Writing - review & editing; Supervision; Validation MSNI: Methodology, Writing - review & editing, Validation.

Open access funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by Johannes Kepler University Open Access Publishing Fund and the Federal State Upper Austria.

Declaration of conflicting interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Data availability statement and material

All data materials as well as software applications support published claims and comply with field standards. Data that supports the findings of this study are available from the corresponding author, Andri Setiyawan upon reasonable request.

Supplemental material

Supplemental material for this article is available online.

References

Pavlova

. TVET As an important factor in country’s economic development. SpringerPlus 2014; 3: K3.

UNESCO U. Strategy for Technical and Vocational Education and Training (TVET), (2016–2021), https://unesdoc.unesco.org/ark:/48223/pf0000245239 (2016).

UNESCO U. Enhancing TVET through digital transformation in developing countries, https://unesdoc.unesco.org/ark:/48223/pf0000385988 (2023).

Setiyawan

Soeharto

Wijaya

, et al. Measuring Teachers’ competencies for AI integration: Development and validation of the AI-TPACK in vocational education. Comput Educ Open 2025; 9: 100319.

Khumaedi

Widjanarko

Setiadi

, et al. Evaluating the impact of audio-visual Media on learning outcomes of drawing orthographic projections. Int J Educ Pract 2021; 9: 613–624.

Setiyawan

Manggalasari

Prasetya

, et al. Development of hydraulic cylinder excavator learning Media based on augmented reality with shapr 3D. J Phys: Conf Ser 2021; 2111: 012008.

Setiyawan

Priyanto

Prasetya

, et al. Usability evaluation of assignment and monitoring information learning system of internship students based on SMS gateway with raspberry pi. In: IOP Conference Series: Earth and Environmental Science, pp.700. Epub ahead of print 1 March 2021. DOI: 10.1088/1755-1315/700/1/012021

Aldabbus

. Project based learning: Implementations & challenges. Int J Educ Learn Dev 2018; 6: 71–79.

Setiyawan

. Wireless engine diagnostic tool based on internet of things (IoT) with PiOBD-II using raspberry on Honda Jazz VTEC. J Phys: Conf Ser 2022; 2406: 12028.

10.

Setiyawan

Lavicza

Cahyono

, et al. Innovative Media for teaching and learning engineering drawing: Opportunities for future learning and research. Int J Eng Educ 2025; 41: 398–408.

11.

Abdul Razak

Noordin

Abdul Khanan

. Digital learning in technical and vocational education and training (TVET) in Public University, Malaysia. JTET 2022; 14: 49–59.

12.

Oyekunle

Gbenga-Julius

Adeeko

. Unlocking opportunities exploring success factors and challenges of digital integration in vocational and technical education in Nigeria. IJRISS 2024; VIII: 216–228.

13.

Hastawan

Haryono

Utomo

, et al. Comparison of testing load cell sensor data sampling method based on the variation of time delay. IOP Conf Ser: Earth Env Sci 2021; 700: 012018.

14.

. Eight years of development in welcoming and engaging diverse scholars to share and promote STEM education research worldwide. IJ STEM Ed 2022; 9: 69. s40594-022-00385–5.

15.

Zhang

Chia

Chen

. Examining Students’ perceptions of STEM subjects and career interests: An exploratory study among secondary students in Hong Kong. J Technol Educ 2022; 33: 4.

16.

Mantegna

. The braking car problem: A challenging and stimulating test bench for beginning mechanical engineering students. Int J Mech Eng Educ 2019; 47: 99–117.

17.

Mullisen

. Thermal engineering design project: Disk brake cooling simulation. Int J Mech Eng Educ 1997; 25: 299–305.

18.

Ebaid

Ammoura

Al-khishali

. Design, build, and test a formula student racing car: An educational engineering exercise at Philadelphia University. Int J Mech Eng Educ 2016; 44: 56–93.

19.

Gadola

Chindamo

Legnani

, et al. Teaching automotive suspension design to engineering students: Bridging the gap between CAD and CAE tools through an integrated approach. Int J Mech Eng Educ 2019; 47: 23–43.

20.

Magagula

Awodiji

. The implications of the fourth industrial revolution on technical and vocational education and training in South Africa. Soc Sci Human Open 2024; 10: 100896.

21.

Mims

Brooks

Gangadharaiah

, et al. Evaluation of a novel emergency braking task on a driving simulator with haptic anti-lock braking system feedback. Safety 2022; 8: 57.

22.

Petersen

Barrett

Morrison

. Driver-training and emergency brake performance in cars with antilock braking systems. Saf Sci 2006; 44: 905–917.

23.

Broughton

Baughan

. The effectiveness of antilock braking systems in reducing accidents in Great Britain. Accid Anal Prev 2002; 34: 347–355.

24.

Khorasani-Zavareh

Shoar

Saadat

. Antilock braking system effectiveness in prevention of road traffic crashes in Iran. BMC Public Health 2013; 13: 439.

25.

Nurtanto

Pardjono

Widarto

, et al. The effect of STEM-EDP in professional learning on automotive engineering competence in vocational high school. J Educ Gifted Young Scientists 2020; 8: 633–649.

26.

Oyetade

Zuva

Harmse

. Integrating industry 4.0 technologies into IT education. Cogent Educ 2025; 12: 2479195.

27.

Setiyawan

Novianto

Afkar

NBA

, et al. Diesel engine performance test using solar-dex and biodiesel (B30) on power and torque. IOP Conf Ser: Earth Environ Sci 2022; 969: 012034.

28.

Setiyawan

Fitriyana

Bahatmaka

, et al. Diesel engine performance using pertamina dex and biodiesel (B30) on RPM and fuel consumption. IOP Conf Ser: Earth Environ Sci 2023; 1203: 012010.

29.

Margot

Kettler

. Teachers’ perception of STEM integration and education: A systematic literature review. IJ STEM Ed 2019; 6: 2.

30.

Cheng

K-H

Tsai

C-C

. A case study of immersive virtual field trips in an elementary classroom: Students’ learning experience and teacher-student interaction behaviors. Comput Educ 2019; 140: 103600.

31.

Wang

L-H

Chen

Hwang

G-J

, et al. Effects of digital game-based STEM education on students’ learning achievement: A meta-analysis. IJ STEM Ed 2022; 9: 26.

32.

Saldívar-Almorejo

Flores-Herrera

Rivera-Blas

, et al. e-Learning challenges in STEM education. Educ Sci 2024; 14: 1370.

33.

Branch

. Instructional design: The ADDIE approach. Boston, MA: Springer US, 2009. Epub ahead of print 2009. DOI: 10.1007/978-0-387-09506-6

34.

Cronbach

. Coefficient alpha and the internal structure of tests. Psychometrika 1951; 16: 297–334.

35.

Taber

. The use of cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ 2018; 48: 1273–1296.

36.

Bonett

Wright

. Cronbach’s alpha reliability: Interval estimation, hypothesis testing, and sample size planning. J Organ Behavior 2015; 36: 3–15.

37.

Mahya

Setiawan

. Development of carabisatulus chatbot learning Media based on environment to improve science learning outcomes. jppipa, pendidikan ipa, fisika, biologi, kimia 2024; 10: 3132–3140.

38.

Kim

. T test as a parametric statistic. Korean J Anesthesiol 2015; 68: 540.

39.

Fagerland

. t-tests, non-parametric tests, and large studies—a paradox of statistical practice? BMC Med Res Methodol 2012; 12: 78.

40.

Blanca

Alarcón

Arnau

, et al.

Non-normal data: Is ANOVA still a valid option?

Psicothema 2017; 4: 552–557.

41.

Ruxton

. The unequal variance t-test is an underused alternative to student’s t-test and the Mann–Whitney U test. Behav Ecol 2006; 17: 688–690.

42.

Hake

. Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. Am J Phys 1998; 66: 64–74.

43.

Mayer

. Multimedia learning. 3rd ed. Cambridge, UK: Cambridge University Press, 2020.

44.

Al-Fraihat

Joy

Masa’deh

, et al. Evaluating E-learning systems success: An empirical study. Comput Human Behav 2020; 102: 67–86.

45.

Tondeur

Van Braak

Ertmer

, et al. Understanding the relationship between teachers’ pedagogical beliefs and technology use in education: A systematic review of qualitative evidence. Education Tech Research Dev 2017; 65: 555–575.

46.

Reeves

Hedberg

. Interactive learning systems evaluation. Englewood Cliffs, NJ: Educational Technology Publications, 2003.

47.

Benny Herlandy

Al Amien

Pahmi

, et al. A virtual laboratory application for vocational productive learning using augmented reality. Jurnal Pendidikan Teknologi dan Kejuruan 2019; 25: 194–203.

48.

Setiyawan

Soeharto

Maričić

, et al. Integrating 3D modeling and printing in automotive component prototyping: Perceptions of pre-service vocational teachers. Tech Know Learn Epub ahead of print 24 November 2025. DOI: 10.1007/s10758-025-09918-7.

49.

Setiyawan

Soeharto

Yunianto

, et al. How orthographic projection engineering drawing support VHS students in their future career: An industrial perspective. Int J Mech Eng Educ 2025: 03064190251377899.

50.

Bahatmaka

Wibowo

Ghyfery

, et al. Numerical approach of fishing vessel hull form to measure resistance profile and wave pattern of mono-hull design. J Adv Res Fluid Mech Thermal Sci 2023; 104: 1–11.

51.

Ismail

Fitriyana

Bayuseno

, et al. Investigating the effect of deacetylation temperature on the characterization of chitosan from crab shells as a candidate for organic nanofluids. J Adv Res Fluid Mech Thermal Sci 2023; 103: 55–67.

52.

Kolb

. Experiential learning: Experience as the source of learning and development. Englewood Cliffs, NJ: Prentice Hall, 1984.