Context-Aware Multimodal Feedback System for Enhancing Outcomes-Based Education in Mechanical Engineering

Authors

  • CUI Fangyuan School of Mechanical Engineering, Henan Institute of Technology, Xinxiang, Henan 453000, China Author

DOI:

https://doi.org/10.5281/zenodo.15582126

Keywords:

context-aware multimodal feedback system, Outcomes-Based Education (OBE), mechanical engineering, personalized feedback, cognitive assessment

Abstract

We propose a context-aware multimodal feedback system designed to enhance Outcomes-Based Education (OBE) in mechanical engineering by dynamically adapting feedback modalities to individual learning contexts and performance. The system integrates cognitive diagnosis models to assess student proficiency and an environment-aware modality selector to determine the optimal feedback form, such as visual annotations, haptic cues, or interactive 3D simulations, depending on whether the learning occurs in physical laboratories or digital platforms. A Transformer-based architecture synthesizes personalized feedback by combining diagnostic outputs with contextual data, enabling precision-tailored support for complex engineering concepts. The proposed method replaces conventional static assessment reports with adaptive, multimodal feedback, thereby addressing the limitations of one-size-fits-all approaches in OBE. Furthermore, the system leverages state-of-the-art technologies, including probabilistic programming for scalable cognitive diagnosis and physics-accurate simulations for immersive learning experiences. Experimental validation demonstrates its effectiveness in improving student engagement and mastery of mechanical engineering principles. This work contributes a unified framework that bridges cognitive assessment, environmental context, and multimodal feedback, offering a scalable solution for personalized engineering education. The results highlight the potential of adaptive feedback systems to transform traditional OBE practices by aligning instructional support with individual learning trajectories and real-world engineering scenarios.

Downloads

Download data is not yet available.

References

KM D’Souza (2024) A Study of Multimodal AI and Human Feedback loops in STEM Learning Environments. hammer.purdue.edu.

Q Liu, R Wu, E Chen, G Xu, Y Su, Z Chen, et al. (2018) Fuzzy cognitive diagnosis for modelling examinee performance. ACM Transactions on Intelligent Systems and Technology.

Y Lin & S Wang (2019) The study and application of adaptive learning method based on virtual reality for engineering education. In International conference on image and graphics.

M Hernandez-de-Menendez, CA Escobar Díaz, et al. (2020) Engineering education for smart 4.0 technology: a review. International Journal on Interactive Design and Manufacturing.

A Liljaniemi & H Paavilainen (2020) Using digital twin technology in engineering education–course concept to explore benefits and barriers. Open Engineering.

J Dāboliņš & J Grundspeņķis (2013) The role of feedback in intelligent tutoring system. Applied Computer Systems.

J Qadir, A Shafi, A Al-Fuqaha, AEM Taha, KLA Yau, et al. (2020) Outcome-based engineering education: A global report of international obe accreditation and assessment practices. eprints.gla.ac.uk.

FR dos Santos & P Notargiacomo (2018) Intelligent educational assistant based on multiagent system and context-aware computing. International Journal of Advanced Computer Science and Applications.

AWC Oreta & CLC Roxas (2012) Implementing an outcomes-based education framework in the teaching of engineering mechanics (statics). In International Conference On Civil Engineering.

X Li & WC Wang (2015) Assessment of differential item functioning under cognitive diagnosis models: The DINA model example. Journal of Educational Measurement.

M Barak (2013) Teaching engineering and technology: cognitive, knowledge and problem-solving taxonomies. Journal of Engineering, Design and Technology.

Y Zhou, Q Liu, J Wu, F Wang, Z Huang, et al. (2021) Modeling context-aware features for cognitive diagnosis in student learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.

L Yan, V Echeverria, Y Jin, et al. (2024) Evidence‐based multimodal learning analytics for feedback and reflection in collaborative learning. British Journal of Educational Technology.

KR Patil, S Bhandari, SK Ayer, et al. (2018) Potential for virtual reality and haptic feedback to enhance learning outcomes among construction workers. Applications of Virtual Reality.

H Cornide-Reyes, F Riquelme, D Monsalves, R Noel, et al. (2020) A multimodal real-time feedback platform based on spoken interactions for remote active learning support. Sensors.

İ Yuksel (2011) The effects of post-observational feedback modes on teaching beliefs: Peer vs. Teacher-mediated feedback. Turkish Online Journal of Qualitative Inquiry.

C Salzmann, W Halimi, D Gillet & S Govaerts (2018) Deploying large-scale online labs with smart devices. Cyber-Physical Laboratories in Engineering and Science Education.

JN Akhigbe & AE Adeyemi (2020) Using gender responsive collaborative learning strategy to improve students’ achievement and attitude towards learning science in virtual and hands-on laboratory …. Journal of Pedagogical Research.

I Nurjannah, M Cholik, T Wiyanto, et al. (2021) Development of OBE-Based Learning Evaluation Model in Mechanical Engineering Education Program. In International Joint Conference on Science and Engineering.

S Watt, C Simpson, C McKillop, et al. (2002) Electronic course surveys: does automating feedback and reporting give better results?. Assessment & Evaluation In Higher Education.

OL Georgeon & I Sakellariou (2012) Designing environment-agnostic agents. In International Conference on Autonomous Agents and Multiagent Systems.

S Mukhopadhyay & S Smith (2010) Outcome-based education: principles and practice. Journal of Obstetrics and Gynaecology.

CWE Whiteman (2003) Mechanical engineering curricula: a baseline study for the future effects of ABET EC2000. International Journal of Mechanical Engineering Education.

S Goel & N Sharda (2004) What Do Engineers Want? Examining Engineering Education through Bloom’s Taxonomy. Online Submission.

T Chow, E Ko, C Li & C Zhou (2012) The systematic development of rubrics in assessing engineering learning outcomes. In Proceedings of IEEE International Conference on Teaching, Assessment, and Learning for Engineering.

SM Downing (2003) Item response theory: applications of modern test theory in medical education. Medical education.

J Torre & ND Minchen (2019) The G-DINA model framework. Handbook Of Diagnostic Classification Models: Models And Model Extensions.

V Le, JM Nissen, X Tang, Y Zhang, A Mehrabi, et al. (2025) Applying cognitive diagnostic models to mechanics concept inventories. Physical Review Physics Education Research.

RE Mayer (2005) Cognitive theory of multimedia learning. The Cambridge Handbook Of Multimedia Learning.

D Chamaret, S Ullah, P Richard & M Naud (2010) Integration and evaluation of haptic feedbacks: from CAD models to virtual prototyping. International Journal on Interactive Design and Manufacturing.

K Hourigan, M Rudman & E Brocher (1996) The feedback loop in impinging two-dimensional high-subsonic and supersonic jets. Experimental Thermal and Fluid Science.

ZA Syed, Z Trabookis, J Bertrand, et al. (2019) Evaluation of virtual reality based learning materials as a supplement to the undergraduate mechanical engineering laboratory experience. International Journal of Engineering Education.

L Ghosh & R Ravichandran (2024) Emerging technologies in vocational education and training. Journal of Digital Learning and Education.

D Oyekunle, BEA Claude, AO Waliu, et al. (2024) Cloud based adaptive learning system: virtual reality and augmented reality assisted educational pedagogy development on clinical simulation. Journal of Digital Healthcare.

C Fachola, A Tornaría, P Bermolen, G Capdehourat, et al. (2023) Federated learning for data analytics in education. Data.

Downloads

Published

2025-06-03

Data Availability Statement

The data that support the findings of this study are available on request from the corresponding author, upon reasonable request.

Issue

Section

Articles

How to Cite

CUI Fangyuan. (2025). Context-Aware Multimodal Feedback System for Enhancing Outcomes-Based Education in Mechanical Engineering. Global Academic Frontiers, 3(2), 58-72. https://doi.org/10.5281/zenodo.15582126