| dc.description.abstract | Traditional learning methods largely rely on printed materials, with teachers delivering knowledge orally, leading to teacher-dominated instruction and passive knowledge reception by students in the classroom. However, in skill-intensive disciplines such as physical education and hospitality services, learners need to engage multiple senses and bodily actions to learn and apply knowledge practically. Furthermore, learners are required to reflect on their multimodal behaviors after learning.
To enable learners to engage in learning and reflection through their own embodied behaviors in scenarios, this study has designed a multimodal embodied situated learning and reflection system. Applied in a digital synchronous setting, the system captures and stores the learners′ various sensory performances using stereo cameras and microphones. This allows learners to interact based on their multimodal embodied behaviors and control a avatar to enter virtual scenarios for learning. During the learning process, multimodal data analysis allows for real-time assessment of learners′ embodied behaviors, providing corresponding multimodal learning scaffolds and system feedback. Learners can engage in reflective learning by reviewing their multimodal learning records. With this system, learners can enhance their learning outcomes, motivation, and reflective thinking without increasing cognitive load.
To validate whether this system can enhance related learning aspects, the system was further applied in actual courses. The research results indicate that this system can enhance learners′ learning outcomes without increasing cognitive load, and also positively affects their learning motivation and reflective thinking. | en_US |