| dc.description.abstract | The purpose of language learning is to ＂communicate.＂ The ideal learning should be linked to the problem situations that may be encountered in the future, so that the learning knowledge can be applied when encountering relevant problems. The real language interaction is not only the oral interaction of listening and speaking, but also the body language and interaction. However, for a long time, the teaching scene has only basic teaching of listening, speaking, reading and writing, and there is no interactive learning of body language.
The purpose of this study is to propose a digital learning theater with gesture recognition for body language understanding. Through gesture recognition, it is possible to instantly recognize whether the user′s body movements are correct or not, and to give a corresponding response. Students must complete situational tasks in the context, learn body language and spoken language, and interact with each other through physical and oral language. The user′s emotional interaction makes the user′s performance more lively and interesting, thus increasing interest and fun for learning.
In order to explore whether the digital drama with the addition of gesture recognition and interaction can improve the learning effectiveness, interest and interest of language and physical movements, this study cooperates with a Japanese language teacher at a university in Taoyuan City to conduct experiments to allow students to study Japanese and body language for restaurant service. The experimental data shows that adding body language recognition and interaction can increase the learning effect, interest and interest of language and body movements.
| en_US |