學習語言的目的是為了「溝通」。而理想的學習應與未來可能遇到問題情境連結，以便往後遇到相關問題時能應用學習的知識，真實的語言互動，並不只僅僅只是聽與說的口語互動，還包含了肢體語言的互動。然而長久以來觀察教學現場，只有基本的聽、說、讀、寫的教學，而沒有肢體語言的互動學習。 本研究旨在提出一個具辨識肢體語言之數位學習劇場，將肢體辨識加入數位學習劇場當中，可即時辨識使用者之肢體動作是否做的正確，及給出相應回應即建議。學生在情境中須完成情境任務，同時學習肢體語言與口語，並以肢體與口語進行交流互動，建立使用者的情感互動讓使用者的表演較活潑、有趣，進而增加對於學習的興趣、樂趣。 為探討加入肢體語言辨識及互動的數位戲劇是否能提高語文及肢體動作的學習成效、學習興趣、趣味性，本研究與桃園市某科技大學日語教師合作進行實驗，讓學生學習餐飲日文以及餐飲服務禮儀動作，並透過前後測、問卷對於學習成效、學習興趣、趣味性進行檢驗。透過實驗結果發現加入肢體語言辨識及互動能夠增加語文及肢體動作的學習成效、學習興趣、趣味性。 ;The purpose of language learning is to "communicate." The ideal learning should be linked to the problem situations that may be encountered in the future, so that the learning knowledge can be applied when encountering relevant problems. The real language interaction is not only the oral interaction of listening and speaking, but also the body language and interaction. However, for a long time, the teaching scene has only basic teaching of listening, speaking, reading and writing, and there is no interactive learning of body language. The purpose of this study is to propose a digital learning theater with gesture recognition for body language understanding. Through gesture recognition, it is possible to instantly recognize whether the user′s body movements are correct or not, and to give a corresponding response. Students must complete situational tasks in the context, learn body language and spoken language, and interact with each other through physical and oral language. The user′s emotional interaction makes the user′s performance more lively and interesting, thus increasing interest and fun for learning. In order to explore whether the digital drama with the addition of gesture recognition and interaction can improve the learning effectiveness, interest and interest of language and physical movements, this study cooperates with a Japanese language teacher at a university in Taoyuan City to conduct experiments to allow students to study Japanese and body language for restaurant service. The experimental data shows that adding body language recognition and interaction can increase the learning effect, interest and interest of language and body movements.
