| dc.description.abstract | A number of past-related studies have revealed that physical movements could facilitate the learner’s learning process. We came to think of combining Total Physical Response and technology to enhance their English ability. In this research, we developed a system based on Microsoft Kinect and integrated five components, physical movement recognition, speech recognition, emotion recognition, direction recognition, and object recognition. This mechanism helps the learners go through the meaning of vocabularies through physical movements. We designed two main modules in our system. One is the learning module, and another is kinesthetic recognition mechanism. For the experimental group, a two-person cooperation mode is adopted, on the other hand, a single play mode is adopted for the control group. In the experimental group, learners cooperate with each other to help. In order to make
it easier for learners to cooperate and discuss. we conducted the activities in a face-to-face manner. In the hardware deployment framework, each learner has one computer、KinectV2、screen and headset. In addition, we use the database to store the learner′s learning behavior and construct a server for data transfer so that learners can cooperate and interact in the activities. The results show that the system can improve the learner′s performance in English writing,pronunciation and the memorization of vocabulary. | en_US |