| dc.description.abstract | Combined a Microsoft Kinect sensor and a projector, we design an interactive table for elementary music education using mixed-reality technology. The interactive table provides 4 modes, inclusive of playing mode, composing mode, staff mode, and entertainment mode.
In playing mode, the system simulates 128 kinds of musical instruments that offer users to play different kinds of instruments with the projected keyboard and to absorb the knowledge of these instruments. In composing mode, the system provides 8 rhythms and 32 chords that help users compose easily. In staff mode, the system automatically verifies the accuracy of music theory while users put musical notes on the staff so that users can learn the concept of staff, time signature, and musical alphabet. Besides, users can record staves and the system would merge them as a song. In entertainment mode, users can choose from 128 kinds of musical instruments and play a beautiful song with the virtual keyboard as if they themselves are famous musician.
After those elementary school students take music classes using our system, we prove that it definitely can help students improve their grades no matter if they manipulate themselves or just assist others aside. Besides, it helps students improve their motivation, concentration, and sense of achievement as well even for those who have no interests in music classes. | en_US |