| dc.description.abstract | In this generation, people need to find a new way to interact directly with device, such as computer, smart phone, note book. Researchers are constantly studying how to make it easier to user to communicate with these devices, user also hope through different devices to achieve some common use like instrument editor, Internet, play games or video editing and so on, because I found that only use mouse and keyboard did not intuitive, I want to interact more naturally with device.
In this paper, I propose a virtual 3D plucked instruments performance system. User only need to sit in front of table and raise hand to face camera, load the Leap hand model into system, if system start to execute, detect hand model of user, and show it in Unity 3D. Then I can interact with plucked instruments model that is design by myself. I use Leap motion as our device. Compare other device with Leap motion, it is more focus on accuracy of the finger. I can through Unity 3D to develop relevant programs and interface.
For performance, I need to design 3D plucked instrument placements, make it easier to operate. In part of playing virtual plucked instruments with fingertip, I implement a finger data collection system, the goal is know the range of finger motion of stability. Therefore, user can avoid to do the gesture of instability, when user practice virtual plucked instruments.
According to entity Harp and Guqin in early generation, I proposed a new kind of virtual instrument. The strings design in accordance with the entity Harp and Guqin, preset string is natural pitch, and use different audio file to change pitch. In part of control volume, I divide string into five regions, and set it different volume. In addition, I can change volume for each regions. The limit of the Virtual Instrument is music speed. Although it could not play the songs which have a high bpm, for slow songs, it is stable and could be used in a professional music performance. | en_US |