dc.description.abstract | In this generation, people need to find a new way to control their computer, smart phone; note book in their daily life, what researchers are interested is how to make it easier to user to communicate with these devices. User hope use some sensor to achieve our goal such as word processing, surf internet, play computer games and video editing, Of course we found using keyboard and mouse alone are not enough, we need to be more convenient and more natural way to control device.
In this paper, we propose a virtual cello, User only need to sit in front of table and raise hand to face camera, the system will match your hand gesture after that you can start playing cello, We use creative Senz 3D to be our sensor, the reason is Senz 3D can capture nearer object than Kinct, And it can receive raw data with PCSDK (Intel Perceptual Computing SDK), we use OpenGL to draw our interface and display 3D model in the screen, The OpenCV is help us to process image.
We proposed a new kind of virtual instrument that can change to different instrument which is a bowed string instrument and it could play a lot of kind of songs because the program is flexible, the user could adjust parameters like music notes, chords, playing position or tones of the instrument. The limit of the Virtual Instrument is music speed. Although it could not play the songs which have a high bpm, for slow songs, it is stable and could be used in a professional music performance.
| en_US |