| 摘要(英) |
In this generation, people need to find a new way to control their computer, smart phone; note book in their daily life, what researchers are interested is how to make it easier to user to communicate with these devices. User hope use some sensor to achieve our goal such as word processing, surf internet, play computer games and video editing, Of course we found using keyboard and mouse alone are not enough, we need to be more convenient and more natural way to control device.
In this paper, we propose a virtual cello, User only need to sit in front of table and raise hand to face camera, the system will match your hand gesture after that you can start playing cello, We use creative Senz 3D to be our sensor, the reason is Senz 3D can capture nearer object than Kinct, And it can receive raw data with PCSDK (Intel Perceptual Computing SDK), we use OpenGL to draw our interface and display 3D model in the screen, The OpenCV is help us to process image.
We proposed a new kind of virtual instrument that can change to different instrument which is a bowed string instrument and it could play a lot of kind of songs because the program is flexible, the user could adjust parameters like music notes, chords, playing position or tones of the instrument. The limit of the Virtual Instrument is music speed. Although it could not play the songs which have a high bpm, for slow songs, it is stable and could be used in a professional music performance.
|
| 參考文獻 |
D. Liu and J. Zhao, "Spatio-temporal Video Object Segmentation Using," Natural Computation (ICNC), 2011 Seventh International Conference on (Volume:4), 26-28 July 2011.
C. Qian, X. Sun, Y. Wei, X. Tang and J. Sun, "Realtime and Robust Hand Tracking from Depth," Oral Acceptance, Computer Vision and Pattern Recognition, 24-27 June 2014.
S. Ghosh, J. Zheng, W. Chen, J. Zhang and Y. Cai, "Real-Time 3D Markerless Multiple Hand Detection and Tracking for Human Computer Interaction Applications," VRCAI ′10 Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its, pp. 323-330, 2010.
H. Bai, L. Gao, J. El-Sana and M. Billinghurst, "Free-Hand Interaction for Handheld Augmented Reality using an RGB-Depth Camera," SA ′13 SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications Article No. 22, ACM, 2013.
J. Raheja, A. Chaudhary and K. Singal, "Tracking of Fingertips and Centres of Palm using KINECT," Computational Intelligence, Modelling and Simulation (CIMSiM), 2011 Third International Conference on, pp. 248-252, 20-22 Sept. 2011.
Y. Li, "Hand gesture recognition using Kinect," Software Engineering and Service Science (ICSESS), 2012 IEEE 3rd International Conference on, pp. 196-199, 22-24 June 2012.
G. Murthy and R. Jadon, "Hand Gesture Recognition using Neural Networks," Advance Computing Conference (IACC), 2010 IEEE 2nd International, pp. 134-138, 19-20 Feb. 2010.
A. Mubashar Khan, W. Umar, T. Choudhary, F. Hussain and M. Haroon Yousaf, "A New Algorithmic Approach for Fingers Detection and Identification," International Conference on Graphic and Image Processing (ICGIP 2012), 20 March 2013.
D. Ghosh and S. Ari, "A Static Hand Gesture Recognition Algorithm Using K-Mean Based Radial Basis Function Neural Network," Information, Communications and Signal Processing (ICICS) 2011 8th International Conference on, pp. 1-5, 13-16 Dec. 2011.
M. Van Den Bergh and L. Van Gool, "Combining RGB and ToF Cameras for Real-time 3D Hand Gesture Interaction," Applications of Computer Vision (WACV), 2011 IEEE Workshop on, pp. 66-72, 5-7 Jan 2011.
V. d. Bergh and Michael, "Haarlet-based hand gesture recognition for 3D interaction.," Applications of Computer Vision (WACV), 2009 Workshop on. IEEE, 2009.
Wang, Fei and C. Zhang, "Feature extraction by maximizing the average neighborhood margin.," Computer Vision and Pattern Recognition, 2007. CVPR′07. IEEE Conference on. IEEE, 2007.
I. Oikonomidis, N. Kyriazis and A. Argyros, "Efficient model-based 3D tracking of hand articulations using Kinect," 22nd British Machine Vision Conference, 29 Aug. 2011.
I. Albrecht, J. Haber and H.-P. Seidel, "Construction and animation of anatomically based human hand models," SCA ′03 Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 98-109, 2003.
S. Melax, L. Keselman and S. Orsten, "Dynamics Based 3D Skeletal Hand Tracking," GI ′13 Proceedings of Graphics Interface 2013, pp. 63-70, 2013.
|
[Endnote RIS 格式]
[相關文章]
[文章引用]
[完整記錄]
[館藏目錄]
[檢視]
plurk
funp
live
udn
HD
myshare
netvibes
friend
youpush
delicious
baidu
Google bookmarks
del.icio.us
hemidemi
facebook
twitter
google
reddit