即時手部追蹤系統以虛擬大提琴為例;Implement Virtual Cello by Real Time Hand Tracking System

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Computer Science and Information Engineering > Electronic Thesis & Dissertation > Item 987654321/68730

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/68730

Title:	即時手部追蹤系統以虛擬大提琴為例;Implement Virtual Cello by Real Time Hand Tracking System
Authors:	黃嘉慶;Huang,Chia-ching
Contributors:	資訊工程學系
Keywords:	手部追蹤;虛擬樂器;影像處理;hand tracking;finger tracking;image processing;Senz 3D
Date:	2015-07-16
Issue Date:	2015-09-23 14:22:43 (UTC+8)
Publisher:	國立中央大學
Abstract:	在這個日新月異科技進步的時代，人們需要找到一個新的方式來使用他們日常生活用具包含：電腦、智慧型手機以及筆記型電腦，而研究人員也在不斷的研究如何更方便的與這些設備互動，使用者也希望可以透過一些不同的設備來達到日常生活中的常用的動作像是文書編輯、上網、玩遊戲或是影像編輯等等，所以我們發現單單使用滑鼠以及鍵盤並不足夠，我們需要更自然的動作來跟這些設備互動。在本文中，我們提出了一款虛擬大提琴，使用者只需要坐在電腦前將手放置相機面前，系統就會開始偵測使用者的手勢，正確追蹤後使用者便可開始演奏樂器，我們使用Intel提出的Creative Senz 3D 當作我們的設備，Senz 3D可以擷取比Kinect近的距離，開發者只需要透過PCSDK便可以開發相關的程式，我們使用OpenGL繪製手部模型以及使用者介面，並且使用OpenCV處裡一些影像處裡。我們提出新的一種虛擬樂器，這種樂器可以改變成任何弓弦樂器，只需要改變輸出的音色就可成為另外的樂器，除此之外也可以自由地改變樂器的把位、弦的位置或是間距因為程式是靈活的，而目前的限制在於虛擬樂器無法演奏速度比較快的歌曲，不過已經可以表演比較慢的歌曲我們也在今年的資工音樂會上使用這個樂器。 ;In this generation, people need to find a new way to control their computer, smart phone; note book in their daily life, what researchers are interested is how to make it easier to user to communicate with these devices. User hope use some sensor to achieve our goal such as word processing, surf internet, play computer games and video editing, Of course we found using keyboard and mouse alone are not enough, we need to be more convenient and more natural way to control device. In this paper, we propose a virtual cello, User only need to sit in front of table and raise hand to face camera, the system will match your hand gesture after that you can start playing cello, We use creative Senz 3D to be our sensor, the reason is Senz 3D can capture nearer object than Kinct, And it can receive raw data with PCSDK (Intel Perceptual Computing SDK), we use OpenGL to draw our interface and display 3D model in the screen, The OpenCV is help us to process image. We proposed a new kind of virtual instrument that can change to different instrument which is a bowed string instrument and it could play a lot of kind of songs because the program is flexible, the user could adjust parameters like music notes, chords, playing position or tones of the instrument. The limit of the Virtual Instrument is music speed. Although it could not play the songs which have a high bpm, for slow songs, it is stable and could be used in a professional music performance.
Appears in Collections:	[Graduate Institute of Computer Science and Information Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	329	View/Open

社群 sharing

Loading...