適用於3D虛擬打擊樂器之多感測器融合技術;A multi-sensor fusion technology for 3D virtual percussion instrument

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Computer Science and Information Engineering > Electronic Thesis & Dissertation > Item 987654321/72048

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/72048

Title:	適用於3D虛擬打擊樂器之多感測器融合技術;A multi-sensor fusion technology for 3D virtual percussion instrument
Authors:	黎哲瑋;Li,Che-Wei
Contributors:	資訊工程學系
Keywords:	虛擬樂器;打擊樂器;角速度感測器;加速度感測器;Kinect;IMUduino;Virtual Instrument;Percussion Instrument;Groscope
Date:	2016-07-19
Issue Date:	2016-10-13 14:23:26 (UTC+8)
Publisher:	國立中央大學
Abstract:	在這科技日新月異的時代，電腦與人之間已經不再是只有滑鼠鍵盤與電腦螢幕的關係了，隨著人機互動的發達，各式各樣的感應器、視訊鏡頭、甚至能提供虛擬實境的頭戴式顯示器等等，都更加的讓我們能體驗到電腦資訊的進步。微軟的深度攝影機Kinect 便在一開始與 Xbox 結合，提供了全然不同的遊戲體驗方式。多了深度資訊，除了內建的人體骨架追蹤外，我們也能藉此利用在3D 呈像上，著實的為工程師們增加了開發各式各樣的應用程式的機會與可能。在Kinect 提供的人體骨架追蹤上，利用這些關節的資訊，我們實現了開發虛擬樂器的可能，然而，如打擊樂器中，常會利用手指的關節控制鼓棒來擊打樂器，但骨架追蹤並無法分辨出細至手指的程度，如此便不能達到如真實樂器般的表演感受。故我們便使用了IMUduino 加速度感應器黏置於鼓棒上提供即時快速的位置及加速度。藉由利用人體骨架的位置來定位擊打位置，以及加速度感應器的加速度以及角速度感測器的即時回饋，我們利用此些特性便能簡易的製作出各種打擊樂器，藉由改變音源庫的音色以及各擊打位置，便能隨意地轉換演奏樂器。;People play music for enjoying lives. However, there are always some obstacle like the fund issue, space limitation or troubles carrying the instruments around. Human-Computer Interaction has been developed rapidly these years. Keyboards and mouse from the very beginning evolve to all kinds of sensor and cameras. Music instruments made by technology has no longer a fantasy in this decade. This kind of thoughts first came out from gaming product like Wii and XBox. But their purposes are mostly for fun, not for replace the real instruments. Bypass the RGB camera which occurs occlusion, infrared cameras have more abilities and capability recognizing users. Kinect , produced by Microsoft, contains a RGB camera and a infrared camera along with their own SDK which can track human skeleton and faces. For developer, it is more convenient of having the position of body parts to fulfill the program. To fully achieve our project, we adopt Kinect 2 as our devices to track skeletons and IMUduino , a smallest and lightest Arduino Leonardo board with motion sensors, to detect a trigger point. With IMUduino on the drumsticks, we can solve the low speed of human joints and the motion blur caused by high-speed hitting. Moreover, user interface are filled with 3D object and user’s body which formed by pointcloud to simulate the real playing environment.
Appears in Collections:	[Graduate Institute of Computer Science and Information Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	182	View/Open

社群 sharing

Loading...