即時手部追蹤之虛擬樂器演奏系統;Designing Virtual Instruments by Real-Time Finger Tracking System

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Computer Science and Information Engineering > Electronic Thesis & Dissertation > Item 987654321/65588

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/65588

Title:	即時手部追蹤之虛擬樂器演奏系統;Designing Virtual Instruments by Real-Time Finger Tracking System
Authors:	許木炘;Hsu,Mu-hsen
Contributors:	資訊工程學系
Keywords:	Kinect;Leap Motion;手指追蹤;虛擬樂器;OpenNI;Kinect SDK;Kinect;Leap Motion;Finger Tracking;Virtual Instrument;OpenNI;Kinect SDK
Date:	2014-07-10
Issue Date:	2014-10-15 17:05:27 (UTC+8)
Publisher:	國立中央大學
Abstract:	人機互動漸漸成為電腦科學及資訊工程相關研究中的一個重要領域，並且讓人們可以使用各種方式與電腦或設備進行溝通。同時，許多研究者也希望從中發展出更多新的研究議題。Kinect是由微軟公司發行的一個3D感測裝置，使用者可以透過Kinect得到的環境深度資料應用在各種開發和研究。近年來，許多的開發者函式庫陸續的誕生，如微軟官方的 Kinect SDK或PrimeSense公司發布的OpenNI, 這些函式庫提供了包括人體骨架追蹤和深度資料分析的相關技術。然而，這些技術只僅限於人體大節點的追蹤如:手、頭、膝蓋..等。如果需要更細部的偵測如手指，這些開放式函式庫就無法達成，然而 Leap Motion和Senz3d感測器可以達成手指的追蹤，並且提供了相關的函式庫，讓使用者開發自己的應用程式。雖然這些新一代的感測器有相當程度的精確度，並且提供了手指追蹤的函式，但是它有操作距離的限制，使用者必須在固定的位置操作，另外，它所提供的手指追蹤函式庫如果要應用在虛擬樂器的演奏上效率是比較不足的。在這篇論文中，作者設計了一個基於Kinect感測器的手指追蹤演算法，該系統可即時的分析深度資料並且追蹤到使用者的手指。系統可以應用在各個領域或軟體，我們將該系統設計為虛擬樂器的控制器，讓使用者可以透過自身的手勢彈奏樂器。;Human Computer Interaction is becoming a major component in computer science related fields allowing humans to communicate with machines in very simple ways exploring new dimensions of research. Kinect, the 3D sensing device introduced by Microsoft which allows developers to use depth data for research. Recently, there are several mature libraries such as OpenNI and Kinect SDK which provide functions of Human skeleton tracking. Therefore, users may find that these applications only work with big joints of human body. When it comes to the tracking of fingers, devices such as Leap Motion or Senz3D will be mentioned because it provide APIs (Application Programming Interface) and games, which users can communicate with the computer by their fingers. Although these new devices provides functions of finger tracking, the operating distance is short and users need to sit in a fixed position. On the other hand, the efficiency of current tracking method is hard to be used for Virtual Instrument. Here, in this paper, authors’ experimental efforts on detailed hand tracking including fingers based on Microsoft Kinect. Analyzing the depth information captured by Kinect in real time, users can apply the result in different scopes such as device controller and Virtual Instruments.
Appears in Collections:	[Graduate Institute of Computer Science and Information Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	389	View/Open

社群 sharing

Loading...