博碩士論文 103522044 詳細資訊




以作者查詢圖書館館藏 以作者查詢臺灣博碩士 以作者查詢全國書目 勘誤回報 、線上人數:11 、訪客IP:54.172.169.199
姓名 劉玠泓(Liu, Chieh-Hung)  查詢紙本館藏   畢業系所 資訊工程學系
論文名稱 三維空間之即時手部追縱與吉他和弦手勢辨識
(Real-Time 3D Hand Tracking and Guitar Gesture Recognition)
相關論文
★ 基於edX線上討論板社交關係之分組機制★ 利用Kinect建置3D視覺化之Facebook互動系統
★ 利用 Kinect建置智慧型教室之評量系統★ 基於行動裝置應用之智慧型都會區路徑規劃機制
★ 基於分析關鍵動量相關性之動態紋理轉換★ 基於保護影像中直線結構的細縫裁減系統
★ 建基於開放式網路社群學習環境之社群推薦機制★ 英語作為外語的互動式情境學習環境之系統設計
★ 基於膚色保存之情感色彩轉換機制★ 一個用於虛擬鍵盤之手勢識別框架
★ 分數冪次型灰色生成預測模型誤差分析暨電腦工具箱之研發★ 使用慣性傳感器構建即時人體骨架動作
★ 基於多台攝影機即時三維建模★ 基於互補度與社群網路分析於基因演算法之分組機制
★ 即時手部追蹤之虛擬樂器演奏系統★ 基於類神經網路之即時虛擬樂器演奏系統
檔案 [Endnote RIS 格式]    [Bibtex 格式]    [相關文章]   [文章引用]   [完整記錄]   [館藏目錄]   [檢視]  [下載]
  1. 本電子論文使用權限為同意立即開放。
  2. 已達開放權限電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。
  3. 請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。

摘要(中) 人機互動漸漸成為電腦科學中的一個重要議題,它讓我們能更輕易地與電腦或各種設備進行交流。本篇提出了一個基於區域搜索的手部追蹤方法,我們採用了三維點雲 (Point Cloud) 資訊的方法來改善手部追蹤的穩定度,並且介紹了一個基於分群的手指指尖偵測方法,可以在手指追蹤失敗時用來還原手指座標。在手部追蹤完成後,我們利用手指指尖座標與我們的吉他和弦手勢資料庫比對,並且將結果整合到虛擬吉他系統中。在最後,我們設計了一個實驗讓一般的使用者在我們的虛擬吉他系統上演奏一首。而我們也分別在Kinect V1和Kinect V2彈上三首歌來討論兩種感測器的差異。結果說明了我們的方法在虛擬吉他系統上表現良好,而一般使用者也能簡單地學習我們的系統。
摘要(英) Human Computer Interaction (HCI) is becoming a hot issue in computer science which makes people communicate with computers easier. A novel hand tracking method based on region search is presented in this paper. We adopt the concept of 3D point clouds to further improve the stability of hand tracking. Also, the cluster-based finger detection is introduced in this paper, which can be used for restoring finger position if finger tracking failed. After hand tracking finished, we use the position of fingertips to match our hand gesture with our guitar hand gesture database, and integrate proposed method into our virtual guitar system. At last, we setup an experiment which allows general users to play a song with our virtual guitar system. And we also test our system by playing three songs on both Kinect V1 and Kinect V2 sensor and discuss their difference. The result shows that our method performs well on virtual guitar system and general users can learn our system easily.
關鍵字(中) ★ 手指追縱
★ 吉他和弦手勢辨識
★ 點雲
★ 深度資訊
★ 即時
★ 區域搜尋
關鍵字(英) ★ Finger Tracking
★ Guitar Chord Gesture Recognition
★ Point Clouds
★ Depth Data
★ Real-Time
★ Region Search
論文目次 摘要 i
Abstract ii
Acknowledgements iii
Contents iv
List of Figures vii
List of Tables ix

Chapter 1. Introduction 1
1.1 Background 1
1.2 Motivation 2
1.3 Thesis Organization 3

Chapter 2. Related Works 4
2.1 Musical applications on Kinect 4
2.1.1 3D Music Control interface 4
2.1.2 A Gesture-Based Game for Teaching Music to Children 4
2.2 The analysis of existing method 5
2.2.1 Real-time Markerless Kinect based Finger Tracking and Hand Gesture Recognition for HCI 5
2.2.2 A robust method of detecting hand gestures using depth sensors 5
2.2.3 3D fingertips and palm tracking in depth image sequences 6
2.2.4 Efficient Model-based 3D Tracking of Hand Articulations using Kinect 7
2.3 Kinect V1 vs Kinect V2 8
2.4 Acoustic fingerprint 9
2.5 MIDI protocol 10

Chapter 3. Proposed method 13
3.1 Depth Frame and Point Clouds 14
3.2 Reduce Data Usage 16
3.2.1 Build Lookup Table for Hand Data 16
3.2.2 Down Sampling Hada Data 18
3.3 Center Point of Hand Palm and Wrist Removement 19
3.4 Hand Flipping Detection 20
3.5 Finger Detection 21
3.6 Finger Tracking 24
3.7 Finger Labeling 27
3.8 Guitar Chord Gesture Recognition 30

Chapter 4. Experimental Results and Discussions 33
4.1 Preliminary Results 33
4.2 Experiment Setup 34
4.2.1 Chord Testing 35
4.2.2 Note Testing 36
4.2.3 Song List and Testing Machine 37
4.2.4 Comparsion Tools and Method 38
4.2.5 Preparation of hand database 44
4.3 Experiment Results 45
4.3.1 Self Testing 45
4.3.2 User Testing 46
4.3.3 Benchmark Testing 48

Chapter 5. Conclusions and Future Works 49
5.1 Conclusions 49
5.2 Future Works 53

References 58
參考文獻 [1] Wu. A, Shah. M, and Da Vitoria Lobo. N, “A virtual 3D blackboard: 3D finger tracking using a single camera,” Proceedings of fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 536-543, Mar 2000.

[2] Hui Liang, Junsong Yuan, and Daniel Thalmann, “3D fingertips and palm tracking in depth image sequences”, Proceedings of the 20th ACM international conference on multimedia, 2012, pp.785-788.

[3] Arun Kulshreshth, Chris Zorn, Joseph J., LaViola Jr., “Real-time Markerless Kinect based Finger Tracking and Hand Gesture Recognition for HCI”, 2013 IEEE Symposium on 3D User Interfaces (3DUI), 2013, pp. 187-188

[4] Yan Wen, Chuanyan Hu, Guanghui Yu, Changbo Wang, “A robust method of detecting hand gestures using depth sensors”, 2012 IEEE International Workshop on Haptic Audio Visual Environments and Games (HAVE), 2012, pp. 72-77

[5] Iason Oikonomidis, Nikolaos Kyriazis, Antonis Argyros, “Efficient Model-based 3D Tracking of Hand Articulations using Kinect”, Proceedings of the British Machine Vision Conference, 2011, pp. 101.1-101.11

[6] Zhou Ren, Junsong Yuan, Zhengyou Zhang, “Robust Hand Gesture Recognition Based on FingerEarth Mover’s Distance with a Commodity Depth Camera”, Proceedings of the 19th ACM international conference on Multimedia, 2011, pp. 1093-1096

[7] Jagdish L. Raheja, Ankit Chaudhary, Kunal Singal, “Tracking of Fingertips and Centers of Palm Using KINECT”, 2011 Third International Conference on Computational Intelligence Modelling and Simulation (CIMSiM), 2011, pp. 248-252

[8] Stergios Poularakis, Ioannis Katsavounidis, “Finger detection and hand posture recognition based on depth information”, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2014, pp. 4329-4333

[9] G. Odowichuk, S. Trail, P. Driessen, W. Nie, W. Page, “Sensor fusion: Towards a fully expressive 3D music control interface”, 2011 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PacRim), 2011, pp. 836-841

[10] Manuela Renzi, Stavros Vassos, Tiziana Catarci, Stephen Kimani, “Touching Notes: A Gesture-Based Game for Teaching Music to Children”, TEI ′15 Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, 2015, pp. 603-606.

[11] Hamed Sarbolandi, Damien Lefloch, Andreas Kolb, “Kinect Range Sensing: Structured-Light versus Time-of-Flight Kinect”, Computer Vision and Image Understanding Volume 139, 2015, pp. 1-20.

[12] http://www.similarityapp.com/

[13] P. Cano; E. Batle; T. Kalker; J. Haitsma, “A review of algorithms for audio fingerprinting”, 2002 IEEE Workshop on Multimedia Signal Processing, 2002, pp. 169-173.
[14] Jonathan T. Foote, “Content-based retrieval of music and audio”, Multimedia Storage and Archiving Systems II Vol. 3229, 1997, pp. 138-147.

[15] http://www.midomi.com/
[16] https://www.cakewalk.com/Products/SONAR
[17] http://www.nerds.de/en/loopbe1.html
[18] https://www.guitar-pro.com/en/index.php
[19] http://www.asio4all.com/
[20] https://goo.gl/or5cu1
[21] https://midi-protocol.wikispaces.com/03-MIDI+Message
[22] https://www.music.mcgill.ca/~gary/rtmidi/

[23] Mu Hsen Hsu, “Real-Time Finger Tracking for Virtual Instruments”, 2014 7th International Conference on Ubi-Media Computing and Workshops (UMEDIA), 2014, pp. 133-138.

[24] https://duo3d.com/product/duo-minilx-lv1#tab=specs
指導教授 施國琛(Timothy K. Shih) 審核日期 2016-7-19
推文 facebook   plurk   twitter   funp   google   live   udn   HD   myshare   reddit   netvibes   friend   youpush   delicious   baidu   
網路書籤 Google bookmarks   del.icio.us   hemidemi   myshare   

若有論文相關問題,請聯絡國立中央大學圖書館推廣服務組 TEL:(03)422-7151轉57407,或E-mail聯絡  - 隱私權政策聲明