博碩士論文 102522102 詳細資訊




以作者查詢圖書館館藏 以作者查詢臺灣博碩士 以作者查詢全國書目 勘誤回報 、線上人數:14 、訪客IP:44.200.169.3
姓名 黃嘉慶(Chia-ching Huang)  查詢紙本館藏   畢業系所 資訊工程學系
論文名稱 即時手部追蹤系統以虛擬大提琴為例
(Implement Virtual Cello by Real Time Hand Tracking System)
相關論文
★ 基於edX線上討論板社交關係之分組機制★ 利用Kinect建置3D視覺化之Facebook互動系統
★ 利用 Kinect建置智慧型教室之評量系統★ 基於行動裝置應用之智慧型都會區路徑規劃機制
★ 基於分析關鍵動量相關性之動態紋理轉換★ 基於保護影像中直線結構的細縫裁減系統
★ 建基於開放式網路社群學習環境之社群推薦機制★ 英語作為外語的互動式情境學習環境之系統設計
★ 基於膚色保存之情感色彩轉換機制★ 一個用於虛擬鍵盤之手勢識別框架
★ 分數冪次型灰色生成預測模型誤差分析暨電腦工具箱之研發★ 使用慣性傳感器構建即時人體骨架動作
★ 基於多台攝影機即時三維建模★ 基於互補度與社群網路分析於基因演算法之分組機制
★ 即時手部追蹤之虛擬樂器演奏系統★ 基於類神經網路之即時虛擬樂器演奏系統
檔案 [Endnote RIS 格式]    [Bibtex 格式]    [相關文章]   [文章引用]   [完整記錄]   [館藏目錄]   [檢視]  [下載]
  1. 本電子論文使用權限為同意立即開放。
  2. 已達開放權限電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。
  3. 請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。

摘要(中) 在這個日新月異科技進步的時代,人們需要找到一個新的方式來使用他們日常生活用具包含:電腦、智慧型手機以及筆記型電腦,而研究人員也在不斷的研究如何更方便的與這些設備互動,使用者也希望可以透過一些不同的設備來達到日常生活中的常用的動作像是文書編輯、上網、玩遊戲或是影像編輯等等,所以我們發現單單使用滑鼠以及鍵盤並不足夠,我們需要更自然的動作來跟這些設備互動。
在本文中,我們提出了一款虛擬大提琴,使用者只需要坐在電腦前將手放置相機面前,系統就會開始偵測使用者的手勢,正確追蹤後使用者便可開始演奏樂器,我們使用Intel提出的Creative Senz 3D 當作我們的設備,Senz 3D可以擷取比Kinect近的距離,開發者只需要透過PCSDK便可以開發相關的程式,我們使用OpenGL繪製手部模型以及使用者介面,並且使用OpenCV處裡一些影像處裡。
我們提出新的一種虛擬樂器,這種樂器可以改變成任何弓弦樂器,只需要改變輸出的音色就可成為另外的樂器,除此之外也可以自由地改變樂器的把位、弦的位置或是間距因為程式是靈活的,而目前的限制在於虛擬樂器無法演奏速度比較快的歌曲,不過已經可以表演比較慢的歌曲我們也在今年的資工音樂會上使用這個樂器。
摘要(英) In this generation, people need to find a new way to control their computer, smart phone; note book in their daily life, what researchers are interested is how to make it easier to user to communicate with these devices. User hope use some sensor to achieve our goal such as word processing, surf internet, play computer games and video editing, Of course we found using keyboard and mouse alone are not enough, we need to be more convenient and more natural way to control device.
In this paper, we propose a virtual cello, User only need to sit in front of table and raise hand to face camera, the system will match your hand gesture after that you can start playing cello, We use creative Senz 3D to be our sensor, the reason is Senz 3D can capture nearer object than Kinct, And it can receive raw data with PCSDK (Intel Perceptual Computing SDK), we use OpenGL to draw our interface and display 3D model in the screen, The OpenCV is help us to process image.
We proposed a new kind of virtual instrument that can change to different instrument which is a bowed string instrument and it could play a lot of kind of songs because the program is flexible, the user could adjust parameters like music notes, chords, playing position or tones of the instrument. The limit of the Virtual Instrument is music speed. Although it could not play the songs which have a high bpm, for slow songs, it is stable and could be used in a professional music performance.
關鍵字(中) ★ 手部追蹤
★ 虛擬樂器
★ 影像處理
關鍵字(英) ★ hand tracking
★ finger tracking
★ image processing
★ Senz 3D
論文目次 摘要 i
Abstract ii
Acknowledgements iii
Contents iv
List of Figures vii
List of Tables x
Chapter 1. Introduction 1
1.1 Background 1
1.2 Motivation 2
1.3 Thesis Organization 3
Chapter 2. Related works 4
2.1 Appearance-based hand tracking 4
2.2 Hand tracking with Neural Network 11
2.3 Model based hand tracking 16
2.4 The analysis of existing method 21
Chapter 3. Technology of Hand tracking 22
3.1 Environment 22
3.2 Region of Interest 23
3.3 Morphology 24
3.4 Center point of palm 24
3.5 Edge detection 26
3.6 Find convex hull 27
3.7 Finger region distribution 28
3.8 Proposed method 30
3.9 The work flow of system 33
3.10 Model based hand tracking 34
3.11 Finger tapping 37
3.12 Hand motion detection 38
Chapter 4. Applications 39
4.1 Virtual Cello 39
4.2 Virtual two string fiddle (Erhu) 41
4.3 MIDI 42
Chapter 5. Conclusions and Future Works 44
5.1 Environment 44
5.2 Conclusions 45
5.3 Future Works 48
References 49
參考文獻 D. Liu and J. Zhao, "Spatio-temporal Video Object Segmentation Using," Natural Computation (ICNC), 2011 Seventh International Conference on (Volume:4), 26-28 July 2011.
C. Qian, X. Sun, Y. Wei, X. Tang and J. Sun, "Realtime and Robust Hand Tracking from Depth," Oral Acceptance, Computer Vision and Pattern Recognition, 24-27 June 2014.
S. Ghosh, J. Zheng, W. Chen, J. Zhang and Y. Cai, "Real-Time 3D Markerless Multiple Hand Detection and Tracking for Human Computer Interaction Applications," VRCAI ′10 Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its, pp. 323-330, 2010.
H. Bai, L. Gao, J. El-Sana and M. Billinghurst, "Free-Hand Interaction for Handheld Augmented Reality using an RGB-Depth Camera," SA ′13 SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications Article No. 22, ACM, 2013.
J. Raheja, A. Chaudhary and K. Singal, "Tracking of Fingertips and Centres of Palm using KINECT," Computational Intelligence, Modelling and Simulation (CIMSiM), 2011 Third International Conference on, pp. 248-252, 20-22 Sept. 2011.
Y. Li, "Hand gesture recognition using Kinect," Software Engineering and Service Science (ICSESS), 2012 IEEE 3rd International Conference on, pp. 196-199, 22-24 June 2012.
G. Murthy and R. Jadon, "Hand Gesture Recognition using Neural Networks," Advance Computing Conference (IACC), 2010 IEEE 2nd International, pp. 134-138, 19-20 Feb. 2010.
A. Mubashar Khan, W. Umar, T. Choudhary, F. Hussain and M. Haroon Yousaf, "A New Algorithmic Approach for Fingers Detection and Identification," International Conference on Graphic and Image Processing (ICGIP 2012), 20 March 2013.
D. Ghosh and S. Ari, "A Static Hand Gesture Recognition Algorithm Using K-Mean Based Radial Basis Function Neural Network," Information, Communications and Signal Processing (ICICS) 2011 8th International Conference on, pp. 1-5, 13-16 Dec. 2011.
M. Van Den Bergh and L. Van Gool, "Combining RGB and ToF Cameras for Real-time 3D Hand Gesture Interaction," Applications of Computer Vision (WACV), 2011 IEEE Workshop on, pp. 66-72, 5-7 Jan 2011.
V. d. Bergh and Michael, "Haarlet-based hand gesture recognition for 3D interaction.," Applications of Computer Vision (WACV), 2009 Workshop on. IEEE, 2009.
Wang, Fei and C. Zhang, "Feature extraction by maximizing the average neighborhood margin.," Computer Vision and Pattern Recognition, 2007. CVPR′07. IEEE Conference on. IEEE, 2007.
I. Oikonomidis, N. Kyriazis and A. Argyros, "Efficient model-based 3D tracking of hand articulations using Kinect," 22nd British Machine Vision Conference, 29 Aug. 2011.
I. Albrecht, J. Haber and H.-P. Seidel, "Construction and animation of anatomically based human hand models," SCA ′03 Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 98-109, 2003.
S. Melax, L. Keselman and S. Orsten, "Dynamics Based 3D Skeletal Hand Tracking," GI ′13 Proceedings of Graphics Interface 2013, pp. 63-70, 2013.
指導教授 施國琛(Timothy K. Shih) 審核日期 2015-7-16
推文 facebook   plurk   twitter   funp   google   live   udn   HD   myshare   reddit   netvibes   friend   youpush   delicious   baidu   
網路書籤 Google bookmarks   del.icio.us   hemidemi   myshare   

若有論文相關問題,請聯絡國立中央大學圖書館推廣服務組 TEL:(03)422-7151轉57407,或E-mail聯絡  - 隱私權政策聲明