博碩士論文 103522050 詳細資訊




以作者查詢圖書館館藏 以作者查詢臺灣博碩士 以作者查詢全國書目 勘誤回報 、線上人數:52 、訪客IP:44.204.164.147
姓名 黃也恩(Yeh-en Huang)  查詢紙本館藏   畢業系所 資訊工程學系
論文名稱 手指動作解讀以彈撥樂器為例
(Finger Motion Interpretation - using Plucked Musical Instrument as Example)
檔案 [Endnote RIS 格式]    [Bibtex 格式]    [相關文章]   [文章引用]   [完整記錄]   [館藏目錄]   [檢視]  [下載]
  1. 本電子論文使用權限為同意立即開放。
  2. 已達開放權限電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。
  3. 請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。

摘要(中) 在這個日新月異科技進步的時代,人們需要找到一個新的方式與設備做直接的互動,比如說電腦、筆記型電腦以及智慧型手機,而研究人員也在不斷的研究如何更方便的去運用這些設備,使用者也希望可以透過不同的設備來實現一些常見的運用像是文書編輯、上網、玩遊戲或是影像編輯等等,因為我們發現單單使用滑鼠以及鍵盤這樣間接的互動並不夠直覺,我們想要更自然的和設備互動。
在本文中,我們提出了一個3D豎琴表演系統,使用者只需要坐在電腦前將手放置在設備面前,先將手部模型載入系統內,系統啟動後就會開始偵測使用者的手部模型並且將它呈現在Unity3D的三維空間中,就能和設計的豎琴模型做互動,我們使用Leap motion當作我們的設備,因為Leap motion比起Kinect和Senz 3D,更注重於手指的精確性,開發者可透過Unity 3D來開發相關程式並在此開發所需呈現的介面。
針對表演來看,需要去設計3D豎琴擺放的位置,讓使用者更容易操作,因此除了測試豎琴位置外,對於手指彈奏的部分,也做了一個抓取手指資訊的系統,希望能得到手指活動較穩定的範圍,因此使用者在練習彈奏時,自己能避免做出較不穩定的手勢。
我們提出新的一種虛擬樂器,樂器主要是根據早期的實體豎琴去做設計, 琴弦的音調按照實體豎琴的設計先預設為自然音,但音色也能隨著不同的音檔做改變,在音量部分,對琴弦上做分區,使每一區有不同大小的音量。此外,也對每個分區做音量大小的變換,而目前的限制在於虛擬樂器無法演奏速度比較快的歌曲,不過已經可以表演比較慢的歌曲我們也在今年的資工音樂會上使用這個樂器。
摘要(英) In this generation, people need to find a new way to interact directly with device, such as computer, smart phone, note book. Researchers are constantly studying how to make it easier to user to communicate with these devices, user also hope through different devices to achieve some common use like instrument editor, Internet, play games or video editing and so on, because I found that only use mouse and keyboard did not intuitive, I want to interact more naturally with device.
In this paper, I propose a virtual 3D plucked instruments performance system. User only need to sit in front of table and raise hand to face camera, load the Leap hand model into system, if system start to execute, detect hand model of user, and show it in Unity 3D. Then I can interact with plucked instruments model that is design by myself. I use Leap motion as our device. Compare other device with Leap motion, it is more focus on accuracy of the finger. I can through Unity 3D to develop relevant programs and interface.
For performance, I need to design 3D plucked instrument placements, make it easier to operate. In part of playing virtual plucked instruments with fingertip, I implement a finger data collection system, the goal is know the range of finger motion of stability. Therefore, user can avoid to do the gesture of instability, when user practice virtual plucked instruments.
According to entity Harp and Guqin in early generation, I proposed a new kind of virtual instrument. The strings design in accordance with the entity Harp and Guqin, preset string is natural pitch, and use different audio file to change pitch. In part of control volume, I divide string into five regions, and set it different volume. In addition, I can change volume for each regions. The limit of the Virtual Instrument is music speed. Although it could not play the songs which have a high bpm, for slow songs, it is stable and could be used in a professional music performance.
關鍵字(中) ★ Leap Motion 應用
★ Leap Motion 手指資料收集
★ Unity 3D
★ 虛擬樂器
關鍵字(英) ★ Leap Motion Application
★ Leap Motion Finger Data Collection
★ Unity 3D
★ Virtual Instrument
論文目次 摘要 i
Abstract ii
Acknowledgements iv
Contents v
List of Figures vii
List of Tables ix
Chapter 1. Introduction 1
1.1 Background 1
1.2 Motivation 3
1.3 Thesis Organization 4
Chapter 2. Related works 5
2.1 Usage of color for interface design 5
2.2 Stability of Leap Motion 6
2.3 Finger data for Leap Motion 10
2.4 Combine Unity3D engine and the Leap Motion 15
Chapter 3. Proposed method 22
3.1 Plucked instrument 22
3.2 Virtual Harp instrument 24
3.3 Virtual Guqin instrument 33
3.4 Finger data testing system 42
Chapter 4. Applications and Experiment Result 47
4.1 User Interface 48
4.2 Playing Mechanism 53
4.3 MIDI 54
4.4 Experiment result 56
Chapter 5. Conclusions and Future Works 59
5.1 Conclusions 59
5.2 Future Works 59
References 60

參考文獻 [1]
Peggy Wright, Diane Moser-wooley, and Btuce Wooley, "Technique & Tools for Using Color in computer Interface Design," ACM, Magazine Crossroads - Special issue on human computer interaction, Mar. 1997, pp.3-6.

[2]
Jihyun Han, and Nicolas Gold, “Lessons Learned in Exploring the Leap Motion Sensor for Gesture-based Instrument Design,” New Interface Musical Expression (NIME), 2014.

[3]
Ching-Hua Chuan, Eric Regina, and Caroline Guardio,”American Sign Language Recognition Using Leap Motion Sensor,” Machine Learning and Application (ICMLA), 2014 13th International Conference on IEEE, pp. 541-544.

[4]
Daniel Plemmons and David Holz,”Creating Next-Gen 3D Interactive Apps with Motion Control and Unity3D,” proceeding of Magazine SIGGRAPH ’14 ACM SIGGRAPH 2014 Studio Article, No.24.

[5]
Wonsun Lee, Chulhee Lee, Sungin Hong, Seongah Chin, "Dementia-Prevention Serious Game Techniques using Finger Motion, Object Deformation, and Particle Mapping with Leap-Motion", Proc. of the Intl. Conf. on Advances In Computing, Electronics and Electrical Technology - CEET 2014.

[6]
Pongphan Pongpanitanont and Warakorn Charoensuk, “Leap Motion Signal Preservation and Medical Training System,” IEEE international conference on Biomedical Engineering International (BMEiCON), 2014 , pp. 1-4.

[7]
Leigh Ellen Potter, Jake Araullo and Lewis Carter, “The Leap Motion Controller: A View on Sign Language,” Proceedings of the 25th Australian Computer-Human Interaction, Conference: Augmentation, Application, Innovation, Collaboration, pp. 175-178.

[8]
Joanna C. Coelho and Fons J. Verbeek, “Pointing Task Evaluation of Leap Motion Controller in 3D Virtual Environment,” Proceedings of the Chi Sparks, Apr. 2014 Conference, pp. 78-85.

[9]
Leigh Ellen Potter, Jake Araullo, Lewis Carter, "The Leap Motion controller: A view on sign language", Proceeding OzCHI ′13 Proceedings of the 25th Australian Computer-Human.

[10]
Hongzhe Liu, Yulong Xi, Wei Song, Kyhyun Um, Kyungeun Cho, "Gesture-based NUI Application for Real-time Path Modification", 2013 IEEE 11th International Conference on Dependable, Autonomic and Secure Computing, pp. 446-449.

[11]
P. Chophuk, S. Chumpen, S. Tungjitkusolmun, P. Phasukkit, "Hand Postures for Evaluating Trigger Finger Using Leap Motion Controller", The 201S Biomedical Engineering International Conference (BMEiCON-201S), pp. 1-4.

[12]
Giulio Marin,Fabio Dominio, Pietro Zanuttigh, "Hand Postures for Evaluating Trigger Finger Using Leap Motion Controller", 2014 IEEE International Conference on Image Processing (ICIP), pp. 1565-1569.

[13]
Liberios Vokorokos, Juraj Mihalov, Lubor Lescisin, "Possibilities of Depth Cameras and Ultra Wide Band Sensor ", 2016 IEEE 14th International Symposium on Applied Machine Intelligence and Informatics (SAMI), pp. 57-61.

[14]
Imad Afyouni, Faizan Ur Rehman, Ahmad Qamar, Akhlaq Ahmad, Mohamed Abdur Rahman, Saleh Basalamah, "A GIS-based serious game recommender for online physical therapy", HealthGIS ′14 Proceedings of the Third ACM SIGSPATIAL International Workshop on the Use of GIS in Public Health, pp. 1-10.

[15]
Arun Kulshreshth, Joseph J. LaViola, "Exploring the usefulness of finger-based 3D gesture menu selection", CHI ′14 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1093-1102.

[16]
Nur Atiqah Sia Abdullah, Nur Ida Aniza Rusli, Mohd Faisal Ibrahim, "Mobile game size estimation: COSMIC FSM rules, UML mapping model and Unity3D game engine ", Open Systems (ICOS), 2014 IEEE Conference on, pp. 42-47.

[17]
Joyce Horn Fonteles, Edimo Sousa Silva, Maria Andr´eia Formico Rodrigues, "Gesture-Driven Interaction Using the Leap Motion to Conduct a 3D Particle System: Evaluation and Analysis of an Orchestral Performance", SBC Journal on Interactive Systems, volume 6, number 2, 2015.

[18]
Nandasiri, K.G.M.P., Nawarathna, N.H.C.E.M, Mohamad, M.M.R., Herath, H.M.C.K., Kasthuriarachchi, K.T.S., Wijendra, D., "Advance Technology for Kids to Improve Knowledge and Skills using Motion Gesture Recognition – Leap Mania", NCTM - SLIIT 2014 -DECEMBER.
指導教授 施國深(Timothy K. Shih) 審核日期 2016-7-19
推文 facebook   plurk   twitter   funp   google   live   udn   HD   myshare   reddit   netvibes   friend   youpush   delicious   baidu   
網路書籤 Google bookmarks   del.icio.us   hemidemi   myshare   

若有論文相關問題,請聯絡國立中央大學圖書館推廣服務組 TEL:(03)422-7151轉57407,或E-mail聯絡  - 隱私權政策聲明