| 摘要: | 在這個日新月異科技進步的時代，人們需要找到一個新的方式與設備做直接的互動，比如說電腦、筆記型電腦以及智慧型手機，而研究人員也在不斷的研究如何更方便的去運用這些設備，使用者也希望可以透過不同的設備來實現一些常見的運用像是文書編輯、上網、玩遊戲或是影像編輯等等，因為我們發現單單使用滑鼠以及鍵盤這樣間接的互動並不夠直覺，我們想要更自然的和設備互動。
在本文中，我們提出了一個3D豎琴表演系統，使用者只需要坐在電腦前將手放置在設備面前，先將手部模型載入系統內，系統啟動後就會開始偵測使用者的手部模型並且將它呈現在Unity3D的三維空間中，就能和設計的豎琴模型做互動，我們使用Leap motion當作我們的設備，因為Leap motion比起Kinect和Senz 3D，更注重於手指的精確性，開發者可透過Unity 3D來開發相關程式並在此開發所需呈現的介面。
針對表演來看，需要去設計3D豎琴擺放的位置，讓使用者更容易操作，因此除了測試豎琴位置外，對於手指彈奏的部分，也做了一個抓取手指資訊的系統，希望能得到手指活動較穩定的範圍，因此使用者在練習彈奏時，自己能避免做出較不穩定的手勢。
我們提出新的一種虛擬樂器，樂器主要是根據早期的實體豎琴去做設計， 琴弦的音調按照實體豎琴的設計先預設為自然音，但音色也能隨著不同的音檔做改變，在音量部分，對琴弦上做分區，使每一區有不同大小的音量。此外，也對每個分區做音量大小的變換，而目前的限制在於虛擬樂器無法演奏速度比較快的歌曲，不過已經可以表演比較慢的歌曲我們也在今年的資工音樂會上使用這個樂器。
;In this generation, people need to find a new way to interact directly with device, such as computer, smart phone, note book. Researchers are constantly studying how to make it easier to user to communicate with these devices, user also hope through different devices to achieve some common use like instrument editor, Internet, play games or video editing and so on, because I found that only use mouse and keyboard did not intuitive, I want to interact more naturally with device.
In this paper, I propose a virtual 3D plucked instruments performance system. User only need to sit in front of table and raise hand to face camera, load the Leap hand model into system, if system start to execute, detect hand model of user, and show it in Unity 3D. Then I can interact with plucked instruments model that is design by myself. I use Leap motion as our device. Compare other device with Leap motion, it is more focus on accuracy of the finger. I can through Unity 3D to develop relevant programs and interface.
For performance, I need to design 3D plucked instrument placements, make it easier to operate. In part of playing virtual plucked instruments with fingertip, I implement a finger data collection system, the goal is know the range of finger motion of stability. Therefore, user can avoid to do the gesture of instability, when user practice virtual plucked instruments.
According to entity Harp and Guqin in early generation, I proposed a new kind of virtual instrument. The strings design in accordance with the entity Harp and Guqin, preset string is natural pitch, and use different audio file to change pitch. In part of control volume, I divide string into five regions, and set it different volume. In addition, I can change volume for each regions. The limit of the Virtual Instrument is music speed. Although it could not play the songs which have a high bpm, for slow songs, it is stable and could be used in a professional music performance. |
