摘要(英) |
Combined a Microsoft Kinect sensor and a projector, we design an interactive table for elementary music education using mixed-reality technology. The interactive table provides 4 modes, inclusive of playing mode, composing mode, staff mode, and entertainment mode.
In playing mode, the system simulates 128 kinds of musical instruments that offer users to play different kinds of instruments with the projected keyboard and to absorb the knowledge of these instruments. In composing mode, the system provides 8 rhythms and 32 chords that help users compose easily. In staff mode, the system automatically verifies the accuracy of music theory while users put musical notes on the staff so that users can learn the concept of staff, time signature, and musical alphabet. Besides, users can record staves and the system would merge them as a song. In entertainment mode, users can choose from 128 kinds of musical instruments and play a beautiful song with the virtual keyboard as if they themselves are famous musician.
After those elementary school students take music classes using our system, we prove that it definitely can help students improve their grades no matter if they manipulate themselves or just assist others aside. Besides, it helps students improve their motivation, concentration, and sense of achievement as well even for those who have no interests in music classes. |
參考文獻 |
[1] J. M. Piro and C. Ortiz, “The effect of piano lessons on the vocabulary and verbal sequencing skills of primary grade students,” Psychology of Music, Vol. 37, pp. 325-348, 2009.
[2] 夏琳.海伯梅爾著,滕淑芬譯,學音樂,孩子更聰明,智庫文化,台灣,民國八十九年。
[3] L. Hetland, “Learning to Make Music Enhances Spatial Reasoning,” Journal of Aesthetic Education, Vol. 34, No. 3/4, pp. 179-238, 2000.
[4] 姚世澤,「音樂治療活動對國中階段中重度智障學生社會技能之影響」,國立臺灣師範大學,碩士論文,民國88年。
[5] S. Hallam, “The power of music: Its impact on the intellectual, social and personal development of children and young people,” International Journal of Music Education, Vol. 28, pp. 269-290, 2010.
[6] 楊秀惠和陳嘉彌,「積木角遊戲活動引爆創造力之啟思」,幼兒保育學刊,第五期,87~112頁,2007。
[7] 吳雅玲和許惠欣,「積木遊戲-幼兒單位積木的遊戲型態」,幼兒教保研究期刊,第二期,19~43頁,2008。
[8] Kinect圖片[Online] Available:
http://msdn.microsoft.com/zh-tw/hh367958.aspx Apr. 7, 2013[data accessed]
[9] G. D. Peters, “Music Software and Young Children Fun and Focused Instruction,” General Music Today, Vol. 22, pp. 37-39, SAGE, 2009.
[10] Groovy Shapes Software圖片[Online] Available:
http://www.nook.se/groovy-music-sibelius/ Apr. 7, 2013[data accessed]
[11] Garageband[Online] Available:
http://www.apple.com/tw/apps/garageband/ Apr. 7, 2013[data accessed]
[12] D. Merrill, J. Kalanithi, and P. Maes, “Siftables: Towards Sensor Network User Interfaces,” in TEI’07, pp. 75-78, Baton Rouge, LA, USA, Feb 2007.
[13] Siftables[Online] Available:
http://www.ted.com/talks/david_merrill_demos_siftables_the_smart_blocks.html Apr. 7, 2013[data accessed]
[14] 國民中小學九年一貫課程綱要藝術與人文學習領域,國民教育司,民國97年。
[15] Noteput[Online] Available:
http://www.jonasheuer.de/index.php/noteput/ Apr. 7, 2013[data accessed]
[16] M. Kaltenbrunner, S. Jord`a, G. Geiger, and M. Alonso, “The reacTable*: A Collaborative Musical Instrument,” IEEE Trans. Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE’06), pp. 406-411, June 2006.
[17] Reactable圖片[Online] Available:
http://www.reactable.com/products/live/design/ Apr. 7, 2013[data accessed]
[18] S. Lynch, M. A. Nacenta, S. Carpendale, “ToCoPlay: Graphical Multi-touch Interaction for Composing and Playing Music,” Lecture Notes in Computer Science, Vol. 6948, pp. 306-322, 2011.
[19] ToCoPlay[Online] Available:
http://www.youtube.com/watch?NR=1&v=VwG_kXWliRo&feature=endscreen Apr. 7, 2013[data accessed]
[20] M. Piovesana, Y. Chen, N. Yu, H. Wu, L. Chan, and Y. Hung, “Multi-Display Map Touring with Tangible Widget,” in Proc. ACM Multimedia, pp.679-682, 2010
[21] Classroom of the future[Online] Available:
http://www.universitiesweek.org.uk/Media/Pages/DurhamUniversity.aspx Apr. 7, 2013[data accessed]
[22] 星際迷航觸摸系統教室[Online] Available: http://tech.qq.com/a/20121125/000036.htm Apr. 7, 2013[data accessed]
[23] moJo iCuisine互動餐廳[Online] Available: http://www.youtube.com/watch?v=CO8u6V9DGcw&feature=endscreen&NR=1 Apr. 7, 2013[data accessed]
[24] 林志杰,新版MIDI玩家手冊,第3波出版社,民國八十三年。
[25] MIDI Commands[Online] Available:
http://computermusicresource.com/MIDI.Commands.html Apr. 7, 2013[data accessed]
[26] MIDI音色[Online] Available:
http://www.autosoft.com.hk/article/newuser/snd_midi2/gm_map.htm Apr. 7, 2013[data accessed]
[27] 吳承宗,「基於深度攝影機之混合實境互動桌」,國立中央大學,碩士論文,民國101年。
[28] K. S. Arun, T. Huang, and S. D. Blostein, “Least-Squares Fitting of Two 3-D Point Sets,” IEEE Trans. Analysis and Machine Intelligence, Vol.9, No.5, pp. 698-700, 1987.
[29] 連國珍,數位影像處理,儒林圖書有限公司,民國九十七年。
[30] 楊武智,影像處理與辨認,全華科技圖書股份有限公司,民國九十年。
[31] C#指標掃描影像[Online] Available:
http://www.wretch.cc/blog/qqqoooqw/7444116 Apr. 7, 2013[data accessed]
[32] M. K. Hu, “Visual pattern recognition by moment invariants,” IRE Trans. on Information Theory, Vol.8, No.2, pp. 179-187, Feb 1962.
[33] 鋼鼓圖片[Online] Available:
http://saint616.pixnet.net/blog/post/68220861-%E6%9C%83%E5%94%B1%E6%AD%8C%E7%9A%84%E6%B1%BD%E6%B2%B9%E6%A1%B6---%E6%9C%B1%E5%AE%97%E6%85%B6%E6%89%93%E6%93%8A%E6%A8%82%E5%9C%98%E3%80%8A%E9%8B%BC%E9%BC%93%E9%9F%B3%E6%A8%82 Apr. 7, 2013[data accessed]
[34] 卡林巴圖片[Online] Available:
https://itunes.apple.com/au/app/kalimba-free/id300802995?mt=8 Apr. 7, 2013[data accessed]
[35] 小號指法圖片[Online] Available:
http://www.yyjx.net/ketang/UploadFiles/200506/200568133810526.gif Apr. 7, 2013[data accessed]
[36] Kinect near mode[Online] Available:
http://blogs.msdn.com/b/kinectforwindows/archive/2012/01/20/near-mode-what-it-is-and-isn-t.aspx Apr. 7, 2013[data accessed]
[37] M. C. Su, W. Y. Lee, and S. Y. Chen, “Electronic Trombone-An Interactive Tool to Promote Musical Learning and Performance Creativity,” in VRCAI ’11, pp. 585-588, New York, NY, USA, 2011.
[38] ADSR[Online] Available:
http://blog.yam.com/ktliao88/article/6016664 Apr. 7, 2013[data accessed]
[39] 陳俊文,「形成性評量對國中生於「自然與生活科技」網路學習課程情意學習之影響-以「發現生命的驚奇」單元為例」,國立彰化師範大學,碩士論文,民國93年。 |