以Kinect深度影像攝影機為基礎之嬰幼兒音樂互動系統

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：15

、訪客IP：3.15.145.50

姓名

彭永成(Yung-Cheng Peng) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

以Kinect深度影像攝影機為基礎之嬰幼兒音樂互動系統
(A Kinect-based Interactive System for Children)

相關論文

★ 以Q-學習法為基礎之群體智慧演算法及其應用	★ 發展遲緩兒童之復健系統研製
★ 從認知風格角度比較教師評量與同儕互評之差異：從英語寫作到遊戲製作	★ 基於檢驗數值的糖尿病腎病變預測模型
★ 模糊類神經網路為架構之遙測影像分類器設計	★ 複合式群聚演算法
★ 身心障礙者輔具之研製	★ 指紋分類器之研究
★ 背光影像補償及色彩減量之研究	★ 類神經網路於營利事業所得稅選案之應用
★ 一個新的線上學習系統及其於稅務選案上之應用	★ 人眼追蹤系統及其於人機介面之應用
★ 結合群體智慧與自我組織映射圖的資料視覺化研究	★ 追瞳系統之研發於身障者之人機介面應用
★ 以類免疫系統為基礎之線上學習類神經模糊系統及其應用	★ 基因演算法於語音聲紋解攪拌之應用

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

隨著資訊化時代來臨，社會競爭力越來越大，早期嬰幼兒教育日益受到重視。許多研究指出嬰兒天生並非「白板」一塊，而是有我們未知的各種心理及學習能力，而且嬰幼兒時期心理發展的水平和質量對之後的兒童期、青年期乃至一生都俱有重要的影響。然而嬰兒之聽覺系統在出生時相較於聽覺系統就已發展成熟，所以音樂對於嬰幼兒時期被視為重要的學習教材。研究指出，孩童若越早接觸音樂，能夠幫助孩童提升其語言發展、增強創新能力，並且改善身體的協調性。因此本論文就以工程角度及音樂為基礎，結合 Kinect 深度影像攝影機，提出一個以往不同的互動方式，並應用在嬰兒育樂教育上。
而科技的進步，市面上出現許多跟嬰幼兒互動之電子玩具，這些電子玩具，由於設計上的限制和成本的考量，不免單調且缺乏創造性。因此，本論文提出了一個為嬰幼兒設計的音樂互動系統，結合空間概念、物體運動捕捉及粒子濾波器為基礎的物體追蹤，建構出五種根據不同嬰幼兒發展時期所設計的互動模式：音樂鈴模式（Music Ring Mode）、鋼琴彈奏模式（Piano Mode）、聲音組合模式（Sound Combination Mode）、環境探索模式（Environmental Exploration Mode）及音樂變化模式（Music variation Mode）。藉由以上互動模式，本論文建構出一個有探索、學習、育樂環境之音樂互動環境，讓嬰兒能夠伴隨音樂的旋律，探索世界、認識自我，奠定往後心理及生理發展的基礎。最後，實驗將針對系統準確率作驗證及使用經驗進行相關探討與提供改進的方法。

摘要(英)

With the era of information technology, social competitiveness is higher and higher, early childhood education is getting more attention gradually. Many studies have pointed out that the infant is not a "whiteboard", but has a variety of psychological and learning ability that we don’t know, and the level and quality of infant mental development has great impact on childhood, adolescence, even the future of life. However, the auditory system of the infant at birth compared to other sensory system had been developed, so the music is regarded as an important learning material for children. Many researches indicate that to receive music education early can help children enhance their language development and enhance its ability to innovate or improve the coordination of the body. Therefore, this thesis proposed a different interact compared to the past from engineering and music perspective by using Kinect and apply in infant education.
With advances in technology, there appear many electronic toys to interact with infants and young children, these electronic toys are inevitably monotonous and lack of creativity due to design constraints and cost considerations. Therefore, this thesis proposed a music interactive system for children, combined with the concept of space, motion capture and particle-filter based object tracking, that consists of five different interactive modes: Music ring mode, Piano mode, Sound combination mode, Environmental exploration mode and Music variation mode. By these interactive modes, this system construct a music interactive entertainment with exploratory, learning, interactive that the baby can able to accompany the melody, to explore the world, self-understanding, to lay the foundation of psychophysiology development. Finally, the experiment will verify the system accuracy and using experience of user to discuss and provide improved methods.

關鍵字(中)

★ 嬰兒教育
★ 粒子濾波器
★ 人機界面
★ Kinect
★ 音樂學習

關鍵字(英)

★ kinect
★ human-computer interface
★ particle filter
★ infant education
★ music learning

論文目次

中文摘要 i
ABSTRACT ii
致謝 iv
目錄 v
圖目錄 ix
表目錄 xiii
第一章、緒論 1
1-1 研究動機 1
1-2 研究目的 2
1-3 論文架構 3
第二章、相關研究 4
2-1 嬰兒心智發展 4
2-2 音樂教育 9
2-3 相關音樂互動裝置及嬰幼兒互動玩具 10
2-3-1 相關音樂互動裝置 10
2-3-2 嬰幼兒互動玩具 14
2-4 人機界面設計及評估 16
2-5 Kinect 感應器 18
2-5-1 偵測深度範圍及精確度 20
2-5-2 紅外線雷射的安全性 22
2-6 物件追蹤 24
2-6-1 區塊追蹤法 24
2-6-2 特徵追蹤法 24
2-6-3 預測追蹤法 25
第三章、研究方法及步驟 26
3-1 系統架構 26
3-2 音樂鈴模式 27
3-2-1 深度資訊前處理 28
3-2-2 活動偵測 29
3-2-3 根據活動量控制聲量 30
3-3 鋼琴彈奏模式 31
3-3-1 活動區塊運動方向偵測 32
3-3-2 根據活動區塊之運動方向的發聲規則 35
3-4 聲音組合模式、音樂變化模式 37
3-4-1 追蹤目標物 39
3-4-2 發聲規則 43
3-5 環境探索模式 44
3-5-1 真實空間轉換 46
3-5-2 計算平面方程式 48
3-5-3 判斷標記區域是否有活動 52
第四章、嬰幼兒音樂互動系統設計 55
4-1 開發環境 55
4-2 音樂互動模式介紹 56
4-2-1 音樂鈴模式 56
4-2-2 鋼琴彈奏模式 58
4-2-3 聲音組合模式 60
4-2-4 環境探索模式 62
4-2-5 音樂變化模式 64
第五章、實驗及問卷調查 65
5-1 實驗設計與流程 65
5-2 系統正確率實驗 68
5-2-1 音樂鈴模式系統正確率實驗 68
5-2-2 鋼琴彈奏模式系統正確率實驗 69
5-2-3 聲音組合模式系統正確率實驗 70
5-2-4 環境探索模式系統正確率實驗 71
5-2-5 音樂變化模式系統正確率實驗 72
5-3 問卷設計與分析 73
5-3-1 問卷設計 73
5-3-2 問卷分析 73
5-4 系統效能評估 75
5-4-1 音樂鈴模式效能評估 75
5-4-2 鋼琴彈奏模式效能評估 76
5-4-3 聲音組合、音樂變化模式效能評估 77
5-4-4 環境探索模式效能評估 78
第六章、結論與未來展望 79
6-1 結論 79
6-2 未來展望 79
參考文獻 81
附錄一 88
附錄二 90

參考文獻

[1] Johnson’s Baby : 音樂對幼兒的深遠影響 [Online] Available : http://www.johnsonsbaby.com.hk/knowledgebase/development/4.12.2.aspx Jun. 23, 2012 [data accessed]
[2] K. Huang, T. Starner, E. Do, G. Weiberg, D. Kohlsdorf, C. Ahlrichs, and R. Leibrandt, “Mobile music touch: mobile tactile stimulation for passive learning,” in Proc. of the 28th International Conference on Human factors in computing systems, pp. 791–800, New York, USA, 2010.
[3] Kidsource : Music Appreciation : A Universal Language For All Ages [Online] Available : http://www.kidsource.com/education/music.html Jun. 21, 2012 [data accessed]
[4] M. W. Krogman, Child Growth. Ann Arbour, University of Michigan Press, 1972.
[5] K. Portmann, “Die tragzeiten der primaten und die dauer die schwangerschaft biem menschen : ein problem vergleichen biologie,” Review of Swiss Zoology, pp. 511-518, 1941.
[6] John Oate著，邱維珍譯，兒童發展導論，五南文化，民國八十八年。
[7] J. S. Gould, Ontogeny and Phylogeny, Cambridge, Mass., Harvard University Press, p. 369, 1977.
[8] 信誼 : 大腦上網路啦！～嬰兒心智發展與學 [Online] Available : http://parent.kimy.com.tw/new/article.aspx?id=1481 Jun. 23, 2012 [data accessed]
[9] R. P. Huttenlocher, “Synaptic density in human frontal cortex-developmental changes and effects of ageing,” Brain Research, pp. 195-205, 1979.
[10] 楊明道，「0~1 歲嬰兒發展指標」，嬰兒與母親，352，130~136頁，民國九十五年二月。
[11] 育兒百科 : 促進探索行為的 4 條近囊妙計 [Online] Available : http://baby.lifepedia.net/view/4874/ Jun. 24, 2012 [data accessed]
[12] S. Gertner, C. Greenbaum, A. Sadeh, Z. Dolfin, L. Sirota, and Y. Ben-Nun, “Sleep-wake patterns in preterm infants and 6 month’s home environment : Implications for early cognitive development.” Early Human Development, pp. 93–102, 2002.
[13] Charles R. Hoffer著，李茂興譯，音樂教育概論，揚智文化，民國八十六年。
[14] 夏琳．海伯梅爾著，滕淑芬譯，學音樂，孩子更聰明，智庫文化，民國八十九年。
[15] M. Desainte-Catherine, G. Kurtag, S. Marchand, C. Semal, and P. Hanna, “Playing with sounds as playing video games,” ACM Computers in Entertainment, vol. 2, no. 2, pp. 1–22, 2004.
[16] H. E. Krugman and E. L. Hartley, Passive learning from television, The Public Opinion Quarterly, Oxford University Press, vol. 34, no. 2, pp. 184–190, 1970.
[17] C. Zukin and R. Snyder, Passive learning: When the media environment is the message, The Public Opinion Quarterly, Oxford University Press, vol. 48, no. 3, pp. 629–638, 1984.
[18] 張蕙慧，「兒童音樂教育與心理學關係析論」，新竹師院學報，第八期，137~164 頁，民國八十四年。
[19] 嬰兒彈奏樂器圖 [Online] Available : http://kemall.shop.rakuten.tw/200000001397574/ Jun. 21, 2012 [data accessed]
[20] 嬰兒彈奏樂器圖 [Online] Available : http://kemall.shop.rakuten.tw/200000000690865/ Jun. 21, 2012 [data accessed]
[21] 床邊音樂鈴 [Online] Available : http://kemall.shop.rakuten.tw/200000001349012/ Jun. 21, 2012 [data accessed]
[22] 嬰兒腳部鋼琴圖 [Online] Available : http://www.baby22.com.tw/comm/upimage/PD-090826-023514.jpg Jun. 21 , 2012 [data accessed]
[23] 嬰兒腳部玩具圖 [Online] Available : http://img.pcstore.com.tw/~prod/M07933970_big.jpg?pimg=static&P=1298461536 Jun. 21, 2012 [data accessed]
[24] J. H. Alker, L. Sproull and R. Subramani, “Using a human face in an interface,” in Proc. of CHI-94, pp.85-91, 1994.
[25] 人機介面組成要素 [Online] Available : http://squall.cs.ntou.edu.tw/UserInterface/HumanComputerInterface.html Jun. 21, 2012 [data accessed]
[26] J. Nielsen, “Heuristic Evaluation,” Usability Inspection Methods, John Wiley & Sons, New York, 1994.
[27] Kinect感應器 [Online] Available : http://msdn.microsoft.com/zh-tw/hh367958.aspx Jun. 21, 2012 [data accessed]
[28] Light Coding [Online] Available : http://www.primesense.com/technology Jun. 21, 2012 [data accessed]
[29] 雷射光散斑圖 [Online] Available : http://www.bb.ustc.edu.cn/jpkc/guojia/dxwlsy/kj/part2/grade3/LaserSpeckle/image001.jpg Jun. 21, 2012 [data accessed]
[30] Kinect 深度點密度分布圖 [Online] Available : http://kheresy.files.wordpress.com/2011/12/depthhistogram.png?w=630 Jun. 21, 2012 [data accessed]
[31] S. Jorda, G. Geiger, M. Alonso, and M. Kaltenbrunner, “The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces,” in 1st International Conference on Tangible and Embedded Interaction, pp. 139-146, 2007.
[32] J. Nielsen, N. K. Barendsen, and C. Jessen, “RoboMusicKids- Music education with robotic building blocks,“ in 2nd IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning, pp. 149-156, 2008.
[33] H. K. Min, “SORISU: Sound with Numbers“, in 9th International Conference on New Interfaces for Musical Expression, 2009.
[34] S. Chun, A. Hawryshkewich, K. Jung, and P. Pasquier, “Freepad: A Custom Paper-based MIDI Interface,” in 10th International Conference on New Interfaces for Musical Expression, 2010.
[35] AMIO [Online] Available : http://www.sea-labs.com/previews/amio/ Jun. 21, 2012 [data accessed]
[36] J. Davis, Recognizing movement using motion histograms, MIT Media lab Technical Report, 487, March 1999.
[37] Scharr 運算式 [Online Availagle] : http://en.wikipedia.org/wiki/Sobel_operator Jun. 21, 2012 [data accessed]
[38] Sobel 運算式 [Online] Available : http://zh.wikipedia.org/wiki/索貝爾算子 Jun. 21, 2012 [data accessed]
[39] G. Bradski and A. Kaehler, Learning OpenCV, O’Reilly, 2008.
[40] M. Isard and A. Blake, “Contour Tracking by Stochastic Propagation of Conditional Density,” European Conference on Computer Vision, pp. 343-356, 1996.
[41] M. Isard and A. Blake, “CONDENSATION - Conditional Density Propagation for Visual Tracking,” International Journal on Computer Vision, vol. 29, no. 1, pp. 5-28, 1998.
[42] K. Nummiaro, K. M. Esther, and L. V. Gool, "An Adaptive Color-Based Particle Filter," in Proc. of Image And Vision Computing, vol. 21, pp. 99-110, 2003.
[43] Kinect 空間座標分析 [Online] Available : http://kheresy.wordpress.com/2012/04/05/coordinate-system-in-openni/ Jun. 21, 2012 [data accessed]
[44] 空間中的平面圖 [Online] Available : http://3.bp.blogspot.com/_NG5MStU39lo/TM1Wc4N4ZfI/AAAAAAAAAFg/oCrFFVDZFL8/s1600/空間中直線垂直平面.png Jun. 21, 2012 [data accessed]
[45] 最小平方法 [Online] Available : http://en.wikipedia.org/wiki/Least_squares Jun. 21, 2012 [data accessed]
[46] C++ MIDI Library - libjdkmidi [Online] Available : http://mobile.jdkoftinoff.com/ Jun. 21, 2012 [data accessed]
[47] MIDI 天堂 [Online] Available : http://www.countryin4.com/default.asp Jun. 21, 2012 [data accessed]
[48] MIDI MAX音樂廳 [Online] Available : http://sql.jaes.tpc.edu.tw/javaroom/ MIDI/alas/ Jun. 21, 2012 [data accessed]
[49] 育兒百科 [Online] Available : http://baby.lifepedia.net/ Jun. 21, 2012 [data accessed]
[50] K. Huang, T. Starner, E. Do, G. Weiberg, D. Kohlsdorf, C. Ahlrichs, and R. Leibrandt, “Mobile music touch: mobile tactile stimulation for passive learning,” in Proc. of the 28th International Conference on Human factors in computing systems, pp. 791–800, New York, USA, 2010.
[51] Se Mi Sei Vicino [Online] Available : http://www.soniacillari.net/home.htm Jun. 21, 2012 [data accessed]
[52] G. Levin and Z. Lieberman, “In-Situ Speech Visualization in Real-Time Interactive Installation and Performance.” in Proc. of The 3rd International Symposium on Non-Photorealistic Animation and Rendering, Annecy, France, 2004.
[53] ANSI Z136 [Online] Available : http://www.lia.org/publications/ansi/Z136-4 Jun. 21, 2012 [data accessed]
[54] Laser Safety Handbook [Online] Available : http://www.research.northwestern.edu/ors/forms/laser-safety-handbook.pdf Jun. 21, 2012 [data accessed]
[55] Kinect Laser Safety Power Measurement [Online] Available : http://www.youtube.com/watch?v=7qLDzLYPG-w Jun. 21, 2012 [data accessed]
[56] S. Birchfield and S. Rangarajan, “Spatiograms versus histograms for region-based tracking.” in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, Volume 2, pp. 1158-1163, 20-25 June 2005.
[57] Y. Hayashi and H. Fujiyoshi, “Mean-Shift-Based Color Tracking in Illuminance Change.” Robot Soccer World Cup XI, pp. 302-311, 2007.
[58] F. Chang, L. Ma, and Y. Qiao, “Target Tracking Under Occlusion by Combining Integral-Intensity-Matching with Multi-block-voting.” in Proc. of Lecture Notes, Volume 3644, pp. 77-86, 2005. 
[59] P. F. Gabriel, J. G. Verly, J. H. Piater, and A. Genon, “The State of the Art in Multiple Object Tracking Under occlusion in video sequences.” in Proc. of Advanced Concepts for Intelligent Vision Systems, Belgium, September 2-5, 2003.
[60] 顏妙純，「一個即時移動物偵測與追蹤的嵌入式系統」，國立中央大學資訊工程研究所論文，民國九十八年。

指導教授

蘇木春(Mu-chun Su)

審核日期

2012-7-25

推文