聲音強度與音高之復健遊戲系統

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：83

、訪客IP：18.221.13.173

姓名

蔡吳傳(Wu-Chuan Tsai) 查詢紙本館藏

畢業系所

電機工程學系

論文名稱

聲音強度與音高之復健遊戲系統
(A game system for rehabilitation on voice intensity and pitch)

相關論文

★ 獨立成份分析法於真實環境中聲音訊號分離之探討	★ 口腔核磁共振影像的分割與三維灰階值內插
★ 數位式氣喘尖峰氣流量監測系統設計	★ 結合人工電子耳與助聽器對中文語音辨識率的影響
★ 人工電子耳進階結合編碼策略的中文語音辨識成效模擬--結合助聽器之分析	★ 中文發聲之神經關聯性的腦功能磁振造影研究
★ 利用有限元素法建構3維的舌頭力學模型	★ 以磁振造影為基礎的立體舌頭圖譜之建構
★ 腎小管之草酸鈣濃度變化與草酸鈣結石關係之模擬研究	★ 口腔磁振影像舌頭構造之自動分割
★ 微波輸出窗電性匹配之研究	★ 以軟體為基準的助聽器模擬平台之發展-噪音消除
★ 以軟體為基準的助聽器模擬平台之發展-回饋音消除	★ 模擬人工電子耳頻道數、刺激速率與雙耳聽對噪音環境下中文語音辨識率之影響
★ 用類神經網路研究中文語音聲調產生之神經關聯性	★ 教學用電腦模擬生理系統之建構

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

近年來本國隨著對語言治療的重視日益增加，因此診斷出有語言障礙的患者也逐年成長，導致了語言治療師的人力缺乏，而且在傳統語言治療中，溝通障礙患者需要語言治療師一對一去進行治療，故語言治療師同一時間內很難同時對多位病人進行治療，因為人力不足導致於其治療成效不佳。基於以上原因，本研究開發一套針對訓練音高和音量的嚴肅遊戲，藉由遊戲的方式進行復健，希望提高受測者的動機和改善其構音障礙和音量不足的問題。此系統利用筆記型電腦上的麥克風收錄人聲訊號，由電腦計算出此段語音的基頻和音量，再結合遊戲動畫，利用遊戲動畫給予受測者練習發音的視覺回饋。為了評估此系統對語音復健的有效性，本研究與衛福部部立桃園醫院復健科的語言治療團隊合作，徵求了五位患有音聲障礙的實驗組參與實驗，同時也安排六位正常組進行實驗以比對差異，內容根據患者實際狀況決定，內容包含音高訓練和音量訓練，總共三次練習，一個禮拜一天，總計進行六次的發音練習實驗，每次耗時約30分鐘，除了做本研究開發的語音復健系統(A系統)的實驗之外，也同時做本實驗室所先前所開發的音聲障礙復健系統(B系統)的實驗。在實驗的最後，我們會提供一個問卷給受測者做填寫，上面有11個問題，以評估實驗過程中的體驗。完成實驗後，比對受測者第一次與最後一次的實驗數據，以評估其音聲障礙是否有被改善，同時也比較A系統與B系統的結果差異。為了比較實驗組與正常組在練習前後音高和音量是否有所不同，我們使用T檢定 ( T test ) 算出練習前和練習後的p值。在A系統方面，實驗組最後一次練習後的平均音域比第一次練習後的平均音域增加了103Hz，p值為0.025 ，有顯著差異；而平均音量則增加了12bB，p值為0.023 ，有顯著差異；而正常組部分，練習前後對其音域和音量皆無顯著差異。在B系統方面，實驗組最後一次練習後的平均音域比第一次練習後的平均音域增加了68Hz，p值為0.005 ，有顯著差異；而平均音量則增加了16bB，p值為0.01 ，有顯著差異；而正常組部分，練習前後對其音域和音量皆無顯著差異。在音量訓練上B系統的訓練成果優於A系統的訓練成果，造成此種結果的可能性有三個，分別是遊戲型態、個案數量不足和人為誤差。在音高訓練上A系統的訓練成果優於B系統的訓練成果，推論可能是因為程式中遊戲動畫觸發器設定不同所造成。經由上述實驗結果可知，實驗組完成實驗後，其音量和音域皆有明顯的成長，且與其他學者的研究結果相近，證明了本系統可以用來幫助患者改善發音，並且在問卷回饋中，受測者都對此系統保持正面看法。

摘要(英)

As the attention on the language therapy increased in Taiwan in recent years, the growth of patients discovered with language disorder leads to lack of language therapists. For traditional treatment of speech disorder, speech therapists need to assess and treat patients with communication disorder individually. Such personalized therapy process is inefficient for massive patients waiting for their next rehabilitation appointments. In addition, this treatment performance is ineffective since lack of language therapists. Therefore, we proposed a serious game for rehabilitation on voice intensity and pitch. We hoped patients would not only improve the dysarthria and decay of volume but also be motivated for speech rehabilitation by playing the game. The system recorded a short speech signal from human and calculated its volume (in decibel, dB) and fundamental frequency (in Hertz, Hz) immediately. These two parameters were used to control the animated character and provide visual feedbacks for patients. In order to assess the effectiveness of this game system, we collaborated with a speech therapist of the Taoyuan General Hospital. Eleven subjects including five patients with voice disorder and six normal subjects were involved in the clinical study to see if there were any differences in between. Experiments were carried out for three weeks (one day per week and six times per day with a total time of 30 minutes). Each experiment included 4 pitch and 2 volume games.
Besides the experiment of our system (A system), we did the experiment of the game system (B system) for voice disorder from previous study of our laboratory. At the end of the experiments, subjects were presented with a questionnaire which included 11 items aiming at evaluating various aspects of the training experience. After finishing all the experiments, the speech performance of patients was assessed by comparing the results of the first and last experiments. Next, we would like to see the difference between the results of A system and B system. To examine the difference between normal subjects and patients, we analyzed the results of the first and last experiments with the T test and calculated the p value. The results of A system were found that the average frequency range of patients was increased by 103Hz and the average of volume was increased by 12dB. The p value of frequency range is 0.025 and the p value of the volume is 0.023, hence there were significant differences. The results of B system were found that the average frequency range of patients was increased by 68Hz and the average of volume was increased by 16dB. The p value of frequency range is 0.005 and the p value of the volume is 0.01, hence there were significant differences. The results of A system and B system showed the average frequency range and volume of normal subjects for normal subjects were not significant changed in the last experiment. In voice intensity treatment, the effectiveness of B system was better than the effectiveness of A system. We surmised the probable causes including
personal error, the lack of sample size and the difference of the game type between two systems. In pitch treatment, the effectiveness of A system was better than the effectiveness of B system. We inferred that the probable reason was the difference of the animation trigger between two systems. The superior frequency range and volume of patients after practices were similar to the results of other research in the literature. It has proved the benefits of this game system for speech therapy. In addition, the feedback of questionnaire showed the subjects were all confident in the system that we presented.

關鍵字(中)

★ 基頻
★ 音量
★ 音聲障礙
★ 音聲治療
★ 嚴肅遊戲

關鍵字(英)

★ Fundamental Frequency
★ Volume
★ Voice disorder
★ Voice therapy
★ Serious game

論文目次

目錄
摘要..............................................I
Abstract........................................III
致謝.............................................VI
圖目錄............................................X
表目錄..........................................XII
第一章緒論.......................................1
1.1 研究動機......................................1
1.2 文獻探討......................................3
1.3 研究目的......................................7
1.4 論文架構......................................8
第二章溝通障礙與語音治療遊戲......................10
2.1溝通障礙介紹..................................10
2.2 語音復健遊戲與傳統語言治療....................12
第三章語音復健系統架構...........................14
3.1 遊戲引擎介紹.................................14
3.2 音量與音高演算法..............................18
3.2.1 音量演算法.................................18
3.2.2 音高演算法.................................19
3.3 動畫產生方式.................................22
3.3.1 Adobe flash CS5與Unity動畫編輯器介紹.......23
3.4 系統架構和遊戲介紹...........................25
3.4.1 系統架構..................................25
3.4.2 遊戲介紹..................................27
第四章實驗步驟與流程............................33
4.1 受測者簡介..................................33
4.2 實驗流程....................................35
4.3 實驗分析方法................................38
第五章實驗結果與討論............................40
5.1 音量遊戲結果................................40
5.2音高遊戲結果.................................42
5.3 遊戲問卷結果................................44
5.4 綜合討論....................................46
第六章結論與未來展望............................50
6.1 結論........................................50
6.2 未來展望....................................52
英文參考資料:...................................54
中文參考資料:...................................56
附錄A 調查問卷..................................57
附錄B 實驗個別結果..............................59

參考文獻

英文參考資料:
Assad, O., Hermann, R., Lilla, D., Mellies, B., Meyer, R., Shevach, L., Siegel, S., Springer, M., Tiemkeo, S., Voges, J., Wieferich, J., Herrlich, M., Krause, M. & Malaka, R. (2011). Motion-Based Games for Parkinson′s Disease Patient. Part of the Lecture Notes in Computer Science book series, Vol 6972.

Botte, B., Matera, C. & Sponsiello, M. (2009). Serious games between simulation and game. A proposal of taxonomy. Journal of e-Learning and Knowledge Society-English Version , Vol. 5, 11-21.

Cagatay, M., Ege, P., Tokdemir, G. & Cagiltay, N. E. (2012) A serious game for speech disorder children therap. 7th International symposium on health informatics and bioinformatics.

Cole, R., Halpern, A., Ramig, L., Ngampatipatpong, S. V. N. & Yan, J. (2006) A virtual speech therapist for individuals with parkinson disease. Educational Technology.

Krause, M., Smeddinck, J. & Meyer, R. (2013) A Digital Game to Support Voice Treatment for Parkinson’s Disease. CHI 2013:Changing Perspectives.

Kaipa, R. & Peterson, A. M. (2016) A systematic review of treatment intensity in speech disorders. International Journal of Speech-Language Pathology, Vol. 18, Issue 6, 507-520.

Lopes, M., Magalhaes, J. & Cavaco, S. (2016) A voice-controlled serious game for the sustained vowel exercise. 12th International congress on advances in civil engineering.

Lan, T., Aryal, S., Ahmed, B., Ballard, K. & Gutierez-Osuna, R. (2014) Flappy Voice: An Interactive Game for Childhood Apraxia of Speech Therapy. CHI PLAY ′14.

McCormack, J., McLeod, S., Harrison, L. J. & McAllister, L. (2010) The impact of speech impairment in early childhood:
Investigating parents’ and speech-language pathologists’ perspectives using the ICF-CY. Journal of Communication Disorders, Vol. 43, Issue 5, 378-396.

Owens, R. E. Jr., Metz, D. E. & Haas, A., (2000) Introduction to communication disorders: a lifespan perspective. Needham heights: allyn and bacon.

Parnandi, A., Karappa, V., Son, Y., Shahin, M., McKechnie, J., Ballard, K., Ahmed, B. & Gutierrez-Osuna1, R. (2013) Architecture of an automated therapy tool for childhood apraxia of speech 15th ACM SIGACCESS International Conference on Computers and Accessibility.

Pinto, S., Chan A., Guimaraes I., Rothe-Neves R. & Sadat J. (2017) A cross-linguistic perspective to the study of dysarthria in Parkinson’s
disease. Mechanisms of regulation in speech.

Sapir, S., Ramig, L. O & Fox, C. M. (2011) Intensive voice treatment in Parkinson’s disease: Lee Silverman Voice Treatment. Expert Review of Neurotherapeutics, Vol 11, Issue 6, 815-830.

Shtern, M., Haworth, M. B., Yunusova, Y., Baljko M. & Faloutsos, P. (2012) A Game System for Speech Rehabilitation. Part of the Lecture Notes in Computer Science book series, Vol 7660.

Tan, C., Johnston, A., Ballard, K., Ferguson, S. & Perera-Schulz, D. (2013) sPeAK-MAN: Towards popular gameplay for speech therapy. Proceedings of The 9th Australasian Conference on Interactive Entertainment: Matters of Life and Death Article No. 28.

Umanski, D., Kogov?ek, D. & Ozbi?, M., Schiller, N. O. (2010) Development of a voice-based rhythm game for training speech motor skills of children with speech disorders. 8th International Conference on Disability, Virtual Reality & Associated Technologies.

中文參考資料:
行政院內政部統計處網站，民國106年資料:
https://dep.mohw.gov.tw/DOS/lp-2976-113.html
(2018年6月26日網頁資料)

莊?婷, 民國104年, 語言治療簡介：
https://goo.gl/bpuxTp (2018年6月26日網頁資料)

鄭靜宜, 民國100年, 語音聲學-說話聲音的科學, 心理出版社股份有限公司, 台灣台北市.

謝秉寰, 民國103年, 可見式語音診斷與復健系統, 國立中央大學電機工程研究所, 碩士論文.

吳炤民, 黃郁凱, 鄭博霙, 黃心和, 蔡吳傳 (2017) 語音診斷復健系統之發展-音聲障礙復健遊戲系統, 中華民國一百零六年生物醫學工程研討會, 桃園, paper 116, 1-4.

林寶貴, 錡寶香, 民國95年, 語言障礙學生輔導手冊：
http://163.32.59.168/2/org/Spedu/03.pdf (2018年6月26日網頁資料)

林寶貴, 民國83年, 語言障礙與矯治，五南圖書出版有限公司, 台北市, 台灣.

王小川, 民國98年, 語音訊號處理, 修定二版, 全華圖書股份有限公司, 新北市, 台灣.

楊東華, 民國103年, Unity跨平台3D全方位遊戲設計, 碁峰資訊股份有限公司, 台北市, 台灣.

李金泉, 民國96年, 精通SPSS統計分析實務與應用, 全華圖書股份有限公司, 新北市, 台灣.

指導教授

吳炤民(Chao-Min Wu)

審核日期

2018-7-24

推文