發展以聽覺生理與類神經網路為基礎之人工電子耳聲音處理策略及其對中文語音辨識效果之研究─模擬與臨床評估;Study on the Development of Auditory Physiology and Neural Network Based Cochlear Implant Sound Processing Strategies and Its Effects on Mandarin Speech Perception – Simulation and Clinical Evaluation

NCU Institutional Repository > 資訊電機學院 > 電機工程學系 > 研究計畫 > Item 987654321/82358

請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/82358

題名:	發展以聽覺生理與類神經網路為基礎之人工電子耳聲音處理策略及其對中文語音辨識效果之研究─模擬與臨床評估;Study on the Development of Auditory Physiology and Neural Network Based Cochlear Implant Sound Processing Strategies and Its Effects on Mandarin Speech Perception – Simulation and Clinical Evaluation
作者:	吳炤民;曹昱林
貢獻者:	國立中央大學電機工程學系
關鍵詞:	人工電子耳;耳蝸植入;聲音處理器;數位信號處理;國語聲調分辨;語音知覺;聽覺處理機制;噪音;回響;類神經網路;深度學習;極限學習機;cochlear implant (CI);sound processor;digital signal processing;Mandarin lexical tone identification;speech perception;auditory processing mechanisms;noise;reverberation;artificial neural network;deep learning;extreme learning machine (ELM)
日期:	2020-01-13
上傳時間:	2020-01-13 14:47:27 (UTC+8)
出版者:	科技部
摘要:	人工電子耳改變了數十萬無法有效使用助聽器的聽損者，然而，其聲音品質至今在聲調語言、噪音環境中的語音以及音樂等方面仍有限制。本計畫延續上一年度之計畫，除了繼續探討三個以聽覺生理為基礎的聲音處理方法，並進一步發展基於深度學習的聲音處理策略，以了解它們對於中文語音辨識的效果。有別於大多數電子耳和類神經網路相關的研究，本計畫提出的新穎的聲音處理策略，除了使用類神經網路訓練而產生，並將整合以深度學習之極限學習機ELM為基礎的除回響機制。由上一個計畫的初步結果顯示，增強包絡訊號的EE策略有機會增強中文摩擦音及塞擦音的電極刺激。在本計畫的第一年，我們將在現有實驗平台上完成策略的實作，並進行客觀的語音效果評估和主觀的電子耳模擬實驗。而在第二年，我們將進行本年度及上一年度計畫的臨床實驗，將處理過的訊號從電腦輸出至Cochlear公司提供的NIC 4裝置和研究用處理器，以直接串流到使用者體內的植入裝置，並評估實際的電刺激效果。透過實驗結果比較不同電子耳處理策略對於中文聲調和語音辨識在噪音與回響環境中的表現，以期有助於改善人工電子耳的聲音品質並促進相關領域的研究發展。 ;Cochlear implants (CI) have significantly changed the lives of hundreds of thousands hearing impaired people who could not use hearing aids effectively. However, the sound quality of the cochlear implant today is still limited in the performance of tonal languages, speech in noisy conditions and music perception. The proposed project is going to not only continue the previous project on three auditory physiology based sound processing methods, but also develop sound processing strategies based on the artificial neural network (ANN). In contrast to the directions of most researches on the CI and the ANN, this project suggests an innovative ANN strategy, which is generated by training with the ANN as well as integrating the dereverberation mechanism based on the extreme learning machine (ELM) of deep learning. The results from the previous project show that the envelope enhancement strategy may increase the electrode stimulation for Mandarin fricatives and affricatives. In the first year of this project, sound processing strategies will be implemented on the current experiment platform, which will be used for objective speech performance evaluation and subjective CI simulations. In the second year, clinical experiments of this project and the previous-year project will be carried out. Processed signals will be directly streamed from a computer into each CI recipient’s internal implant via the NIC (Nucleus implant communicator) 4 device and a research processor provided by Cochlear Ltd. Hence the actual electric stimulation results can be evaluated. Based on the outcomes these experiments, the performance of different CI strategies for Mandarin lexical tone identification and speech recognition is going to be compared in order to improve the sound quality of CIs and to enhance the research and development in the related fields.
關聯:	財團法人國家實驗研究院科技政策研究與資訊中心
顯示於類別:	[電機工程學系] 研究計畫

文件中的檔案:

檔案	描述	大小	格式	瀏覽次數
index.html		0Kb	HTML	275	檢視/開啟

在NCUIR中所有的資料項目都受到原著作權保護.

社群 sharing

資料載入中.....