深度學習於腦波情緒辨識研究

NCU Institutional Repository > 資訊電機學院 > 電機工程研究所 > 博碩士論文 > Item 987654321/81566

請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/81566

題名:	深度學習於腦波情緒辨識研究
作者:	蕭國彬;Xioa, Guo-Bin
貢獻者:	電機工程學系
關鍵詞:	深度學習;腦波;情緒辨識;人工智慧;虛擬實境;Deep Learning;Electroencephalography(EEG);emotional recognition;artificial intelligence;virtual reality
日期:	2019-08-22
上傳時間:	2019-09-03 16:03:22 (UTC+8)
出版者:	國立中央大學
摘要:	隨著全球腦科學研究的發展，大腦在應用技術上推陳出新，腦電波的發展提供了有效的工具用於揭開人腦的神祕面紗。「情緒」從古至今都是左右決策、影響勝敗的關鍵。本研究以國科會委任台灣大學執行的情緒計劃所提供的腦波誘發資料，和實驗室自製的8通道腦波機及乾式電極當作實驗設備，蒐集所需要的情緒腦波的訓練資料，從腦波中找出情緒在自主程度暨正負向性腦波的特殊特徵驗證實驗確效性，由於不同年齡、不同性別、不同慣用手上，大腦在不同區塊活躍度有所不同，藉由深度學習來訓練一組適合各年齡層，不同性別都適用的人工智慧模神經網路模型，以學校師生男女共15人的腦波當成訓練資料，給予每位受試者觀看20分鐘的腦波刺激材料，同時利用專門為深度學習打造，具備有GPU模組的TX2進行有效率的深度學習，以雙線程為主軸，當在接收腦波的同時，即時將腦波經處理置入訓練好的神經網路模型，快速辨識受測者當下的情緒在自主程度、正負向性的情緒指標。在準確率方面，正負向性準確率經交叉驗證後的準確度達到81.48%，自主程度準確度達到74.18%，透過此8個通道腦波規格及創新的資料預處理方法來達成過去必須要32通道或是64通道所訓練出來的準確率及成果，完成在應用上更具輕便性以及輕巧性的系統，致力於減少通道數及系統的精簡性。在應用層面，為實體化辨識的情緒指標，引進虛擬實境做為媒介跟時代接軌，透過立體環境模擬遠端視訊，同時讓另一端知道自己真實的情緒狀態，將冷冰冰的理論實現到現代應用設備上。;With the developments of research in brain science and the novel technologies of brain-related applications technology, electroencephalography (EEG) provides an effective tool to unveil the mystery of human brain. Especially, "emotion" is the most attractive topic which can influence decision and be the key to victory or defeat. In this dissertation, emotion stimulation materials are provided by the emotional plan of National Science Council, which is implemented by the National Taiwan University. Eight-channel EEG machine and high-sensitivity dry electrodes are used as the experimental equipment to collect the emotional EEG training data. Human emotions were represented in valence and dominance domains. The relations between EEG temporal-frequency features and emotion markers verified the the correctness of the experiment. Since brain activities are different across individuals owing to their ages and habitual hand, neural network is a suitable choice for our emotion classification study. In the study, fifteen subjects were recruited to view a twenty-minute emotion stimulation material. EEG data measured from the fifteen subjects were used as training data for deep-learning neural network. After network training, real-time recognition of subjects’ emotions were performed on TX2 platform whose GPU module was configured by the pre-trained Deep Learning neural network. In our system, simultaneous EEG data recording and real-time emotion recognition was available with the use of double-threading system. The accuracies of valence and dominance indexes have achieved 81.48% and 74.18%, respectively. The research results of our eight-channel EEG study in this thesis have attained comparable results compared to other previous literatures which utilized 32- or 64-channel EEG system in emotion studies. In addition, we also introduced virtual reality (VR) to integrate with our proposed eight-channel EEG emotion detection system. The VR-EEG emotion detection system has already implemented in 3D environment and combined with social communication software which can achieve a variety of entertainment applications in future studies.
顯示於類別:	[電機工程研究所] 博碩士論文

文件中的檔案:

檔案	描述	大小	格式	瀏覽次數
index.html		0Kb	HTML	279	檢視/開啟

在NCUIR中所有的資料項目都受到原著作權保護.

社群 sharing

資料載入中.....