基於鏡像神經元訓練之深度學習想像運動模型

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：63

、訪客IP：18.119.112.154

姓名

陳泓夬(Hong-Guai Chen) 查詢紙本館藏

畢業系所

電機工程學系

論文名稱

基於鏡像神經元訓練之深度學習想像運動模型
(A Deep Learning Model for Motor Imagery based on Mirror Neuron Training)

相關論文

★ 使用梳狀濾波器於相位編碼之穩態視覺誘發電位腦波人機介面	★ 應用電激發光元件於穩態視覺誘發電位之腦波人機介面判斷
★ 智慧型手機之即時生理顯示裝置研製	★ 多頻相位編碼之閃光視覺誘發電位驅動大腦人機介面
★ 以經驗模態分解法分析穩態視覺誘發電位之大腦人機界面	★ 利用經驗模態分解法萃取聽覺誘發腦磁波訊號
★ 明暗閃爍視覺誘發電位於遙控器之應用	★ 使用整體經驗模態分解法進行穩態視覺誘發電位腦波遙控車即時控制
★ 使用模糊理論於穩態視覺誘發之腦波人機介面判斷	★ 利用正向模型設計空間濾波器應用於視覺誘發電位之大腦人機介面之雜訊消除
★ 智慧型心電圖遠端監控系統	★ 使用隱馬可夫模型於穩態視覺誘發之腦波人機介面判斷與其腦波控制遙控車應用
★ 使用類神經網路於肢體肌電訊號進行人體關節角度預測	★ 使用等階集合法與影像不均勻度修正於手指靜脈血管影像切割
★ 應用小波編碼於多通道生理訊號傳輸	★ 結合高斯混合模型與最大期望值方法於相位編碼視覺腦波人機介面之目標偵測

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 (2026-8-4以後開放)

摘要(中)

隨著腦科學的研究發展，腦機介面以成為腦科學的發展重點，而具有非侵入式優點的 EEG 腦電訊號，正是腦機介面的主要方案之一。然而腦電訊號通常被掩沒在噪聲中，其訊號的信噪比(SNR)非常低，無法以肉眼替不同動作的腦波進行分類，這對運動圖像分類立下了巨大的挑戰。
而近年來分析的方式也相當多元，從自動編碼器(Auto Encoder)、受限玻爾茲曼機，到人工智慧的 CNN 和 RNN 深度學習網路，這些用於 EEG 運動圖像分類的方式皆極大地提高了運動圖像分類的準確性。然而多分類依然為一大挑戰，不僅想像運動的方式無法訓練出多種不同的分類，且訓練階段也將耗費相當多的時間，因此本論文針對訓練方式提出了不同的方法，利用鏡像神經元的方式訓練想像運動，希望藉由觀看學習的方式達到更好的效果，同時縮短訓練的時間並提高不同動作的判斷率，與此同時在神經網路上也將採用新穎的時序性架構進行訓練。
實驗過程採用 13 通道的腦波機收集資料，於最後的辨識成果中，透過五位受試者對五種動作各 300 次的動作觀看，三分類最高可達 56.2%，而五分類也有 40.3% 的辨識率，除此之外，以純想像運動資料放入鏡像神經元所訓練出的模型中，三分類辨識率可達 52%，而五分類則為 33.1%。證實鏡像神經元與像想運動之間並非毫無關聯，前者所訓練出的網路對後者依然有一定的辨識度。

摘要(英)

With the development of EEG science research, the advanced techniques for brain wave analysis enable people to probe the profound neurocircuitry inside human brain. One promising technique is the use of brain waves to control peripheral machines through user’s intentions, which is called brain copmuter interface (BCI). But how to extract useful information from brain wave is still a big challenge.
In recent years, some deep learning solutions based on AutoEncoder, Restricted Boltzmann Machine, CNN and RNN have been proposed for EEG imagery classification which have will improved the accuracy. However, multi-task problem remains a challenge. Because of imagery movement can’t use for multi-task classification, so we try to use mirror neuron training for the better result. In this paper, we also use a new solution based on Temporal Convolutional Network(TCN) with much higher computational efficiency and accuracy.
Our experiment result have shown that the propose TCN solution has obtained state of the great performance on multi-task of mirror neuron training. A high classification accuracy as 56.2% on 3 tasks and 40.3% on 5 tasks. Besides, imagery movement data is also recognizable in the model. The three task recognition rate can reach 52% and five task recognition rate can reach 33.1%. It shows that there are some similar associations between mirror neuron training and motor imagery.

關鍵字(中)

★ 鏡像神經元
★ 深度學習
★ 腦波
★ 想像運動

關鍵字(英)

論文目次

中文摘要 i
Abstract ii
目錄 iii
圖目錄 viii
緒論 1
1-1 研究動機與目的 1
1-2 文獻探討 1
1-3 論文章節架構 2
原理介紹 3
2-1 腦電訊號 3
常用腦電訊號基本類型 3
大腦皮質區域及功能 5
腦電波測量方法與位置 6
2-2 腦電波分析方法 8
巴特沃斯濾波器 8
事件相關去同步化腦波與事件相關同步化腦波 9
小波變換 10
2-3 腦機介面 11
2-4 人工神經網路 12
類神經網路
長短期記憶神經網路 12
注意力機制 13
研究設計與方法 14
3-1 系統架構 18
實際運動系統架構 18
想像運動系統架構腦波機硬體架構 19
3-2 腦波預處理及神經網路模型 21

3-3 實驗設計 24
實際運動實驗對象 27
實際運動實驗設計流程想像運動實驗對象
3-4 小波變換後時頻圖 28
實驗結果與討論 33
4-1 實際運動實驗數據分析 34

結論與未來展望 43
參考文獻 50

參考文獻

[1] B. Graimann, B. Allison and G. Pfurtscheller, Brain-Computer Interfaces: A Gentle Introduction, 2010.
[2] I. Käthner, S. C. Wriessnegger, G. R. Müller-Putz, A. Kübler, and S. Halder, “Effects of mental workload and fatigue on the P300, alpha and theta band power during operation of an ERP (P300) brain–computer interface,” Biological Psychology, pp. 118-129, October 2014.
[3] S. N. Abdulkader, A. Atia, and M.-S. M. Mostafa, “Brain computer interfacing: Applications and challenges,” Egyptian Informatics Journal, pp. 213-230, July 2015.
[4] J. J. Daly and J. R. Wolpaw, “Brain–computer interfaces in neurological rehabilitation,” The Lancet Neurology, pp. 1032-1043, November 2008.
[5] J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, “Brain–computer interfaces for communication and control,” Clinical Neurophysiology, pp. 767-791, June 2002.
[6] G. Pfurtscheller and F. H. Lopes da Silva, “Event-related EEG/MEG synchronization and desynchronization: basic principles,” Clinical Neurophysiology, pp. 1842-1857, November 1999.
[7] Aimin Jiang, Jing Shang, Xiaofeng Liu, Yibin Tang, Hon Keung Kwan, Yanping Zhu, “Efficient CSP Algorithm With Spatio-Temporal Filtering for Motor Imagery Classification,” IEEE Transactions on Neural Systems and Rehabilitation Engineering , pp. 1006-1016, April 2020.
[8] De-Shuang Huang and Jian-Xun Mi, “A New Constrained Independent Component Analysis Method,” IEEE Transactions on Neural Networks , pp. 1532-1535, September 2007.
[9] Sina Khanmohammadi, Chun-An Chou, “Adaptive Seizure Onset Detection Framework Using a Hybrid PCA–CSP Approach,” IEEE Journal of Biomedical and Health Informatics, pp. 154-160, Jan. 2018.
[10] Saugat Bhattacharyya, Anwesha Khasnobish, Somsirsa Chatterjee, Amit Konar, D.N Tibarewala, “Performance analysis of LDA, QDA and KNN algorithms in left-right limb movement classification from EEG data,” 2010 International Conference on Systems in Medicine and Biology, pp. 126-131, December 2020.
[11] R. Shantha Selva Kumari, J. Prabin Jose, “Seizure detection in EEG using time frequency analysis and SVM,” 2011 International Conference on Emerging Trends in Electrical and Computer Technology, pp. 626-630, March 2011.
[12] Bin Hu, Xiaowei Li, Shuting Sun, Martyn Ratcliffe, “Attention Recognition in EEG-Based Affective Learning Research Using CFS+KNN Algorithm,” IEEE/ACM Transactions on Computational Biology and Bioinformatics , pp. 38-45, October 2016.
[13] Johannes Hennrich, Christian Herff, Dominic Heger, Tanja Schultz, “Investigating deep learning for fNIRS based BCI,” 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2844-2847, August 2015.
[14] Na Lu, Tengfei Li, Xiaodong Ren, and Hongyu Miao, “A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines,” IEEE Transactions on Neural Systems and Rehabilitation Engineering , pp. 566-576, June 2017.
[15] Y. R. Tabar and U. Halici, “A novel deep learning approach for classification of EEG motor imagery signals,” Journal of Neural Engineering, November 2016.
[16] Guangyi Zhang, Vandad Davoodnia, Alireza Sepas-Moghaddam, Yaoxue Zhang, Ali Etema, “Classification of Hand Movements From EEG Using a Deep Attention-Based LSTM Network,” IEEE Sensors Journal , pp. 3113-3122, 15 March 2020.
[17] L. R. Fournier, G. F. Wilson, C. R. Swainc, “Electrophysiological, behavioral, and subjective indexes of workload when performing multiple tasks: manipulations of task difficulty and training,” International Journal of Psychophysiology, pp. 129-145, January 1999.
[18] T. H. Budzynski, H. Budzynski, J. Evans, and A. Abarbanel, Introduction to quantitative EEG and neurofeedback: Advanced theory and applications, Academic Press, 2009.
[19] H. J. Herbert, “The ten-twenty electrode system of the International Federation,” Electroencephalography and clinical neurophysiology, pp. 370-375, 1958.
[20] G. Pfurtscheller, G. R. Müller-Putz, R. Scherer and C. Neuper, “Rehabilitation with Brain-Computer Interface Systems,” Computer, pp. 58-65, Oct. 2008 .
[21] S. Hochreiter and J. Schmidhuber, “Long Short-Term Memory,” Neural computation, pp. 1735-1780, 15 November 1997.
[22] G. Pfurtscheller and C. Neuper, “Motor imagery and direct brain-computer communication,” Proceedings of the IEEE, pp. 1123 - 1134, July 2001.
[23] R. Polikar, “The Wavelet Tutorial,” [線上]. Available: http://users.rowan.edu/~polikar/WTtutorial.html.
[24] Dalin Zhang, "Cascade amd parallel convolutional recurrent neural networks on EEG-Based", Thu, 10 Jun 2021
[25] Shaojie Bai, "An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling", Thu, 19 Apr 2018
[26] Long, Jonathan, "Fully convolutional networks for semantic segmentation", In CVPR, 2015
[27] Yu, Fisher and Koltun, "Multi-scale context aggregation by dilated convolutions", In ICLR, 2016
[28] Na Lu, " A Temporal Convolution Network Solution for EEG Motor Imagery Classification", IEEE, 26 December 2019
[29] Tian-jian Luo, " Effect of Different Movement Speed Modes on Human Action Observation: An EEG Study ", Neurosci., April 2018
[30] Jin Woo Choi, "Observing Actions Through Immersive Virtual Reality Enhances Motor Imagery Training ", IEEE, May 2020

指導教授

李柏磊

審核日期

2022-4-6

推文