在虛擬現實場景中利用多種生理資料進行高壓駕駛的壓力識別

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：14

、訪客IP：3.144.242.165

姓名

陳俊瑜(Jyun-yu Chen) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

在虛擬現實場景中利用多種生理資料進行高壓駕駛的壓力識別
(Stress recognition by multi-physiology data in high pressure driving VR scene)

相關論文

★ 從EEG解釋虛擬實境的干擾對注意力的影響	★ 使用虛擬教室遊戲的基於融合的深度學習注意缺陷多動障礙評估方法
★ 利用分層共現網絡評估發展遲緩兒童的精細運動	★ 太極大師：基於太極拳的注意力訓練遊戲，使用動作辨識及平衡分析進行表現評估
★ 比較XRSPACE MANOVA中手勢和控制器互動模式的用戶體驗	★ 基於骨架步態藉由機器學習進行臨床老化衰落分類
★ 用於注意力不足過動症診斷的可解釋多模態融合模型	★ 基於深度學習的虛擬現實腦震盪檢測與融合方法
★ 基於V模型、醫療器材標準和FDA指南的新醫療器材軟體開發流程:以ADHD虛擬實境教室為例

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 (2025-7-1以後開放)

摘要(中)

壓力識別一直是個重要議題，尤其是在開車的時候。在過去，已經進行了一些與壓力識別有關的研究，並使用了單一生理感測器，例如心電或腦電，很少同時與多個生理傳感器結合使用。本文使用虛擬現實技術開發了虛擬戰場駕駛環境，並重現了戰爭中流彈的場景。我們的VR場景結合了多種生理傳感器：心電（ECG），皮膚電（GSR）和眼睛追踪。使用這些生理數據，我們分析了場景刺激引起的壓力狀況。結果表明，我們可以通過機器學習和深度學習的分類來識別壓力狀態。我們的心電分類準確率達到75％，皮膚電的分類準確率達到82.14％，眼動追踪的分類準確率達到75.27％，另外在混和兩種生理數據時甚至達到更高的分類準確率91.66％。基於我們的系統和模型，我們的模型將來可以應用於其他高壓的環境，並可以改進現有系統結構以獲得更好的結果。

摘要(英)

Stress recognition has always been an important issue, especially when driving the car. In the past, there have been related researches for stress recognition and used single sensor, such as ECG or EEG, rarely combined with multiple physiological sensors. This paper used Virtual Reality (VR) technology to development a virtual battlefield driving environment, and reproduces the stray bullet stimulations in the war. Our VR scene combines a variety of physiological sensors: Electrocardiography (ECG), Galvanic Skin Response (GSR), and eye tracking. Using these physiological data, we analyze the stress condition caused by the bullet stimulations. The results show that, we can identify stressful states by the classification of machine learning and deep learning. We achieve 75% classification accuracy on ECG, 82.14% classification accuracy on galvanic skin response, 75.27% classification accuracy on eye tracking, and even better on fusing two physiological data for 91.66% classification accuracy. Based on our systems and models, we are able to apply it to other stressful environments in the future and improve the existing architecture to achieve better results.

關鍵字(中)

★ 虛擬現實
★ 心電圖
★ 皮膚電反應
★ 眼睛跟踪
★ 機器學習
★ 壓力識別

關鍵字(英)

★ Virtual Reality(VR)
★ Electrocardiography(ECG)
★ Galvanic Skin Response(GSR)
★ eye tracking
★ machine learning
★ stress recognition

論文目次

Table of Contents
摘要 I
Abstract II
致謝 III
Table of Contents IV
List of Figures VI
List of Tables VII
1. Introduction 1
1.1 Background 1
2. Related Works 4
2.1 HRV 4
2.2 GSR 5
2.3 Eye tracking 6
2.4 Motivation 7
3. System and Methodology 8
3.1 System architecture 8
3.2 Experiment 10
3.3 Data processing 13
3.3.1 Pre-processing 14
3.3.2 Feature extraction 14
3.4 Analysis methods 16
4. Result and discussion 18
4.1 Statistical analysis 18
4.1.1 HRV 18
4.1.2 GSR 19
4.1.3 Eye tracking 19
4.2 Machine learning analysis 22
4.3 Data fusion 23
5. Conclusion & Future Work 24
List of Reference 25

參考文獻

List of Reference
[1] Gonca Gokce Menekse Dalveren, Nergiz Ercil Cagiltay,” Evaluation of Ten Open-Source Eye-Movement Classification Algorithms in Simulated Surgical Scenarios”, IEEE Access (Volume: 7) ,2019
[2] Senuri De Silva, Sanuwani Dayarathna, Gangani Ariyarathne,” A Rule-Based System for ADHD Identification using Eye Movement Data”, 2019 Moratuwa Engineering Research Conference (MERCon)
[3] Xiaowei Li, Tong Cao, Shuting Sun,” Classification study on eye movement data: Towards a new approach in depression detection”, IEEE Congress on Evolutionary Computation (CEC), 2016
[4] Robin Blanco , Juan Calle , Alvaro Uribe-Quevedo,“Development of a driving VR prototype for distraction awareness employing eye tracking”, IEEE 6th Global Conference on Consumer Electronics (GCCE), 2017
[5] Peng Tian, Yunjia Wang, Ying Lu,” Behavior Analysis of Indoor Escape Route-Finding Based on Head-Mounted VR and Eye Tracking”, International Conference on Internet of Things and IEEE Green Computing and Communications and IEEE Cyber, Physical and Social Computing and IEEE Smart Data ,2019
[6] Katrin Solveig Lohan, Eli Sheppard, Gillian Little, “Toward Improved Child–Robot Interaction by Understanding Eye Movements”, IEEE Transactions On Cognitive and Developmental Systems, Vol. 10, No. 4, 2018
[7] Hirotaka Maruyama , Yuta Saito , Mitsuho Yamada,“An analysis of changes in attention based on miniature eye movements”, IEEE 11th International Conference on Computer Science & Education (ICCSE), 2016
[8] Jiapu Pan, Willis J. Tompkins,” A Real-Time QRS Detection Algorithm”, IEEE Transactions on Biomedical Engineering (Volume: BME-32, Issue: 3), 1985
[9] Vignesh Kalidas, Lakshman Tamil,” Real-time QRS detector using Stationary Wavelet Transform for Automated ECG Analysis”, IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE), 2017
[10] Nermine Munla, Mohamad Khalil, Ahmad Shahin,” Driver Stress Level Detection Using HRV Analysis”, IEEE International Conference on Advances in Biomedical Engineering (ICABME),2015
[11] Koichi Fujiwara, Miho Miyajima, Toshitaka Yamakawa,” Epileptic Seizure Prediction Based on Multivariate Statistical Process Control of Heart Rate Variability Features”, IEEE Transactions on Biomedical Engineering (Volume: 63, Issue: 6), 2016
[12] Koichi Fujiwara, Erika Abe, Keisuke Kamata, “Heart Rate Variability-Based Driver Drowsiness Detection and Its Validation With EEG “, IEEE Transactions on Biomedical Engineering (Volume: 66, Issue: 6), 2019
[13] Giorgos Giannakakis ,Dimitris Grigoriadis ,Katerina Giannakaki, “Review on psychological stress detection using biosignals”, IEEE Transactions on Affective Computing , 09 July 2019
[14] Jiayuan He, Ke Li, Xiaoli Liao, Ping Zhang, Ning Jiang,” Real-Time Detection of Acute Cognitive Stress Using a Convolutional Neural Network From Electrocardiographic Signal”, IEEE Access (Volume: 7), 2019
[15] Parkbhum Reanaree, Polachet Tananchana, Worapong Narongwongwathana, Chuchart Pintavirooj,” Stress and office-syndrome detection using EEG, HRV and hand movement”, 2016 9th Biomedical Engineering International Conference (BMEiCON)
[16] Luz Santamaria-Granados , Mario Munoz-Organero , Gustavo Ramirez-González,”Using Deep Convolutional Neural Network for Emotion Detection on a Physiological Signals Dataset (AMIGOS)”, IEEE Access, Journals & Magazines , Volume 7, 2018
[17] RobertoZangróniz, ArturoMartínez-Rodrigo, AntonioFernández-Caballero, “Electrodermal Activity Sensor for Classification of Calm/Distress Condition”, Sensors 2017
[18] Raquel Martinez, Asier Salazar-Ramirez, “A Self-Paced Relaxation Response Detection System Based on Galvanic Skin Response Analysis”, IEEE Access, Journals & Magazines, Volume: 7, 02 April 2019
[19] Değer Ayata, Yusuf Yaslan, Mustafa Kamaşak,” Emotion recognition via random forest and galvanic skin response: Comparison of time based feature sets, window sizes and wavelet approaches”, Medical Technologies National Congress (TIPTEKNO), 2016
[20] Yuanguo Liu, Chi Jiang, “Recognition of Shooter’s Emotions Under Stress Based on Affective Computing “, IEEE Access, Journals & Magazines, Volume: 7, 10 May 2019
[21] Djoko Budiyanto Setyohadi, Sri Kusrohmaniah, S.B. GunawanShow, “Galvanic skin response data classification for emotion detection”, International Journal of Electrical and Computer Engineering ,2018
[22] Juan Abdon Miranda Correa, Mojtaba Khomami Abadi, Niculae Sebe, Ioannis Patras,“AMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups”, IEEE Transactions on Affective Computing,2018
[23] Srinivas S. S. Kruthiventi, Kumar Ayush, R. Venkatesh Babu, “DeepFix: A Fully Convolutional Neural Network for Predicting Human Eye Fixations”, IEEE Transactions on Image Processing (Volume: 26, Issue: 9), 2017
[24] Wenguan Wang, Jianbing Shen,” Deep Visual Attention Prediction”, IEEE Transactions on Image Processing (Volume: 27, Issue: 5), 2018
[25] Chen Xia, Junwei Han, Fei Qi, Guangming Shi, “Predicting Human Saccadic Scanpaths Based on Iterative Representation Learning”, IEEE Transactions on Image Processing (Volume: 28, Issue: 7), 2019
[26] Xiaoshuai Sun, Hongxun Yao, Rongrong Ji, Xian-Ming Liu,” Toward Statistical Modeling of Saccadic Eye-Movement and Visual Saliency”, IEEE Transactions on Image Processing,2014
[27] Xiu Chen, Zhenzhong Chen, “Visual attention identification using random walks based eye tracking protocols”, IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2015
[28] Yujie Zheng, Xuliu Lan, Junling Li, Fang Meng, “The contrast experiment on visual attention regions and saliency maps based on the eye tracker”, IEEE 11th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD),2014
[29] Rory M.S. Clifford, Sungchul Jung, Simon Hoermann, Mark Billinghurst, “Creating a Stressful Decision Making Environment for Aerial Firefighter Training in Virtual Reality”, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR),2019
[30] Jean-Luc Lugrin, Henrik Dudaczy, Marc Erich Latoschik,” Low-Frequency Stress Elicitation for VR Training”, 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games),2018
[31] Mores Prachyabrued, Disathon Wattanadhirach, Richard B. Dudrow, “Toward Virtual Stress Inoculation Training of Prehospital Healthcare Personnel: A Stress-Inducing Environment Design and Investigation of an Emotional Connection Factor”, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR),2019
[32] Takurou Magaki, Michael Vallance, “Developing an Accessible Evaluation Method of VR Cybersickness”, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR),2019
[33] Claudia Krogmeier, Christos Mousas, David Whittinghill, “Human, Virtual Human, Bump! A Preliminary Study on Haptic Feedback”, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR),2019
[34] Yusuke Kishishita , Swagata Das , Antonio Vega Ramirez , Chetan Thakur , “Muscleblazer: Force-Feedback Suit for Immersive Experience”
[35] Mohammadhossein Moghimi, Robert Stone, Pia Rotshtein, “Affective Recognition in Dynamic and Interactive Virtual Environments”, IEEE Transactions on Affective Computing, (Volume: 11, Issue: 1), 2017
[36] C. Jyotsna, J. Amudha, “Eye Gaze as an Indicator for Stress Level Analysis in Students”, 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI), 2018
[37] G. Marquart, C. Cabrall and J. de Winter, “Review of eye-related measures of drivers’ mental workload”, Procedia Manuf., vol. 3, pp. 2854-2861, 2015
[38] H. J. Foy and P. Chapman, "Mental workload is reflected in driver behavior physiology eye movements and prefrontal cortex activation", Applied ergonomics, vol. 73, pp. 90-99, 2018.

指導教授

葉士青吳曉光(Shih-Ching Yeh Eric Hsiao-Kuang Wu)

審核日期

2020-7-30

推文