評估自閉症類群障礙兒童(ASD)結合多模態傳感器的虛擬實境系統

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：15

、訪客IP：3.128.206.122

姓名

李宜軒(Yi-Hsuan Lee) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

評估自閉症類群障礙兒童(ASD)結合多模態傳感器的虛擬實境系統
(A Multi-model Sensing Virtual Reality System for Diagnosing Children with Autism Spectrum Disorder)

相關論文

★ 虛擬實境搭配腦電、心電以及呼吸器設備在心肺同步呼吸訓練對心跳變異與腦波之訓練應用系統與資料分析	★ 利用分層共現網絡評估發展遲緩兒童的精細運動
★ 太極大師：基於太極拳的注意力訓練遊戲，使用動作辨識及平衡分析進行表現評估	★ 比較XRSPACE MANOVA中手勢和控制器互動模式的用戶體驗
★ 基於舌頭力量和表面肌電圖的吞嚥智能評估系統	★ 基於數據融合模型的機器學習對甲基苯丙胺使用障礙的多生理訊號號分析
★ 在有干擾的虛擬教室環境下大人小孩的行為表現與腦神經反應的異同	★ 使用映射模型和跨資料集遷移式學習的輕量化居家衰弱症訓練系統
★ 心率生理回饋放鬆訓練對於海洛因使用疾患(HUD)生理資訊之影響分析	★ 基於深度學習模型的3D心理旋轉對認知障礙的診斷與評估
★ 評估注意力偵測之穿戴式腦電電極放置有效性	★ 基於骨架步態藉由機器學習進行臨床老化衰落分類
★ 用於注意力不足過動症診斷的可解釋多模態融合模型	★ 基於VR的自閉症兒童多模態訓練系統的改進
★ 基於深度學習的虛擬現實腦震盪檢測與融合方法	★ 設計透過立體互動的虛擬實境教學遊戲系統

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 (2028-7-1以後開放)

摘要(中)

自閉症譜系障礙 (ASD) 是一種複雜的神經發育障礙，會嚴重影響兒童的生活，尤其是在社交、溝通和行為方面。早期診斷和干預對於改善自閉症患者的預後至關重要。本文提出了一個評估模組，其靈感來自廣受認可的自閉症診斷觀察表 (ADOS) 評估工具，該工具利用虛擬現實 (VR) 技術和多模態神經數據來全面評估 ASD 症狀。評估模塊包括三個階段：拼圖遊戲、氣球遊戲和蛋糕遊戲。每一個階段都針對 ASD 症狀的特定方面，例如凝視持續時間、共同住注意力和談話技巧。為了捕獲不同的神經和行為數據，評估模組結合了多模態傳感設備，包括腦電 (EEG)、眼動追踪和語音辨識。這些設備提供了對與 ASD 相關的潛在生理特徵，增強了 ASD 評估中常用的傳統觀察方法。在評估過程中，多模態傳感設備不斷地收集來自於受測者的生理數據，腦電圖用來記錄大腦活動，眼動追踪用來監測凝視模式，語音辨識用來分析對話技巧。最後，對收集到的數據進行綜合統計分析，結合臨床量表、任務表現分數和多模態神經數據。這種綜合分析方法可以進一步了解受測者表現出來有關 ASD 的特徵，使臨床醫生和研究人員能夠做出更明智的診斷並製定個性化的治療計劃。評估模組展示了其在支持臨床決策、促進準確的 ASD 診斷和優化治療結果方面的有效性。

摘要(英)

Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder that significantly affects children′s lives, particularly in the areas of social interaction, communication, and behavior. Early diagnosis and intervention are crucial for improving outcomes in individuals with ASD. This paper presents an Evaluation Module inspired by the widely recognized Autism Diagnostic Observation Schedule (ADOS) assessment tool, which utilizes virtual reality (VR) technology and multi-modal neurosensing to comprehensively assess ASD symptoms. The Evaluation Module consists of three stages: the Puzzle Game, Balloon Game, and Cake Game. Each stage targets specific aspects of ASD symptoms, such as gaze duration, joint attention, and conversation skills. To capture diverse neural and behavioral data, the Evaluation Module incorporates digital sensing devices, including electroencephalography (EEG), eye-tracking, and speech recognition. These devices offer valuable insights into the underlying physiological processes associated with ASD, enhancing the traditional observational methods commonly used in ASD assessments. During the assessment, the digital sensing devices continuously collect data from the participants. EEG records brain activity, eye-tracking monitors gaze patterns, and speech recognition analyzes conversational skills.The collected data then undergoes comprehensive statistical analysis, combining clinical scales, task performance measures, and neurophysiological data. This integrated analysis approach provides a comprehensive understanding of the participants′ ASD symptoms, enabling clinicians and researchers to make more informed diagnoses and tailor individualized treatment plans. The Evaluation Module demonstrates its effectiveness in supporting clinical decision-making, facilitating accurate ASD diagnoses, and optimizing treatment outcomes.

關鍵字(中)

★ 自閉症類群障礙
★ 虛擬實境
★ 多模態傳感器
★ 數位醫療
★ 共享是注意力
★ 腦電
★ 眼動
★ 情緒辨識

關鍵字(英)

★ Autism spectrum disorder (ASD)
★ virtual reality (VR)
★ multi-sensor
★ emotion
★ eye tracking
★ joint attention (JA)
★ electroencephalography (EEG)
★ digital therapeutics

論文目次

摘要 I
Abstract III
致謝 V
Table of Contents VI
List of Figures V
List of Tables VI
1. Introduction 1
2. Related Works 6
3. Methodology 10
Fig. 1. System Architecture 11
Fig. 2. VR Scenario (kindergarten classroom) 12
Fig. 3. Head-mounted display (HMD) and EEG equipment. 12
Fig. 4. Experimental Design 19
Fig. 5. ROIs defined in Evaluation Module 22
4. Results 25
Fig. 6. Task performance comparison between four participants 30
Fig. 7. Head amplitude based on three game phase comparison of four participants 31
Fig. 8. Three-stage pupil path distance comparison of four participants 35
Fig. 9. Three-stage saccade comparison of four participants 36
Fig. 10. Fixation time comparison of four participants 37
Fig. 11. Three-stage saccade comparison of four participants 38
Fig. 12. Three-stage saccade comparison of four participants 39
5. Discussions 40
6. Conclusion and Future Works 44
Reference 47

參考文獻

[1] H. Zhao, A. R. Swanson, A. S. Weitlauf, Z. E. Warren, and N. Sarkar,“Hand-in-hand: A communication-enhancement collaborative virtual reality system for promoting social interaction in children with autismspectrum disorders,” IEEE Transactions on Human-Machine Systems, vol. 48, no. 2, pp. 136–148, 2018.
[2] Y.-Q. Chen, F.-A. Lin, T.-Y. Yang, S.-C. Yeh, E. H.-K. Wu, J. M. Poole, and C. Shao, “A vr-based training and intelligent assessment system integrated with multi-modal sensing for children with autism spectrum disorder,” in 2021 IEEE 3rd Eurasia Conference on IOT, Communication and Engineering (ECICE), IEEE, 2021.
[3] M. Robles, N. Namdarian, J. Otto, E. Wassiljew, N. Navab, C. M. FalterWagner, and D. Roth, “A virtual reality based system for the screening and classification of autism,” IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 5, pp. 2168–2178, 2022.
[4] Z. Zheng, Q. Fu, H. Zhao, A. R. Swanson, A. S. Weitlauf, Z. E. Warren, and N. Sarkar, “Design of an autonomous social orienting training system (asots) for young children with autism,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 25, no. 6, pp. 668–678, 2017.
[5] American Psychiatric Association, “DSM-5: Diagnostic and Statistical Manual of Mental Disorders.” https://www.psychiatry.org/psychiatrists/practice/dsm, 2021. [Online; accessed July 7, 2023.]
[6] M. Li, M. Amirizaniani, and R. Kashef, “Efficient comorbidity analysis in brain disorders reveals better diagnosis,” in 2021 IEEE 23rd Int Conf on High Performance Computing Communications; 7th Int Conf on Data Science Systems; 19th Int Conf on Smart City; 7th Int Conf on Dependability in Sensor, Cloud Big Data Systems Application (HPCC/DSS/SmartCit, IEEE, 2021.
[7] A. Gupta and D. Malhotra, “Ai-based techniques for the detection of neuro-developmental disorders: A survey,” in 2023 6th International Conference on Information Systems and Computer Networks (ISCON), IEEE, 2023.
[8] A. McCrimmon and K. Rostad, “Test review: Autism diagnostic observa- tion schedule, second edition (ados-2) manual (part ii): Toddler module,” Journal of Psychoeducational Assessment, vol. 32, no. 1, pp. 88–92, 2014.
[9] A. Z. Amat, H. Zhao, A. Swanson, A. S. Weitlauf, Z. Warren, andN. Sarkar, “Design of an interactive virtual reality system, invirs, for joint attention practice in autistic children,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 29, pp. 1866–1876, 2021.
[10] W. Jones, K. Carr, and A. Klin, “Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2- year-old toddlers with autism spectrum disorder,” Archives of General Psychiatry, vol. 65, no. 8, p. 946, 2008. OA status: bronze.
[11] B. Kim, D. Jeong, M. Jeong, T. Noh, S.-I. Kim, T. Kim, S.-Y. Jang, H. J. Yoo, J. Kim, H. Hong, and K. Han, “Vista: User-centered vr training system for effectively deriving characteristics of people with autism spectrum disorder,” in 28th ACM Symposium on Virtual Reality Software and Technology, ACM, 2022.
[12] C. Greco, M. Romani, A. Berardi, G. De Vita, G. Galeoto, F. Giovan- none, M. Vigliante, and C. Sogos, “Morphing task: The emotion recog- nition process in children with attention deficit hyperactivity disorder and autism spectrum disorder,” International Journal of Environmental Research and Public Health, vol. 18, no. 24, p. 13273, 2021.
[13] C.-C. Chen, E. H.-K. Wu, Y.-Q. Chen, H.-J. Tsai, C.-R. Chung, and S.-C. Yeh, “Neuronal correlates of task irrelevant distractions enhance the detection of attention deficit/hyperactivity disorder,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 31, pp. 1302– 1310, 2023.
[14] T. A. Dennis, M. M. Malone, and C.-C. Chen, “Emotional face process- ing and emotion regulation in children: An erp study,” Developmental Neuropsychology, vol. 34, no. 1, pp. 85–102, 2009.
[15] E. Bekele, J. Wade, D. Bian, J. Fan, A. Swanson, Z. Warren, and N. Sarkar, “Multimodal adaptive social interaction in virtual environment (masi-vr) for children with autism spectrum disorders (asd),” in 2016 IEEE Virtual Reality (VR), IEEE, 2016.
[16] F. F. Velez, S. Colman, L. Kauffman, C. Ruetsch, and K. Anastassopou- los, “Real-world reduction in healthcare resource utilization following treatment of opioid use disorder with reset-o, a novel prescription digital therapeutic,” Expert Review of Pharmacoeconomics Outcomes Research, vol. 21, no. 1, pp. 69–76, 2021.
[17] S. H. Kollins, D. J. Deloss, E. Can˜adas, J. Lutz, R. L. Findling, R. S. E. Keefe, J. N. Epstein, A. J. Cutler, and S. V. Faraone, “A novel digital intervention for actively reducing severity of paediatric adhd (stars- adhd): a randomised controlled trial,” The Lancet Digital Health, vol. 2, no. 4, pp. e168–e178, 2020.
[18] A. J. Haskins, J. Mentch, T. L. Botch, B. D. Garcia, A. L. Burrows, and C. E. Robertson, “Reduced social attention in autism is magnified by perceptual load in naturalistic environments,” Autism Research, vol. 15, no. 12, pp. 2310–2323, 2022.
[19] T. D. Elkin, Y. Zhang, and J. C. Reneker, “Gaze fixation and visual searching behaviors during an immersive virtual reality social skills training experience for children and youth with autism spectrum dis- order: A pilot study,” Brain Sciences, vol. 12, no. 11, p. 1568, 2022.
[20] A. Koirala, Z. Yu, H. Schiltz, A. Van Hecke, B. Armstrong, and Z. Zheng, “A preliminary exploration of virtual reality-based visual and touch sensory processing assessment for adolescents with autism spec- trum disorder,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 29, pp. 619–628, 2021.
[21] P. R. Krishnappa Babu, P. Oza, and U. Lahiri, “Gaze-sensitive virtual re- ality based social communication platform for individuals with autism,” IEEE Transactions on Affective Computing, vol. 9, no. 4, pp. 450–462, 2018.
[22] S. Liu, L. Zhao, J. Zhao, B. Li, and S.-H. Wang, "Attention deficit/hyperactivity disorder Classification based on deep spatio-temporal features of functional Magnetic Resonance Imaging," Biomedical Signal Processing and Control, vol. 71, p. 103239, 2022.
[23] M. R. Kandalaft, N. Didehbani, D. C. Krawczyk, T. T. Allen, and S. B. Chapman, “Virtual reality social cognition training for young adults with high-functioning autism,” Journal of Autism and Developmental Disorders, vol. 43, no. 1, pp. 34–44, 2013.

指導教授

葉士青(Shih-Ching Yeh)

審核日期

2023-7-26

推文