以影像為基礎之重度身障者人機介面

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：22

、訪客IP：18.119.160.154

姓名

葉錦諺(Chin-Yen Yeh) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

以影像為基礎之重度身障者人機介面
(Imaged-Based Human Computer Interfaces for People with Severe Disabilities)

相關論文

★ 以Q-學習法為基礎之群體智慧演算法及其應用	★ 發展遲緩兒童之復健系統研製
★ 從認知風格角度比較教師評量與同儕互評之差異：從英語寫作到遊戲製作	★ 基於檢驗數值的糖尿病腎病變預測模型
★ 模糊類神經網路為架構之遙測影像分類器設計	★ 複合式群聚演算法
★ 身心障礙者輔具之研製	★ 指紋分類器之研究
★ 背光影像補償及色彩減量之研究	★ 類神經網路於營利事業所得稅選案之應用
★ 一個新的線上學習系統及其於稅務選案上之應用	★ 人眼追蹤系統及其於人機介面之應用
★ 結合群體智慧與自我組織映射圖的資料視覺化研究	★ 追瞳系統之研發於身障者之人機介面應用
★ 以類免疫系統為基礎之線上學習類神經模糊系統及其應用	★ 基因演算法於語音聲紋解攪拌之應用

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

本篇論文主要是提供一套以影像為基礎的低價位溝通輔具系統，讓不
同症狀的身障者都能夠操作系統，與家人或是朋友溝通，並且控制家中電
器。本系統的硬體只需要一台低價位的視訊攝影機以及一台個人電腦。
本論文的溝通輔具系統主要提供7 個日常生活中常用到的功能，分別
為語音溝通板、中英文輸入、家電控制、遠端協助、影音娛樂、瀏覽網際
網路以及傳送訊息。另外還有暫停與離開的選項。本系統主要提供三種溝
通介面。當身障者的手臂能夠動作時，可以利用手臂的動作來操作系統。
當身障者可以自主地控制嘴唇，可以利用嘴唇開闔來操作系統。當身障者
罹患重度疾病，像是腦性麻痺患者或是漸凍人，可以利用眨眼的方式來操
作系統。不同症狀的身障者可以選擇適用於自己的點選方式來操作本論文
提出的溝通輔具系統。
實驗結果顯示，使用眼動點選、唇動點選以及大動作點選等不同的方
式，都有九成以上的正確率。

摘要(英)

This paper presents an implementation of a low-cost image-based
communication aid system which allows people with disabilities to use their
limited voluntary motions to communicate with family and friends, access
computers, and control TV and air conditioner, etc. The system consists of only
one low-cost web camera and a personal computer.
The communication aid dichotomizes daily living necessities into 7 groups
(e.g., Voiced Messages, Typing, Home Appliance Control, Help, A/V
Entertainments, Web Surfing, Messages). In addition to the seven selections,
Suspend and Exit, are another two available options. The system provides users
with three kinds of operational interfaces to operate the communication aid. First
of all, people who still are able to control their arms can operate the system via
the movements of their arms. Secondly, for people who still can voluntarily open
and close their mouths, the system can be operated via the open and the closure
of the mouth. Thirdly, for people with severe disabilities, an extreme disability
such as severe cerebral palsy or amyotrophic lateral sclerosis, the system can be
operated via eye blinks. People with different kinds of disabilities can choose an
appropriate operational interface from the aforementioned three interfaces to
operate the communication aid.
Experimental results show that the performance of the proposed
communication aid is very encouraging.

關鍵字(中)

★ 人機介面
★ 溝通輔具
★ 眨眼溝通
★ 漸凍人

關鍵字(英)

★ Human Computer Interface
★ Communication Aid
★ Amyotrophic Lateral Sclerosis
★ Eye-Blink Communication

論文目次

摘要 i
Abstract ii
誌謝 iii
目錄 iv
圖目錄 vi
表目錄 viii
一、緒論 1
1-1 研究動機 1
1-2 研究目的 2
1-3 論文架構 2
二、溝通輔具系統相關研究 3
2-1 眨眼溝通法 3
2-2 眼電圖法 4
2-3 紅外線視訊系統 5
2-4 紅外線眼動圖法 6
2-5 光學瞳位追蹤系統 7
三、溝通輔具系統演算法 10
3-1 系統校正演算法 11
3-1-1 侵蝕與擴張 12
3-1-2 標號演算法 13
3-2 自動選擇點選方式 15
3-2-1 眼動點選演算法 16
3-2-2 唇動點選演算法 26
3-2-3 大動作點選演算法 29
3-3 點選檢驗 31
四、溝通輔具系統介面 32
4-1 硬體環境 32
4-2 系統操作流程 33
4-3 系統主要功能 35
4-3-1 中文語音資料庫 38
4-3-2 影音播放介面 39
4-3-3 中英文輸入介面 40
4-3-4 網際網路瀏覽介面 43
4-3-5 家電控制介面 44
4-3-6 尋求協助介面 46
4-3-7 傳送訊息介面 47
五、實驗結果 49
5-1 偵測眼睛測試 49
5-2 眨眼測試 50
5-3 唇動測試 50
5-4 大動作測試 51
5-5 中文輸入介面比較及測試 51
5-6 自動判斷點選方式測試 53
5-7 點選打字測試 54
六、結論與未來展望 56
6-1 結論 56
6-2 未來展望 56
參考文獻 58

參考文獻

[1] J. Y. Bouguet, “Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm,” Intel Corporation Microprocessor Research Labs.
[2] M. J. Black, D. J. Fleet, and Y. Yacoob, “A Framework for Modeling Appearance Change in Image Sequences,” in International Conference on Computer Vision, 1998, pp. 660-667.
[3] M. Betke, J. Gips, and P. Fleming, “The Camera Mouse: Visual Tracking of Body Feature to Provide Computer Access for People with Severe Disabilities,” IEEE Trans. on Neural Systems and Rehabilitation Engineering, vol. 10, no. 1, pp. 1-10, 2002.
[4] T. N. Bhaskar, F. T. Keat, S. Ranganath, and Y. V. Venkatesh, “Blink Detection and Eye Tracking for Eye Localization,” in Conference on Convergent Technologies for Asia-Pacific Region, 2003, vol. 2, pp. 821-824.
[5] Y. L. Chen, F. T. Tang, W. H. Chang, M. K. Wong, Y. Y. Shih, and T. S. Kuo, “The New Design of an Infrared-Controlled Human-Computer Interface for the Disabled,” IEEE Trans. on Rehabilitation Engineering, vol. 7, pp. 474-481, Dec. 1999.
[6] E. B. Delabarre, “A Method of Recording Eye-Movements,” The American Journal of Psychology, vol. 9, no. 4, pp. 572-574, July 1898.
[7] L. S. Di and A. Bulgarelli, “A Simple and Efficient Connected Components Labeling Algorithm,” in IEEE Proc. of Image Analysis and Processing, Sep. 1999, pp. 322-327.
[8] D. G. Evans, R. Drew, and P. Blenkhorn, “Controlling Mouse Pointer Position Using an Infrared Head-Operated Joystick,” IEEE Trans. on Rehabilitation Engineering, vol. 8, no. 1, pp. 107-117, 2000.
[9] T. Fawcett, “An Introduction to ROC Analysis,” Pattern Recognition Letters, vol. 27, no. 8, pp. 861-874, June 2006.
[10] M. F. Funada, S. P. Ninomija, S. Suzuki, K. Idogawa, Y. Yam, and H. Ide, “On an Image Processing of Eye Blinking to Monitor Awakening Levels of Human Beings,” in 18th Annual International Conference of the Engineering in Medicine and Biology Society, 1996, vol. 3, pp. 966-967.
[11] K. Grauman, M. Betke, J. Gips, and G. R. Bradski, “Communication via Eye Blinks – Detection and Duration Analysis in Real Time,” in Proc. of CVPR 2001, vol. 1, pp. I-1010-1017.
[12] J. Gang and E. Sung, “Study on Eye Gaze Estimation,” IEEE Trans. on Systems, Man and Cybernetics, Part B, vol. 32, no. 3, pp. 332-350, June 2002.
[13] R. Heishman and Z. Duric, “Using Image Flow to Detect Eye Blinks in Color Videos,” in IEEE Workshop on Applications of Computer Vision, 2007.
[14] R. L. Hsu, M. A. Mottaleb, and A. K. Jain, “Face Detection in Color Images,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, pp. 696-706, 2002.
[15] D. Kumar and E. Poole, “Classification of EOG for Human Computer Interface,” in Conference in the Second Joint EMBS/BMES, Oct. 2002, vol. 1, pp. 64-67.
[16] C. S. Lin, C. C. Huan, C. N. Chan, M. S. Yeh, and C. C. Chiu, “Design of a Computer Game Using an Eye-Tracking Device for Eye's Activity Rehabilitation,” Optics and Lasers in Engineering, pp. 91-108, July 2004.
[17] H. Lim and V. K. Singh, “Design of Healthcare System for Disable Person Using Eye Blinking,” in Proc. of Fourth Annual ACIS International Conference on Computer and Information Science, 2005, pp. 551-555.
[18] C. H. Morimoto, D. Koons, A. Amit, M. Flickner, and S. Zhai, “Keeping an Eye for HCI,” in Processing of XII Brazilian Symp. Computer Graphics and Image, 1999, pp. 171-176.
[19] T. Miyakawa, H. Takano, and K. Nakamura, “Development of Non-contact Real-time Blink Detection System for Doze Alarm,” in Proc. of SICE Annual Conference, 2004, vol. 2, pp. 1626-1631.
[20] G. Norris and E. Wilson, “The Eye Mouse, An Eye Communication Device,” in IEEE Proc. of Bioengineering, May 1997, pp. 66–67.
[21] I. Park, J.-H. Ahn, and H. Byun, “Efficient Measurement of Eye Blinking under Various Illumination Conditions for Drowsiness Detection Systems,” in Proc. of the 18th International Conference on Pattern Recognition, 2006, vol. 1, pp. 383-386.
[22] K. S. Park and K. T. Lee, “Eye-Controlled Human Computer Interface Using the Line-of-Sight and the Intentional Blink,” Computer Engineering, vol. 30, no. 3, pp. 463-473, 1996.
[23] R. B. Reilly and M. J. O’Malley, “Adaptive Noncontact Gesture-Based System for Augmentative Communication,” IEEE Trans. on Rehabilitation Engineering, vol. 7, no. 2, pp. 174-182, 1999.
[24] J. A. Stern, “The Eye Blink: Affective and Cognitive Influence,” in Anxiety: Recent Developments in Cognitive, Psychophysiological, and Health Research, D. G. Forgays, T. Sosnowski, and K. Wrzesniewski, Eds. Washington: Hemisphere Publishing, 1992, ch. 8, pp. 109-128.
[25] M. C. Su, S. Y. Su, and G. D. Chen, “A Low Cost Vision-Based Human-Computer Interface for People with Severe Disabilities,” Biomedical Engineering-Applications, Basis, Communications, vol. 17, no. 6, pp. 10-18, 2005.
[26] Y. Tomita, Y. Igarashi, S. Honda, and N. Matsuo, “Electro-Oculography Mouse for Amyotrophic Lateral Sclerosis Patients,” in IEEE Conference Engineering in Medicine and Biology Society, Nov. 1996, vol. 5, pp. 1780-1781.
[27] O. Takami, N. Irie, C. Kang, T. Ishmatsu, and T. Ochiai, “Computer Interface to Use Head Movement for Handicapped People,” in Proc. of IEEE TENCON’96, Digital, Signal Processing Applications, 1996, vol. 1, pp. 468-472.
[28] T. Westeyn, P. Pesti, K.-H. Park, and T. Starner, “Biometric Identification Using Song-Based Blink Pattern,” in Proc. of 11th International Conference on Human-Computer Interaction, 2005, vol. 3.
[29] L. Young and D. Sheena, “Survey of Eye Movement Recording Methods,” Behav. Res. Meth. Instrum, vol. 7, no. 5, pp. 397-429, 1975.
[30] Z. Zhu and Q. Ji, “Eye Gaze Tracking under Natural Head Movements,” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 2005, vol. 1, pp. 918-923.
[31] LC Technologies, INC. EYEGAZE SYSTEMS. [Online]. Available: http://www.eyegaze.com/INDEX.htm July 2008 [date accessed]
[32] Texas Instruments, System-On-Chip for 2.4 GHz ZigBee. [Online]. Available: http://focus.ti.com/lit/ds/symlink/cc2431.pdf July 2008 [date accessed]
[33] 李佳霖，「頭配式顯示器之人體生理參數量測分析」，碩士論文，醫學工程研究所，中原大學，民國九十年六月。
[34] 吳成柯、戴善榮、程湘君、雲立實譯，數位影像處理。儒林圖書有限公司，民國九十年。
[35] 邱國鈞，「追瞳系統之研製及其應用」，碩士論文，資訊工程研究所，國立中央大學，民國九十五年七月。
[36] 簡志忠，「光學式瞳位追蹤器之人機介面系統研製」，碩士論文，自動控制工程研究所，逢甲大學，民國八十六年。
[37] 莊英杰，「追瞳系統之研發於身障者之人機介面應用」，碩士論文，資訊工程研究所，國立中央大學，民國九十三年六月。
[38] 郭靜男，「可眼控及頭控之多功能PC Camera之研發與應用」，碩士論文，自動控制工程研究所，逢甲大學，民國九十二年五月。
[39] 陳弦澤，「改良式紅外線眼控系統之研發與應用」，碩士論文，自動控制工程研究所，逢甲大學，民國九十三年五月。
[40] 陳晏輝，「利用眼球運動發展肢體障礙者之人機界面」，碩士論文，醫學工程研究所，國立成功大學，民國八十七年。
[41] 張凱傑，「眼控與頭控之人機介面系統研發與整合」，碩士論文，自動控制工程研究所，逢甲大學，民國九十年。
[42] 詹永舟，「瞳位追蹤應用於眼控系統及眼球動態量測儀器之製作與分析」，碩士論文，自動控制工程研究所，逢甲大學，民國八十七年。
[43] 蔡金源，「以眼球控制之殘障者人機介面系統:紅外線視動滑鼠」，碩士論文，電機工程研究所，國立台灣大學，民國八十六年。

指導教授

蘇木春(Mu-Chun Su)

審核日期

2008-7-17

推文