追瞳系統之研發於身障者之人機介面應用

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：13

、訪客IP：18.224.39.32

姓名

莊英杰(Ying-Chieh Chuang) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

追瞳系統之研發於身障者之人機介面應用
(Development of an Eye-Tracking System and Its application in Human-Computer Interfaces for the Disabled)

相關論文

★ 以Q-學習法為基礎之群體智慧演算法及其應用	★ 發展遲緩兒童之復健系統研製
★ 從認知風格角度比較教師評量與同儕互評之差異：從英語寫作到遊戲製作	★ 基於檢驗數值的糖尿病腎病變預測模型
★ 模糊類神經網路為架構之遙測影像分類器設計	★ 複合式群聚演算法
★ 身心障礙者輔具之研製	★ 指紋分類器之研究
★ 背光影像補償及色彩減量之研究	★ 類神經網路於營利事業所得稅選案之應用
★ 一個新的線上學習系統及其於稅務選案上之應用	★ 人眼追蹤系統及其於人機介面之應用
★ 結合群體智慧與自我組織映射圖的資料視覺化研究	★ 以類免疫系統為基礎之線上學習類神經模糊系統及其應用
★ 基因演算法於語音聲紋解攪拌之應用	★ 虹膜辨識系統之研究與實作

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

部份身障者〈如漸凍人(肌萎縮性側索硬化症)或患有大腦性麻痺之病人等〉的肢體及臉部肌肉無法自主控制，極度影響他們本身及其家人的生活。若身障者只剩下眼睛仍能自主活動，透過使用追瞳系統，不僅可提升其獨立自主的能力，並可加強與人溝通的能力。現今已有數種追瞳系統問市，各有其優缺點。其中有些系統需使用者戴上頭盔，造成使用上負擔及不便；而複雜的操作流程也會增加使用者的挫折感，導致再度使用的意願不高；甚至有些系統是用高價來換取精準度，使得一般使用者無力負擔。基於以上之考量，本篇論文提出一套低價位追瞳系統，利用這套系統可以找到瞳孔中心座標，並估算出人眼凝視銀幕的相對位置，藉由對應後的座標控制滑鼠的移動。這個系統首先將CCD camera所擷取到的影像二值化，再利用投影機制找出瞳孔粗略位置，並運用邊緣偵測的方法得到瞳孔邊緣，接著使用一個簡單的群聚演算法求得瞳孔中心點。最後我們將所求得的瞳孔座標做網格點的轉換，找出人眼凝視銀幕的位置，並將其應用於人機介面的操作上。從實驗結果可以得知此系統可以快速且精確地執行追蹤瞳孔的工作，再搭配所設計之應用程式後，便可以有效地幫助身障者，提升其獨立自主的能力。

摘要(英)

For some disabled, an extreme disability such as severe cerebral palsy or amyotrophic lateral sclerosis (ALS) deprives them of the use of their limbs and facial muscles. If eye motion is unaffected, the disabled could rely on an eye-tracking system to attain some degrees of independence and communicate with somebody more easily. Nowadays there are several different eye-tracking systems. Each of them has it’s own advantages and disadvantages. Some systems ask users to put on a helmet on the user’s head. Wearing a helmet will probably result in an uncomfortable feeling and increase the operational load. The other systems involve a complex operation procedure that sometimes will makes the user feel frustrated and deprive the user of the willing of using the systems again. As for some commercial systems, most of them are too expensive to be affordable for ordinary users. Based on these discussions, this thesis presents a low-cost eye-tracking system. Via the system, the coordinates of the user’s pupil can be computed and then the user’s eye gaze information can be estimated. The eye gaze information is then used to manipulate the movements of the mouse. The system first converts a color image obtained form a CCD camera to a binary image. Using a special projection method we can roughly locate the position of the pupil. The Sobel operator is then used to compute the edges of the pupil. A simple clustering algorithm is adopted to find a circle to fit the edges so that the coordinates of the center of the pupil are located. Finally, a special mapping method is used to transfer the coordinates of pupil to the eye gaze information. Then the eye gaze information is used to manipulate the computer. Several experiments were conducted to test the performance of the proposed system. Experimental results demonstrate the system can quickly and precisely track the movements of the pupil. In addition, via a special application software the system can help the disabled to effectively manipulate the computer to make them be able to live more independently.

關鍵字(中)

★ 漸凍人
★ 追瞳系統
★ 影像二值化
★ 邊緣偵測
★ 人機介面

關鍵字(英)

★ Human-Computer Interfaces
★ edge detection
★ amyotrophic lateral sclerosis (ALS)
★ eye-tracking system
★ thresholding

論文目次

摘要 I
Abstract II
目錄 IV
表目錄 VI
圖目錄 VII
第一章緒論 1
1.1 研究動機 1
1.2 研究目的 3
1.3 論文架構 4
第二章追瞳系統研究之介紹與探討 5
2.1 搜尋線圈法 5
2.2 紅外線視訊系統 6
2.3 眼電圖法 7
2.4 紅外線眼動圖法 9
2.5 光學式瞳位追蹤系統 10
2.6 Purkinje 影像追蹤法 12
第三章研究方法與步驟 13
3.1 瞳孔特徵擷取 15
3.2 去除雜訊 17
3.3 校正基準點 18
3.4 邊緣偵測 19
3.5 估測瞳孔中心 21
3.6 瞳孔中心座標轉換 24
第四章追瞳系統之人機介面介紹 38
4.1 系統硬體設備 38
4.2 系統操作流程 39
4.3 系統主要功能 42
4.3.1 中文語音資料庫 42
4.3.2 中英文輸入系統 44
4.3.3 影音播放系統 46
4.3.4 尋求遠端協助系統 49
4.3.5 傳送簡訊系統 51
4.3.6 網際網路瀏覽 53
第五章實驗結果 56
5.1 瞳孔偵測實驗 56
5.2 滑鼠控制實驗 58
5.3 打字實驗 59
第六章結論與未來展望 61
參考文獻 63
附錄A 型態學運算 67
附錄B 標號演算法 69

參考文獻

[1] 陳晏輝,陳天送,蔡子同, ”眼控撥號系統之建立”,國立成功大學醫學工程研
究所, 06,1997。
[2] 林宸生,林南州, 簡志忠, ”光學式瞳位追蹤器之人機介面系統研製”逢甲大學自動
控制工程研究所, 06,1997。
[3] 林道祥, ”眼波與眼影的融合及同步紀錄系統”,國立成功大學電機工程研究所碩士
論文, 06,1993。
[4] 劉文義, ”以眼球電信號控制之殘障者人機介面設計”, 國立台灣大學電機工程研
究所碩士論文, 06, 1996。
[5] 賴以倫, ”臨床視覺神經系統刺激與診斷儀器”, 國立成功大學, 電機工程研究所
碩士論文, 1996。
[6] 蔡金源, ”以眼球控制之殘障者人機介面系統:紅外線視動滑鼠”, 國立台灣大學,
電機工程研究所碩士論文, 1997。
[7] 謝文元著作, ”殘障者人機介面系統:紅外線眼控電腦滑鼠系統之研製” ,國立台灣
大學電機工程研究所碩士論文, 1999。
[8] 陳晏輝著,”利用眼球運動發展肢體障礙者之人機介面” ,國立成功大學醫學工程研
究所碩士論文,1998。
[9] 張凱傑, ”眼控與頭控之人機介面系統研發與整合”, 逢甲大學自動控制工程研究
所碩士論文, 2001。
[10] 郭靜男, ”可眼控及頭控之多功能PC Camera之研發與應用”, 逢甲大學自動控制
工程研究所碩士論文, 2002。
[11] 詹永舟,”瞳位追蹤應用於眼控系統及眼球動態量測儀器之製作與分析”, 逢甲
大學自動控制工程研究所碩士論文, 1998。
[12] M. Betke, J. Gips, and P. Fleming, “The camera mouse: visual tracking
of body feature to provide computer access for people with severe
disabilities,” IEEE Trans. on Neural Systems and Rehabilitation
Engineering, vol. 10, no. 1, pp. 1-10, 2002.
[13] Carpenter, R. H. S. (1977), Movements of the eyes, Pion, London.
[14] Eye-Trace System, Permobil Meditech AB, Timra, Sweden,
http://www.algonet.se/~eyetrace.
[15] R. S. Feris, T. E. Campos, and R. M. Cesar, “Detection and tracking of
facial features in video sequences,” in Mexican International Conference
on Artificial Intelligence, pp. 129-137, 2000.
[16] A. J. Glenstrup and T. E. Nielsen, "Eye Controlled Media: Present and
Future State", Thesis of Bachelor in Information Psychology,
Psychological Laboratory, University of Copenhagen, Denmark, 1995.
[17] R. C. Gonazlez and R. E. woods, Digital image processing, 2nd. Addison
wesley, 1992.
[18] J. Hartigan, Clustering algorithms, Wiley, New York, 1975.
[19] R. L. Hsu, M. A. Mottaleb, and A. K. Jain, “Face detection in color
images,” IEEE Trans. Pattern Analysis and Machine Intell., vol. 24, pp.
696-706, 2002.
[20] R. V. Kenyon, ”A Soft Contact Lens Search Coil for Measuring eye
Movements”, Vision Res.Vol.25, No.11, p1629-1633, 1985.
[21] D. Kumar and E. Poole, “Classification of EOG for human computer
interface,” in the Second Joint EMBS/BMES Conference, vol. 1, pp. 23-26,
Oct. 2002.
[22] J. J. Lahoud, The eyegaze system, Optics and Photonics News, July 1996.
[23] N. L. Lee and D. Keating, “Controllers for use by disabled people,”
Computing & Control Engineering Journal, pp. 121-124, June 1994.
[24] R. Lippman, “An introduction to neural computing”, IEEE ASSP Mag., pp.
4-22, April, 1987.
[25] C. H. Morimoto, D. Koons, A. Amit, M. Flickner, and S. Zhai, “Keeping an
eye for HCI,” in Proc. XII Brazilian Symp. Computer Graphics and Image
Processing, pp. 171-176, 1999.
[26] K. S. Park and K. T. Lee,” Eye-controlled human/computer interface using
the line-of-sight and the intentional blink”, Computer Engineering, Vol.
30, No.3, pp. 463-473, 1996.
[27] L. D. Stefano and A. Bulgarelli, “A simple and efficient connected
components labeling algorithm”, IEEE Proc. Of the 10th International
Conference on Image Analysis and Processing, pp.322-327, 1999.
[28] M. C. Su and M. T. Chung, “A voice-controlled human-computer Interface
for the disabled,” IEE Computing & Control Engineering Journal, vol. 12,
no. 5, pp. 225-230, 2001.
[29] M. Sugeno and T. Yasukawa, “A fuzzy-logic-based approach to qualitative
modeling”, IEEE Trans. Fuzzy Syst., Vol.1, pp.7-31, 1993.
[30] Y. Tomita, Y. Igarashi, S. Honda, and N. Matsuo, “Electro-Oculography
Mouse for Amyotrophic Lateral Sclerosis Patients”, 18th Annual
International Conference of the IEEE Engineering in Medicine and Biology
Society, Page(s): 1708-1781 vol. 531 Oct-3 Nov. 1996.
[31] G. Norris and E. Wilson, “The Eye Mouse, An Eye Communication Device”,
IEEE, 1997.
[32] Y. H. Man and I. Gath, “Detection and Separation of Ring-Shaped clusters
Using Fuzzy Clustering”, Pattern Analysis and Machine Intelligence, IEEE
Trans. Vol. 16, pp.855-861, 1994.
[33] S. H. Yeh, “Human facial animation based on real image sequence,”
http://sun.lib.nsysu.edu.tw/ETD-db/etd-0724101-163439.pdf, 2001.
[34] L. Young and D. Sheena, “Survey of eye movement recording methods,”
Behav. Res. Meth. Instrum, vol. 7, no. 5, pp.397-429, 1975.

指導教授

蘇木春(Mu-Chun Su)

審核日期

2004-7-5

推文