整合即時手勢辨識的智慧型觸控控制器

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：35

、訪客IP：3.15.219.217

姓名

周立笙(Li-sheng Chou) 查詢紙本館藏

畢業系所

資訊工程學系在職專班

論文名稱

整合即時手勢辨識的智慧型觸控控制器
(Smart Touch Controller with Real-Time Gesture Recognition)

相關論文

★ 整合GRAFCET虛擬機器的智慧型控制器開發平台	★ 分散式工業電子看板網路系統設計與實作
★ 設計與實作一個基於雙攝影機視覺系統的雙點觸控螢幕	★ 智慧型機器人的嵌入式計算平台
★ 一個即時移動物偵測與追蹤的嵌入式系統	★ 一個固態硬碟的多處理器架構與分散式控制演算法
★ 基於立體視覺手勢辨識的人機互動系統	★ 整合仿生智慧行為控制的機器人系統晶片設計
★ 嵌入式無線影像感測網路的設計與實作	★ 以雙核心處理器為基礎之車牌辨識系統
★ 基於立體視覺的連續三維手勢辨識	★ 微型、超低功耗無線感測網路控制器設計與硬體實作
★ 串流影像之即時人臉偵測、追蹤與辨識─嵌入式系統設計	★ 一個快速立體視覺系統的嵌入式硬體設計
★ 即時連續影像接合系統設計與實作	★ 基於雙核心平台的嵌入式步態辨識系統

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

在人機互動系統中，觸控手勢操作已成為新一代產品的必備功能。目前觸控手勢辨識主要透過後端中介軟體運算實現，這無疑加重系統工作負擔，非常不適合要求即時且資源有限的嵌入式系統使用。本研究提出一個即時手勢辨識演算法，首先對手勢操作的連續座標進行正規化處理，接著透過機率神經網路(Probability Neural Network, PNN)進行手勢辨識與分類，並將粒子群體最佳化(Particle Swarm Optimization, PSO)演算法應用於機率神經網路的平滑參數σ最佳化，改善手勢辨識率。我們以MIAT方法論將即時手勢辨識演算法全硬體化為一個智慧型觸控控制器，於FPGA平台進行硬體驗證。使用管線化(Pipeline)平行架構重新設計硬體電路以提高系統效能，並加入使用者自訂手勢功能及運用錨點概念來模擬實現多點觸控手勢功能。實驗結果顯示，此智慧型觸控控制器具有高效能、低功耗及高辨識率的特性，大幅簡化觸控應用系統設計，可適用於更小更省電的可攜式電子產品。

摘要(英)

In human-computer interaction systems, touch gestures have become the must-have feature of the new generation products. At present, touch gesture recognition is mainly implemented through the middleware of back-end system, which undoubtedly increase the system workload and is not suitable for real-time requirements and limited resources of embedded systems. This paper proposes a real-time gesture recognition algorithm. We first normalize the continuous coordinates of gestures, and then use Probability Neural Network (PNN) for gesture recognition and classification, and Particle Swarm Optimization (PSO) algorithm for PNN, which optimize the smoothing parameter σ, to improve the rate of gesture recognition. The algorithm is then synthesized into a smart touch controller by the MIAT hardware synthesis methodology and verified on a FPGA platform. We redesign the hardware circuit by using pipelined parallel architecture to improve system performance, add user-defined gestures and anchor point to simulate the multi-touch gestures. From the experiments, the smart touch controller has high performance, low power consumption and high recognition rate, and significantly simplifies the design of touch application system, which is applicable for smaller and more power saving portable electronic products.

關鍵字(中)

★ 電阻式
★ 觸控面板
★ 控制器
★ 智慧型
★ 手勢
★ 觸控手勢
★ 觸控控制器
★ 觸控

關鍵字(英)

★ touch gesture
★ gesture
★ touch
★ smart
★ controller
★ resistive
★ touch panel
★ touch controller

論文目次

摘要 i
Abstract ii
目錄 iii
圖目錄 vi
表目錄 ix
第一章緒論 1
1.1 研究動機 1
1.2 研究內容與系統架構 2
1.3 論文架構 4
第二章觸控原理與架構 6
2.1 觸控面板技術 7
2.1.1 電阻式觸控面板技術 7
2.1.2 表面電容式觸控面板技術 8
2.1.3 波動式觸控面板技術 9
2.1.4 投射電容式多點觸控技術 12
2.1.5 感測器陣列式多點觸控技術 13
2.1.6 電腦視覺式多點觸控技術 14
2.1.7 單點式觸控面板改良 17
2.2 觸控A/D轉換器 18
2.3 觸控軟體 19
2.4 觸控手勢 21
第三章觸控手勢辨識演算法 26
3.1 觸控手勢訊號前處理 26
3.1.1異常座標點濾除 28
3.1.2座標尺度調整 29
3.1.3座標點插補 30
3.2 機率神經網路分類器 33
3.2.1貝式分類器(Bayes classifier)原理 34
3.2.2 Parzen視窗法 35
3.2.3 PNN分類器設計 37
3.3 PSO應用於PNN分類器最佳化 39
3.4手勢辨識演算法驗證實驗 43
3.4.1實驗環境 43
3.4.2建立觸控手勢驗證資料庫 45
3.4.3手勢辨識演算法 45
3.4.4實驗分析 51
第四章智慧型觸控控制器設計 58
4.1 系統設計與高階合成方法論 58
4.1.1 IDEF0 59
4.1.2 GRAFCET 60
4.1.3合成規則 63
4.2 系統架構設計 66
4.3 UART通訊模組 68
4.4 觸控訊號前處理模組 72
4.4.1異常座標點濾除模組 72
4.4.2座標尺度調整模組 75
4.4.3座標點插補模組 78
4.5 機率神經網路分類器模組 81
4.5.1機率密度函數模組 81
4.5.2決策分類模組 84
4.6 管線化(Pipeline)系統架構設計 86
4.7自訂手勢與運用錨點之高階手勢 88
4.7.1 自訂手勢 89
4.7.2 運用錨點之高階手勢 91
第五章系統整合驗證與實驗 95
5.1 實驗設備與開發環境 95
5.2智慧型觸控控制器實作與驗證 98
5.2.1 基本手勢辨識實驗 100
5.2.2高階手勢實驗 101
5.2.3整合應用實驗 103
5.3 系統效能分析 106
第六章結論與未來研究方向 109
6.1 結論 109
6.2 未來研究方向 110
參考文獻 112
附錄 115

參考文獻

[1] 拓墣產業研究所, "觸控面板產業快速成長期來了", [Online]. Avalialbe:
http://www.topology.com.tw/release/releasecontent.asp?ID=6NGPNT8RUXVU9LCDNC8GW8QMV0&sKeyWord=%C4%B2%B1%B1%AD%B1%AAO. , 2010.
[2] "Windows 7 touch implementation notes", [Online]. Available: http://www.touch-base.com/documentation/Windows%207%20touch%20implementation.htm.
[3] eGalax_eMPIA Technology Inc., "手勢辨識一指搞定", [Online]. Available: http://home.eeti.com.tw/web20/eg/2009news/Tnews200901.html
[4] 拓墣產業研究所, "觸控面板產業已產生兩項巨大變化", [Online]. Avalialbe: http://www.eettaiwan.com/ART_8800570510_480502_NT_9bae35
ba.HTM. , 2009.
[5] Ching-Han Chen and Jia-Hong Dai, "Design and High-Level Synthesis of Discrete-Event Controller", National Conference of Automatic Control and Mechtronics System. Taiwan, R.O.C., pp. 75-80. , 2002.
[6] 杜金鴻, "機率神經網路之系統設計與高階合成", 義守大學電機工程學系碩士學位論文, 2003.
[7] GroovyTechnology Crop., "4-Wire Resistive Touch Screen", [Online].
Available: http://www.gtouch.com.tw/dm/Gtouch_Resistive_DM_2008Oct.pdf
[8] "電容觸碰屏驅動原理", [Online]. Available: http://bbs.meizu.com/attachment.php?aid=217398&k=16df26ed18ddce53847e8f90407235df&t=1234354241
[9] GroovyTechnology Corp., "IR Add-On Touch Screen", [Online]. Available: http://www.gtouch.com.tw/dm/Gtouch_IR_DM_2008Oct.pdf
[10] GroovyTechnology Corp., "Surface Acoustic Wave Touch Screen", [Online]. Available: http://www.gtouch.com.tw/dm/Gtouch_SAW_DM_2008Oct.pdf
[11] "3M Micro TouchTM DST Touch System", [Online]. Available: http://solutions.3m.com/wps/portal/3M/en_US/3MTouchSystems/TS/Solutions/ TouchScreens/DispersiveSignal/
[12] "Apple iPhone", [Online]. Available: http://www.apple.com/iphone/technology/
[13] P. Dietz and D. Leigh, "Diamondtouch: a multi-user touch technology", in UIST'01: Proceedings of the 14th annual ACM symposium on User interface software And technology. New York, NY, USA:ACM, 2001, pp. 219-226.
[14] S. Hodges, S. Izadi, A. Butler, A. Rrustemi and B. Buxton, "ThinSight: Versatile Multi-touch Sensing for Thin Form-factor Displays", in UIST'07: Proceedings of the 20th ACM symposium on User interface software and technology. Newport, Rhode Island, USA: ACM, 2007, pp. 259-268.
[15] "Microsoft surface", [Online]. Available: http://www.microsoft.com/surface/
[16] J. Y. Han, "Low-cost multi-touch sensing through frustrated total internalreflection", in UIST'05: Proceedings of the 18th ACM symposium on User interfacesoftware and technology. Seattle, Washington, USA: ACM, 2005, pp. 115-118.
[17] Chi-Ho Yeung, Man-Wa Lam, Hon-Ching Chan and Oscar C. Au, "Vision-Based Hand Gesture Interactions for Large LCD-TV Display Tabletop Systems", in PCM'08: Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing, pp. 89-98.
[18] Z. Mo, J.P. Lewis and U. Neumann, "SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System", in IUI'05: Proceedings of ACM symposium on intelligent User Interfaces. San Diego, CA, USA: ACM, 2005, pp. 239-243.
[19] N. Matsushita, Y. Ayatsuka and J. Rekimoto, "Dual Touch: A Two-Handed Interface For Pen-Based PDAs", in UIST'00: Proceedings of the 13th ACM symposium on User Interface software and technology. San Diego, CA, USA: ACM, 2000, pp. 211-212.
[20] J. Loviscach, "TwoFinger Input with a Standard Touch Screen", in UIST'07: Proceedings of the 20th ACM symposium on User interface software and technology.Newport, Rhode Island, USA: ACM, 2007, pp. 169-172.
[21] F. Echtler and G. Klinker, "A Multitouch Software Architecture", in NordiCHI 2008: Using Bridges, 18-22 October, Lund, Sweden: ACM.
[22] "Open Sound Control", [Online]. Available: http://opensoundcontrol.org/
[23] "TUIO", [Online]. Available: http://www.tuio.org/
[24] J. O. Wobbrock, M. R. Morris and A. D. Wilson, "User-Defined Gestures for Surface Computing ", in CHI 2009, April 4-9, 2009, Boston, Massachusetts, USA: ACM, pp. 1083-1092.
[25] S. Webel, J. Keil and M. Zoellner, "Multi-touch Gestural Interaction in X3D using Hidden Markov Models", in VRST'08, October 27-29, 2008, Bordeaux, France: ACM, pp. 263-264.
[26] A. Olwal, S. Feiner and S. Heyman, "Pubbing and Tapping for Precise and Rapid Selection on Touch-Screen Displays", in CHI 2008, Aprial 5-10, 2008, Florence, Italy: ACM, pp. 295-304.
[27] J. Matejka, T. Grossman, J. Lo and G. Fitzmauric, "The Design and Evaluation of Multi-Finger Mouse Emulation Techniques", in CHI 2009, April 4-9, 2009, Boston, Massachusetts, USA: ACM, pp.1073-1082.
[28] "Windows Touch Gestures Overview", [Online]. Available: http://msdn.microsoft.com/en-us/library/dd940543(VS.85).aspx
[29] "Apple Wins Strategic Multitouch & Music Tempo Workout Patents", [Online]. Available: http://www.patentlyapple.com/patently-apple/2010/04/ apple-wins-strategic-multitouch-music-tempo-workout-patents.html
[30] "Linear Interpolation", [Online]. Available: http://zh.wikipedia.org/wiki/%E7%BA%BF%E6%80%A7%E6%8F%92%E5%80%BC
[31] T. N. E. Greville, "Theory and Application of Spline Functions", New York: Academic, 1969.
[32] Zaknich, "Introduction to the Modified Probabilistic Neural Network for General Signal Processing Applications", IEEE Trans. On Signal Processing, Volume 46. No. 7, pp. 1980-1990. , 1998.
[33] D. F. Specht, "Probabilistic Neural Networks (original contribution)", Neural Networks, Volume 3, No.1, pp.109-118. , 1990.
[34] J. Kennedy and R. Eberhart, "Particle swarm optimization", Proc. of IEEE International Conference on Neural Networks, Volume 4, pp.1942-1948. , 1995.
[35] eGalax_eMPIA Technology Inc., "eGalaxTouch Software Programming Guide Version 2.0," [Online]. Available: http://home.eeti.com.tw/web20/eg/RES_T.html

指導教授

陳慶瀚(Ching-Han Chen)

審核日期

2011-7-15

推文