設計與實作多人多點觸控系統之研究

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：45

、訪客IP：52.15.115.134

姓名

蘇家漢(Jia-Han Su) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

設計與實作多人多點觸控系統之研究
(The Study of Designing a Multi-user and Multi-touch Computing System)

相關論文

★ 無縫隙整合註記學習系統	★ 同步表演機器人之建構與成效評估
★ 探討國小學童使用電子書多媒體註記系統結合註記分享機制對其學習行為與時間之影響	★ 先備知識對註記式多媒體電子書的影響研究：從個別環境到分享環境
★ Facilitating EFL speaking and writing with peer-tutoring and storytelling strategies in authentic learning context	★ An investigation into CKEL-supported EFL learning with TPR to reveal the importance of pronunciation and interactive sentence making
★ Investigation of Facilitating Physics Learning using Ubiquitous-Physics APP with Learning Map and Discussion Board in Authentic Contexts	★ 智慧互動SmartVpen在真實情境對於英文學習之影響
★ 利用合作虛擬化的網絡設計輔助計算機網路學習	★ 探討擴展合作式多媒體認知理論和其對EFL聽力與口語能力之影響 - 結合動覺辨識和學習者設計內容之猜謎遊戲
★ 在真實情境中利用智慧機制提升國小學生之外語口說及對話能力之評估	★ 探討在真實情境下教師回饋對學習認知與學習持續性之影響
★ 註釋、對話代理和協作概念圖支持大學生議論文寫作和後設認知的培養	★ Developing and Validating the Questionnaire and Its Model for Sustainable and Scalable Authentic Contextual Learning Supported by Mobile Apps
★ 探討個人化、情境化及社會化的智慧機制輔助真實情境國小幾何學習與其對學習成效之影響	★ Investigation of smart mechanisms for authentic contextual learning with sensor and recognition technologies

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

近年來，人機互動介面的領域已經廣泛此採用了多點觸控技術。但這項技術除了改善人機之間的互動之外，作者還發現它有更大的潛能將此技術推廣到在人們做面對面溝通與合作的輔助平台，用來改善人與人之間的互動。為了完成這樣的系統，這篇研究設計和實作了一個支援多人多點觸控的運算系統，這系統一共包含了三層的軟體堆疊，從底層到最上層的分別是: 1.多點觸控的追蹤演算法、2. 支援多人多點互動的應用程式開發介面，和3.應用程式。在多點觸控追蹤演算法方面，作者使用了OpenCL的運算模型來實作針對GPU最佳化的演算法，以提高運算的速度與品質，並將這套軟體命名為diTouch。結果顯示diTouch即使在處理百萬像素的解析度下，也擁有每秒五十格以上的處理速度，在相同的測試環境下比知名的Open Source 專案TouchLib還快五到七倍。除了速度之外，作者還加入了以像素為單位的臨界值查表法(threshold map)、二維條碼追蹤，和手指中心位置偵測等技術來增加辨識的精準度。更重要的是現代的作業系統並沒有支援在單一螢幕下的多人使用情境。為了克服這樣的困難，作者在Java Swing的基礎之上，用OpenGL改寫整個UI的底層繪圖系統，來支援可自由旋轉，和多重鎖定的視窗功能，讓使用者介面針對多人多點互動最佳化，並命名Surface Application Framework (SAF)。並且基於這樣的架構開發了多套的應用程式，證實這樣的系統是可行的。最後，作者基於這套系統的研究經驗，提出多個可行的改善方案，包括子像素(sub-pixel)精準度的演算法、使用者辨識和以HTML5為基礎的應用程式開發介面，來改善應用程式開發環境和使用者經驗。

摘要(英)

Recently, the multi-touch technology has become widely available for human-computer interaction. We found it has a great potential to facilitate more awareness of human-to-human interaction than conventional computers in co-located collaborative work. To complete such a computing system, this study builds three layers of software stack; they are multi-touch tracking layer, multi-touch and multi-user-supported UI framework layer, and applications layer. In the multi-touch tracking layer, this study proposes a novel GPU computing framework, name diTouch for robust multi-touch tracking. It utilizes the OpenCL programming model benefited greatly from GPU. The results of the test showed that diTouch promises to have more than 50 frames process speed per second on million pixels image sequence, which is 5 to 7 times faster than that of optimized CPU implementation. Besides the speed, more features, like recursive and symmetric highpass-filter, threshold map and, 2D tag detection, hand detection and fingertip locating are investigated in the proposed system. Moreover, co-located interactions rarely been concerned by other studies, is also being explored. Therefore, the user interface framework, namely Surface Application Framework (SAF), is designed to support multi-touch and multi-user applications on the proposed computing system. Finally, this study suggests some future improvements of the propose system, like sub-pixel precision tracking, three dimensions CSCW design approaches, user recognition and novel HTMl5 based UI framework.

關鍵字(中)

★ 設計與實作多人多點觸控系統之研究

關鍵字(英)

★ The Study of Designing a Multi-user and Multi-to

論文目次

摘要 i
Abstract iii
List of Figures viii
List of Tables xi
1. Introduction 1
1.1. Surface Computer Supported Cooperative Work 1
1.2. A Multi-user and Multi-touch Computing System 4
1.2.1. GPU-based Multi-touch Tracking Method 6
1.2.2. Surface Application Framework 9
2. Related Works 12
2.1 Multi-Touch Technology 12
2.2 Related Multi-touch Tracking Projects 14
2.3 Parallel Computing Model 16
2.4 Workspace Awareness and Tabletop Interaction 19
2.5 User Interface Frameworks 20
2.6 Evaluation on Co-located Collaborative Activity 22
3. Method 23
3.1 General Image Procession Methods to Detect Touch Objects on IR Image 23
3.2 Limitations to Previous Project 24
3.3 Suggestions for Optimized OpenCL Kernel Implementation on GPU 26
3.4 Proposed Touch Tracking Algorithms 33
3.5 Multi-touch and Multi-user Supported UI Framework 49
3.5.1 Design Issue 49
3.5.2 Implementation 54
4. Applications 58
4.1 Robot Tutor Project 58
4.2 English Idiom Composing Game 59
4.3 Collect Coins Game 62
5. Evaluation on Proposed Multi-touch Tracking Method 64
5.1 Multi-touch Tracking Functionality 64
5.2 Multi-touch Tracking Speed 66
5.3 User Study: Results and Analysis 72
5.3.1 Quantitative Analysis Results 72
5.3.2 Qualitative Analysis Results 75
5.3.3 Questionnaire Results 77
6. Conclusions 81
6.1 Sub-pixel Precision Tracking Method 82
6.2 HTML5 and JavaScript 83
6.3 Hand and User Recognition 85
6.4 Interaction Techniques 86
References 91

參考文獻

Alexander Kharlamov and Victor Podlozhnyuk. (2007). “Image Denoising,” Tech. Rep., NVIDIA, Inc.
Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P., Bederson, B. (2003). Drag-and-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems. Paper presented at the Proc. Interact.
Bernsen, J. (1986). "Dynamic thresholding of grey-level images," in Proc. 8th ICPR, pp. 1251-1255.
Buxton, B. (2007). Multi-touch systems that I have known and loved, Microsoft Research,.
Carroll, J. M., Rosson, M. B., Convertino, G., & Ganoe, C. H. (2006). Awareness and teamwork in computer-supported collaborations. Interacting with Computers, 18(1), 21-46.
Chittaro, L., & Ranon, R. (2007). Web3D technologies in learning, education and training: Motivations, issues, opportunities. Computers & Education, 49(1), 3-18.
Collomb, M., Hascoet, M., Baudisch, P., & Lee, B. (2005). Improving drag-and-drop on wall-size displays. Paper presented at the Proceedings of Graphics Interface 2005, 25-32.
Dietz, P. H., & Eidelson, B. D. (2009). SurfaceWare: Dynamic tagging for Microsoft surface. Paper presented at the Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, 249-254.
Dietz, P., & Leigh, D. (2001). DiamondTouch: A multi-user touch technology. Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, 219-226.
Dongen, S. V. (2000). MCL - a cluster algorithm for graphs. Analysis. Retrieved from http://www.micans.org/mcl/
Dourish, P.; Bellotti, V. (1992). "Awareness and coordination in shared workspaces". Proceedings of the 1992 ACM conference on Computer-supported cooperative work. ACM Press New York, NY, USA. pp. 107-114.
Evans, M. A., Rick, J., Horn, M., Shen, C., Mercier, E., McNaughton, J., Higgins, S., Burd, E., Tissenbaum, M., Lui, M., Slotta, J. D., Martinez Maldonado, R. and Clayphan, A. (2012). Interactive surfaces and spaces: A learning sciences agenda. In Proceedings of ICLS 2012, volume 2, pages 78–85. ISLS.
Gutwin, C., & Greenberg, S. (2004). The importance of awareness for team cognition in distributed collaboration. In E. Salas & S. M. Fiore (Eds.), Team cognition: Understanding the factors that drive processes and performance (pp. 177–201). Washington: APA Press.
Han, J. Y. (2005). Low-cost multi-touch sensing through frustrated total internal reflection. Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, 115-118.
Harold W. Kuhn, "The Hungarian Method for the assignment problem", Naval Research Logistics Quarterly, 2:83–97, 1955. Kuhn’’s original publication.
Hawick, K. Leist, A. and Playne, D. (2009). "Parallel graph component labelling with gpus and cuda," Preprint Submitted to Parallel Computing.
Homans, George C. (1958). "Social Behavior as Exchange". American Journal of Sociology 63 (6): 597-606.
Hornecker, E., Marshall, P., Dalton, N. S., & Rogers, Y. (2008). Collaboration and interference: Awareness with mice or touch input. Paper presented at the Proceedings of the ACM 2008 Conference on Computer Supported Cooperative Work, 167-176.
Intel Inc. (2009). "Open Source Computer Vision," The OpenCV Open Source Computer Vision Library, vol. 2009, 24 November.
Ishii, H. (1990). TeamWorkStation: Towards a seamless shared workspace. Paper presented at the Proceedings of the 1990 ACM Conference on Computer-Supported Cooperative Work, 13-26.
Izadi, S. Agarwal, A. Criminisi, A. Winn, J. Blake, A. Fitzgibbon, A. (2007), "C-Slate: A Multi-Touch and Object Recognition System for Remote Collaboration using Horizontal Surfaces", Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems, pp. 3–10, October 2007.
Jezek2. (2009/4/4). JBullet - java port of bullet physics library. Retrieved 5/13, 2009, from http://jbullet.advel.cz/
Jie Zhu and Jie Yang. 2002. Subpixel Eye Gaze Tracking. In Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FGR ’’02). IEEE Computer Society, Washington, DC, USA, 131-.
Kaltenbrunner, M., & Bencina, R. (2007). reacTIVision: A computer-vision framework for table-based tangible interaction. Paper presented at the Proceedings of the 1st International Conference on Tangible and Embedded Interaction, 69-74.
Kaltenbrunner, M., Bovermann, T., Bencina, R., & Costanza, E. (2005). TUIO: A protocol for table-top tangible user interfaces. Paper presented at the Proc. of the the 6th Int’l Workshop on Gesture in Human-Computer Interaction and Simulation.
Kruger, R., Carpendale, S., Scott, S. D., & Greenberg, S. (2003). How people use orientation on tables: Comprehension, coordination and communication. Paper presented at the Proceedings of the 2003 International ACM SIGGROUP Conference on Supporting Group Work, 369-378.
Mazalek, A., Reynolds, M., & Davenport, G. (2006). TViews: An extensible architecture for developing multi-user digital media tables. Submitted to IEEE CG&A, Special Issue on Interacting with Digital Tabletops.
Morris, M.R., Fisher, D., and Wigdor, D. (2010). Search on Surfaces: Exploring the Potential of Interactive Tabletops for Collaborative Search Tasks. Information Processing and Management, Spring 2010.
Morris, M. R., Huang, A., Paepcke, A., & Winograd, T. (2006). Cooperative gestures: Multi-user gestural interactions for co-located groupware. Proceedings of the 2006 SIGCHI Conference on Human Factors in Computing Systems, 1201-1210.
Moyer, P. S., Bolyard, J. J., & Spikell, M. A. (2002). What are virtual manipulatives?. Teaching Children Mathematics, 8(6), 372-377.
Munshi, A. (2009) "The OpenCL specification version 1.0," Khronos OpenCL Working Group, 2009.
NUI Group Community. (2009), "Touchlib: an opensource multi-touch framework," vol. 2009, 26 October.
NVidia, C. (2009). "CUDA Zone," vol. 2009, December 13.
Pinelle, D., Nacenta, M., Gutwin, C., & Stach, T. (2008). The effects of co-present embodiments on awareness and collaboration in tabletop groupware. Paper presented at the Proceedings of Graphics Interface 2008, 1-8.
Piper, A. M., O’’Brien, E., Morris, M. R., & Winograd, T. (2006). SIDES: A cooperative tabletop computer game for social skills development. Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work, 1-10.
Rekimoto, J., & Matsushita, N. (1997). Perceptual surfaces: Towards a human and object sensitive interactive display. Workshop on Perceptual User Interfaces (PUI’97) , 30-32.
Rick, J., Rogers, Y., Haig, C., and Yuill, N (2009). Learning by doing with shareable interfaces. Children, Youth & Environments, 19(1),.
Rogers, Y., & Lindley, S. (2004). Collaborating around vertical and horizontal large interactive displays: Which way is best? Interacting with Computers, 16(6), 1133-1152.
Schoning, J., Brandl, P., Daiber, F., Echtler, F., Hilliges, O., Hook, J. (2008). Multi-touch surfaces: A technical guide Technical report, Technical University of Munich
Shen, C., Vernier, F. D., Forlines, C., & Ringel, M. (2004). DiamondSpin: An extensible toolkit for around-the-table interaction. Paper presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 167-174.
Thomson, A. M., Perry, J. L., & Miller, T. K. (2009). Conceptualizing and measuring collaboration. Journal of Public Administration Research and Theory, 19(1),23-56
Triona, L. M., & Klahr, D. (2003). Point and click or grab and heft: Comparing the influence of physical and virtual instructional materials on elementary school students’’ ability to design experiments. Cognition and Instruction, 21(2), 149-173.
Tuddenham, P., & Robinson, P. (2007). Distributed tabletops: Supporting remote and mixed-presence tabletop collaboration. Horizontal Interactive Human-Computer Systems, 2007. TABLETOP’’07. Second Annual IEEE International Workshop on, 19-26.
Tuddenham, P., & Robinson, P. (2009). Territorial coordination and workspace awareness in remote tabletop collaboration. Paper presented at the Proceedings of the 27th International Conference on Human Factors in Computing Systems, 2139-2148.
Van Dongen, S. (2000). A cluster algorithm for graphs. Report- Information Systems, (10), 1-40.
Vasconcelos, C.N and Rosenhahn, B., (2009). "Bipartite Graph Matching Computation on GPU," Energy Minimization Methods in Computer Vision and Pattern Recognition, vol. 5681, pp. 42-55.
Wilson, A. D. (2004). TouchLight: An imaging touch screen and display for gesture-based interaction. Proceedings of the 6th International Conference on Multimodal Interfaces, 69-76.
Wu-Yuin Hwang and Jia-Han Su. (2011)” The Study of Surface Computer Supported Cooperative Work and its Design, Efficiency and Challenge”, Interactive Learning Environment, 1-22, Jul 2011.
Xiph.Org. (2008/12/31). Theora video compression. Retrieved 5/31, 2009, from http://www.theora.org/
Zurita, G., & Nussbaum, M. (2004). Computer supported collaborative learning using wirelessly interconnected handheld computers. Computers & Education, 42(3), 289-314.

指導教授

黃武元(Wu-Yuin Hwang)

審核日期

2012-7-27

推文