A Gesture-based Presentation System for Smart Classroom using Kinect

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：108

、訪客IP：18.223.203.68

姓名

吳桑墨(Worapot Sommool) 查詢紙本館藏

畢業系所

軟體工程研究所

論文名稱

A Gesture-based Presentation System for Smart Classroom using Kinect
(利用Kinect建置於智慧型教室中基於手勢辨識之簡報系統)

相關論文

★ 基於edX線上討論板社交關係之分組機制	★ 利用Kinect建置3D視覺化之Facebook互動系統
★ 利用 Kinect建置智慧型教室之評量系統	★ 基於行動裝置應用之智慧型都會區路徑規劃機制
★ 基於分析關鍵動量相關性之動態紋理轉換	★ 針對JPEG影像中隙縫修改之偵測技術
★ 基於保護影像中直線結構的細縫裁減系統	★ 建基於開放式網路社群學習環境之社群推薦機制
★ 英語作為外語的互動式情境學習環境之系統設計	★ 基於膚色保存之情感色彩轉換機制
★ 一個用於虛擬鍵盤之手勢識別框架	★ 分數冪次型灰色生成預測模型誤差分析暨電腦工具箱之研發
★ 使用慣性傳感器構建即時人體骨架動作	★ 基於多台攝影機即時三維建模
★ 基於互補度與社群網路分析於基因演算法之分組機制	★ 即時手部追蹤之虛擬樂器演奏系統

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

Teaching in a classroom is a routine work for the teacher who provides education for the students. Emerging of computers and technologies for education enhance teaching experience and facilitate teacher to use varies teaching media such as video, audio, slide presentation, computer and internet.
However, speaking in public may be a challenging task in terms of self-control and at-tention to the concept to expose and to non-verbal communication. The presentation software, like Microsoft PowerPoint or OpenOffice, may support the speaker in organizing and control-ling the flow of his/her discussion by commanding slide change. Nevertheless, traditional keyboard and mouse based presentation prevent speakers from freely and closely interacting with the audiences, because the speaker continuously has to go to the computer to manage the presentation. Even nowadays, most of this problem has been overcome by the presence wire-less control but also these devices have some drawbacks. Indeed, these kind of device just can support some controlling of the presentation not cover all of functions that teachers or pre-senters need such as play a video on the slide, switching slide show, shows the webpage of reference links from slide, recording a video for making learning material.
In this study proposed a gesture-based presentation system in the classroom, in particular provide a functionality presentation tools to facilitate teachers interact with a presentation software. The system is designed to use a Kinect sensor for input device by capture a teacher’s gesture and create a new set of gesture commands for managing a presentation.
For the experiment, the system was tested by the volunteers from MINElab, department of computer science and information engineering at National Central University, Taiwan R.O.C. The assessment is based on the combined usage of three techniques: a questionnaire-based survey which aims to measure a user satisfaction, also when compare the functionality with other existing systems, and testing the system performance in term of the command ac-curacy.
The result of the questionnaire indicates that for a general opinion of the user were satis-fied of the overall usability of this system. The participants agree about functions and the ease of use of the presentation application. The result of comparing the system with others its shown the system has more functions and may cover all functions that teachers or presenters need during a presentation. The implication of system performance result is the set of com-mand is easy to use and hardly lacking of the command. The commands are appropriate and cover the teachers’ needs during the presentation.

摘要(英)

教室是老師平常教授學生的學習場所。電腦的興起和教育技術的發展，提高了教師教學經歷，也提供給了老師更多的教學媒體，例如影片，音訊，投影片和網路。
然而，在公共場合演講時在自身控制方面會和闡述時的注意力以及口頭上的交流等方面相互影響。時下流行的演講軟體，例如Microsoft PowerPoint或者是OpenOffice都可以支援演講時流動的控制他/她的演講。然後，傳統的鍵盤和滑鼠的控制限制了演講者和聽講者之間的互動，因為演講者需要不停的使用電腦進行演講。甚至至今，雖然無線網路設備解決到了大多數的距離控制的問題，但這些設備或多或少還存在著些許問題。實際上，這些無線設備僅提供了一小部份的作用，並沒能包含所有演講者需要的功能，例如在投影片中播放影片，切換投影片，打開投影片中的網絡鏈接，記錄一個影片作為學習材料等等。
在這次研究中提出了一個教室中的基於手勢的演講系統，並且提供了一個演講工具來幫助演講者與演講軟體之間的一個更好的互動和操作。該系統的設計是通過使用Kinect去捕捉演講者的動作姿態和制定一套手勢命令來輔助演講。
在實驗部份，系統已經在MINElab(資訊工程學系，國立中央大學，台灣)的成員進行測試。測試結果的評估是基於以下三個指標: 一是使用者滿意度的問卷，二是與現有的類型的系統做比較以及測試系統的效能以及精準度。
問卷調查的結果顯示，使用者對系統的設計和操控性還總體滿意。參與者也認同，並覺得該系統使用簡單，操作人性化。與現有的演講系統比，本系統包含更多的功能，幾乎囊括了演講者或者教師在演講中所需的所有功能，最後在系統效能方面，結果顯示所有的指令都能夠被輕易地使用，而這些指令與老師上課時的需求相當符合。

關鍵字(中)

★ 數位學習
★ 人機互動
★ kinect
★ 簡報
★ 智慧型教室
★ 影片協助教學

關鍵字(英)

★ e-learning
★ Human-computer interaction
★ Kinect
★ presentation
★ smart classroom
★ video assisted teaching

論文目次

摘要 i
ABSTRACT ii
Acknowledgments iv
Table of Contents v
List of Figures vii
List of Tables viii
Chapter 1 Introduction 1
1.1 Background 1
1.2 Problem Statement 2
1.3 Research Objectives 2
1.4 Scope and Limitations of the Study 2
1.5 Assumptions 2
1.6 Organization of the Thesis 2
Chapter 2 Literature Reviews 4
2.1 Review of Technologies in the Classroom 4
2.1.1 Real world education 7
2.1.2 Online courses 7
2.1.3 Game and gamification 8
2.1.4 Learning analytics 8
2.1.5 Open source textbooks 9
2.1.6 Integration of social network 9
2.2 Computer-Assisted Teaching 12
2.3 Motion sensing devices 13
2.3.1 Microsoft Kinect sensor 13
2.3.2 Asus Xtion 15
2.3.3 Nintendo Wii Remote 17
2.3.4 The PlayStation Move 18
2.3.5 Leap Motion 20
2.3.6 MYO armband 21
2.4 Presentation Software 26
2.5 Gesture Recognition 29
2.6 Speech Recognition 30
2.7 Video Generating 31
2.8 Related Research Studies of Gesture-based Presentation 35
Chapter 3 Method 38
3.1 System Architecture 38
3.1.1 Skeleton tracking 42
3.1.2 Gesture command recognizer 43
3.1.3 Voice command recognizer 51
3.1.4 Video recorder 53
3.1.5 Command Activator 55
3.1.6 Program interface 56
Chapter 4 Implementation and Discussion 61
4.1 System Implementation 61
4.1.1 System requirement 61
4.2.2 System setup 61
4.2 System Testing 62
4.2.1 System comparison 62
4.2.2 A questionnaire-based survey 64
4.2.3 The system performance 65
4.3 Discussion 66
4.3.1 System comparison 66
4.3.2 Questionnaire-based survey 67
4.3.3 System performance 68
Chapter 5 Conclusion and Future Work 71
Bibliography 73
Appendix A usability questionnaire 79

參考文獻

[1] D. Domermuth, "Creating a Smart Classroom," Tech Directions, vol. 64, no. 6, pp. 21-22, 2005.
[2] Y. Atif, "Conversational learning integration in technology enhanced classrooms," Computers in Human Behavior, vol. 29, no. 2, p. 416–423, 2013.
[3] Y. Shi, W. Xie, G. Xu, R. Shi, E. Chen, Y. Mao and F. Liu, "The smart classroom: merging technologies for seamless tele-education," IEEE Pervasive Computing, vol. 2, no. 2, pp. 47 - 55, 2003.
[4] B. Gerd, F. Steinicke and K. H. Hinrichs, "Arch-explore: A natural user interface for immersive architectural walkthroughs.," in IEEE Symposium on 3D User Interfaces, Louisiana, 2009.
[5] Sony Computer Entertainment America LLC, "PlayStation®Move Essentials Bundle," [Online]. Available: http://us.playstation.com/ps3/systems/ps3-move-essentials-bundle.html. [Accessed 16 April 2013].
[6] Microsoft Corporation, "Inside the Newest Kinect for Windows SDK—Infrared Control," 7 December 2012. [Online]. Available: http://blogs.msdn.com/b/kinectforwindows/archive/2012/12/07/inside-the-newest-kinect-for-windows-sdk-infrared-control.aspx. [Accessed 17 May 2013].
[7] Sd13, "WII เกมคอนโซลสำหรับครอบครัว," 26 February 2009. [Online]. Available: http://learning-center.info/kblog/sd13/2009/02/26/wii-เกมคอนโซลสำหรับครอบคร/. [Accessed 17 May 2013].
[8] M. A. Rahman, V. K. Sarker and K. A. Sayeed, "iClassroom: Toward a low cost interactive classroom," in 2012 15th International Conference on Computer and Information Technology (ICCIT) , Chittagong, Bangladesh, 2012.
[9] S. Cuccurullo, R. Francese, S. Murad, I. Passero and M. Tucci, "A gestural approach to presentation exploiting motion capture metaphors," in AVI ’12 Proceedings of the International Working Conference on Advanced Visual Interfaces, NY, USA, 2012 .
[10] "Filmstrip & Film Projectors and STEM Education & Technology," Retro Educational Technology, 13 March 2011. [Online]. Available: http://www.retroedtech.com/2011/03/filmstrip-film-projectors-and-stem.html. [Accessed 6 June 2013].
[11] K. Blackyard, "New Life For Old Memories: 5 Reasons You Should Be Organizing and Preserving Your Memories," ScanDigital, Inc., 14 June 2009. [Online]. Available: http://www.scandigital.com/blog/digital-photography/new-life-for-old-memories-5-reasons-you-should-be-organizing-and-preserving-your-memories/. [Accessed 5 June 2013].
[12] P. Banner, "The Teaching Machine," 2 November 2012. [Online]. Available: http://apus-ctl.com/the-teaching-machine/. [Accessed 17 May 2013].
[13] Centre for Teaching Excellence Blog, "iClick? iClick not. — Dan Gan, CTE Co-op Student," Centre for Teaching Excellence Blog, 11 July 2012. [Online]. Available: http://cte-blog.uwaterloo.ca/?p=3458. [Accessed 30 May 2013].
[14] Chandni, "Projecting the Past," Network18 Media & Investments Ltd, 24 April 2012. [Online]. Available: http://betterphotography.in/2012/04/24/projecting/. [Accessed 5 June 2013].
[15] E. Hoover, "How We Separate Merit From Privilege," 20 January 2013. [Online]. Available: http://chronicle.com/blogs/headcount/how-we-separate-merit-from-privilege/33503. [Accessed 17 May 2013].
[16] Wikimedia Foundation, Inc., "The Oregon Trail (video game)," 13 May 2013. [Online]. Available: http://en.wikipedia.org/wiki/The_Oregon_Trail_(video_game). [Accessed 17 May 2013].
[17] Wikia community, "U.S. Game Show Wiki: Where in the world is Carmen Sandiego?," [Online]. Available: http://gameshows.wikia.com/wiki/Where_in_the_World_is_Carmen_Sandiego%3F. [Accessed 17 May 2013].
[18] M. Chris , "Tablet sales explode for Christmas 2012: The must have gadget of 2012," IDG United Kingdom, 2012 December 2012. [Online]. Available: http://www.pcadvisor.co.uk/news/tablets/3415949/tablet-sales-explode-for-christmas-2012/. [Accessed 6 June 2013].
[19] IVCi, LLC, "SMART Board 600 Series Interactive Whiteboard," IVCi Collabrorate Anywhere, 2012. [Online]. Available: http://audiovisual.ivci.com/smart-board-600-series-interactive-whiteboard.html. [Accessed 5 June 2013].
[20] R. Kerr, "Year-old YouTube EDU grows and grows," Vator, Inc., 25 March 2010. [Online]. Available: http://vator.tv/news/2010-03-25-year-old-youtube-edu-grows-and-grows. [Accessed 5 June 2013].
[21] S. Zakkas, "Technology in Classroom," InfographicsMania, 24 July 2012. [Online]. Available: http://infographicsmania.com/technology-in-classrooms/. [Accessed 4 May 2013].
[22] "Project-based learning," Wikimedia Foundation, Inc., 5 June 2013. [Online]. Available: http://en.wikipedia.org/wiki/Project-based_learning. [Accessed 6 June 2013].
[23] "E-learning," Wikimedia Foundation, Inc., 5 June 2013. [Online]. Available: http://en.wikipedia.org/wiki/E-learning. [Accessed 6 June 2013].
[24] H. Coffey, "Digital game-based learning," University of North Carolina at Chapel Hill School of Education, [Online]. Available: http://www.learnnc.org/lp/pages/4970. [Accessed 6 June 2013].
[25] J. Doove, "Learning Analytics," SURF Organization, [Online]. Available: http://www.surf.nl/en/themas/InnovationinEducation/learninganalytics/Pages/default.aspx. [Accessed 6 June 2013].
[26] "E-book," Wikimedia Foundation, Inc, 2 June 2013. [Online]. Available: http://en.wikipedia.org/wiki/Ebook. [Accessed 6 June 2013].
[27] J. Berzy, M. Donnahee, J. Franzen, K. Lidwell-McFerren, K. Plechaty, A. Ross and T. Walls, "Social Networking in Education Wiki," Wikia, [Online]. Available: http://socialnetworkingeducation.wikia.com/wiki/Social_Networking_in_Education_Wiki. [Accessed 6 June 2013].
[28] Y. Suo, N. Miyata, T. Ishida and Y. Shi, "Suo, Yue, et al. "Open smart classroom: Extensible and scalable smart space using Web service technology." Advances in Web Based Learning–ICWL 2007," Advances in Web Based Learning–ICWL 2007, vol. 4823, pp. 428-439, 2008.
[29] Y. Shi, W. Qin, Y. Suo and X. Xiao, "Smart Classroom: Bringing Pervasive Computing into Distance Learning," in Handbook of Ambient Intelligence and Smart Environments, Springer US, 2010, pp. 881-910.
[30] B. Hamner, "CHALEARN Gesture Challenge: Competition Forum," 31 May 2010. [Online]. Available: https://www.kaggle.com/c/GestureChallenge/forums/t/1150/getting-started/8061. [Accessed 4 April 2013].
[31] H. "เจาะลึกโครงสร้างของ Kinect สำหรับ Windows (ตอนที่ 1)," 9 April 2012. [Online]. Available: http://kinectasia.wordpress.com/2012/04/09/เจาะลึกโครงสร้างของ-kinect-สำ/. [Accessed 6 June 2013].
[32] ASUSTeK Computer Inc., "Xtion PRO LIVE," Asus, 2013. [Online]. Available: http://www.asus.com/Multimedia/Xtion_PRO_LIVE. [Accessed 2 May 2013].
[33] I Heart Robotics, "ASUS Xtion PRO LIVE Unboxing," 12 September 2011. [Online]. [Accessed 17 May 2013].
[34] L. Lewis, "Motion Sensing," 3 November 2009. [Online]. Available: http://www.grantowngrammar.highland.sch.uk/Pupils/3E%2009-11/Lucinda%20Lewis/Input%20devices/Motion%20sensing.html. [Accessed 17 May 2013].
[35] Y. Yang and L. Li, "Turn a Nintendo Wiimote into a handheld computer mouse.," Potentials, IEEE , pp. 12-16, 2011.
[36] D. Singh, R. Omar and A. Anuar, "Low cost interactive electronic whiteboard using Nintendo Wii remote," American Journal of Applied Sciences, pp. 1458-1463, 2010.
[37] J. Lin, H. Nishino, T. Kagawa and K. Utsumiya, "Free hand interface for controlling applications based on Wii remote IR sensor," in Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry, New York, 2010.
[38] Xunzhang, "Sony PlayStation Move," 16 April 2013. [Online]. Available: http://wiki.etc.cmu.edu/unity3d/index.php?title=Sony_PlayStation_Move&action=history. [Accessed 20 April 2013].
[39] flared0ne, "LEAP: Technical specifications," 1 January 2013. [Online]. Available: https://forums.leapmotion.com/showthread.php?1005-Technical-specifications&p=5795&viewfull=1#post5795. [Accessed 16 April 2013].
[40] AppleInsider Staff, "Leap Motion controller sales pushed back to July due to software issues," AppleInsider.com, 25 April 2013. [Online]. Available: http://appleinsider.com/articles/13/04/25/leap-motion-controller-sales-pushed-back-to-july-due-to-software-issues. [Accessed 4 May 2013].
[41] Thalmic Labs, "Introducing MYO," ThalmicLabs, 2013. [Online]. Available: https://www.thalmic.com/myo/. [Accessed 28 June 2013].
[42] Microsoft, "CODING4FUN," 2013. [Online]. Available: http://channel9.msdn.com/coding4fun/kinect. [Accessed 14 May 2013].
[43] J. Kissko, "Kinect education connected education: what will you create?," 2013. [Online]. Available: http://www.kinecteducation.com/. [Accessed 14 May 2013].
[44] Developer Fusion Ltd., "Kinect SDK Forum," 2013. [Online]. Available: http://www.developerfusion.com/t/kinect/forum/. [Accessed 14 May 2013].
[45] C. Kalani, "SYNAPSE for Kinect," Tumblr, 2012. [Online]. Available: http://synapsekinect.tumblr.com/. [Accessed 4 May 2013].
[46] Wikimedia Foundation, Inc., "Presentation program," 25 May 2013. [Online]. Available: http://en.wikipedia.org/wiki/Presentation_program. [Accessed 14 April 2013].
[47] Wikipedia, "Microsoft PowerPoint," Wikipedia, the free encyclopedia, 2 June 2013. [Online]. Available: http://en.wikipedia.org/wiki/Microsoft_powerpoint. [Accessed 5 June 2013].
[48] Wikipedia, "File:Microsoft PowerPoint 2013 Default Screen.png," Wikipedia, the free encyclopedia, 25 March 2013. [Online]. Available: http://en.wikipedia.org/wiki/File:Microsoft_PowerPoint_2013_Default_Screen.png. [Accessed 5 June 2013].
[49] Apache Software Foundation, "Apache OpenOffice Impress," Apache, [Online]. Available: http://www.openoffice.org/product/impress.html. [Accessed 5 June 2013].
[50] Z. Zafrulla, H. Brashear, T. Starner, H. Hamilton and P. Presti, "American sign language recognition with the kinect," in Proceedings of the 13th international conference on multimodal interfaces, New York, 2011.
[51] TangoChen, "Kinecursor v1.2," 12 February 2013. [Online]. Available: http://tangochen.com/blog/?p=673. [Accessed 4 May 2013].
[52] B. Peek, "Kinect Mouse Cursor," 16 June 2011. [Online]. Available: http://channel9.msdn.com/coding4fun/projects/Kinect-Mouse-Cursor. [Accessed 13 February 2013].
[53] R. Adams, Sourcebook of automatic identification and data collection, New York: Van Nostrand Reinhold, 1990.
[54] M. Papadopoulos and E. Pearson, "Improving the accessibility of the traditional lecture: an automated tool for supporting transcription," in Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers, UK, 2012.
[55] T. C. Kuo, R. Shadiev, W.-Y. Hwang and N.-S. Chen, "Effects of applying STR for group learning activities on learning performance in a synchronous cyber classroom," Computers & Education, vol. 58, no. 1, pp. 600-608, 2012.
[56] Wikimedia Foundation, Inc., "DirectShow," 26 February 2013. [Online]. Available: http://en.wikipedia.org/wiki/DirectShow. [Accessed 30 April 2013].
[57] Kubrick, "Thoughts on directshow," just do IT, 11 April 2010. [Online]. Available: http://rxwen.wordpress.com/2010/04/11/thoughts-on-directshow/. [Accessed 3 May 2013].
[58] AForge.NET, "AForge.NET," 2012. [Online]. Available: http://aforgenet.com/framework/. [Accessed 25 April 2013].
[59] M. Musundi, "WPF: Webcam Control," 18 November 2011. [Online]. Available: http://www.codeproject.com/Articles/285964/WPF-Webcam-Control. [Accessed 20 April 2013].
[60] C.-Y. Chang, Y.-T. Chien, C.-Y. Chiang, M.-C. Lin and H.-C. Lai, "Embodying gesture-based multimedia to improve learning," British Journal of Educational Technology, pp. E5-E9, 2013.
[61] A. Bragdon, R. DeLine, K. Hinckley and M. R. Morris, "Code space: touch + air gesture hybrid interactions for supporting developer meetings," in ITS ’11 Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, New York, 2011.
[62] S. Raiten, "Kinect – Getting Started – Become The Incredible Hulk," 17 June 2011. [Online]. Available: http://blogs.microsoft.co.il/blogs/shair/archive/2011/06/17/kinect-getting-started-become-the-incredible-hulk.aspx. [Accessed 5 May 2013].
[63] Microsoft Corporation, "Keyboard shortcuts for use while delivering a presentation in PowerPoint 2010," 2013. [Online]. Available: http://office.microsoft.com/en-us/powerpoint-help/keyboard-shortcuts-for-use-while-delivering-a-presentation-in-powerpoint-2010-HP010336520.aspx. [Accessed 30 May 2013].
[64] J. R. Lewis, "IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use," International Journal of Human-Computer Interaction, pp. 57-78, 1995.
[65] T. Mohammad, H. Seifi and J. Shi, "Design of Gesture-based Input Devices for Controlling Presentation".
[66] Y. Chen , M. Liu, J. Liu, Z. Shen and W. Pan, "Slideshow: Gesture-aware PPT presentation," in 2011 IEEE International on Multimedia and Expo (ICME), Barcelona, 2011.

指導教授

施國琛(Timothy K. Shih)

審核日期

2013-7-9

推文