探討專家和新手對遊戲式學習進行可用性評估的觀感差異

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：5

、訪客IP：18.217.208.72

姓名

梅菘育(Song-Yu Mei) 查詢紙本館藏

畢業系所

網路學習科技研究所

論文名稱

探討專家和新手對遊戲式學習進行可用性評估的觀感差異
(An Investigation of the Usability of Game-based Learning: Experts vs. Novices)

相關論文

★ 將可用性整合融入遊戲式學習	★ 探討認知風格對於行動學習與合作學習的影響
★ 學習型網站的可用性評估：從問題到解決方案	★ 從人因的觀點評估遊戲式學習
★ 探討認知風格在遊戲式學習中對於客製化與個人化系統的影響	★ 探討認知風格在行動學習中對於客製化與個人化系統的影響
★ 性別差異與認知風格對合作化遊戲式學習的影響	★ 探討認知風格如何影響使用者在行動載具下使用電子期刊
★ 毒品經驗與遊戲先備知識對客製化與個人化遊戲式反毒宣導系統的影響	★ 探討背景音樂和認知風格對遊戲式學習的影響
★ 以多媒體科技和數位遊戲為小小人兒及患者家屬發展線上生活百科	★ 先備知識對註記式多媒體電子書的影響研究：從個別環境到分享環境
★ 從認知風格的角度探討提示對學習英文片語與文法的影響	★ 探討先備知識對學習者在使用鷹架英文學習系統的影響: 限制與扣分機制
★ 發展動畫電子書之研究：從性別差異到性別均等之歷程	★ 探討認知風格於數位遊戲式英語學習環境對遊戲行為與學習成效之影響

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 ( 永不開放)

摘要(中)

近幾年來，遊戲式學習系統擁有了許多優點並且在教育環境中逐漸流行。然而，研究亦指出遊戲式學習系統的介面可用性存在一些問題，例如:遊戲式學習系統為了提高視覺效果而使用大量的遊戲元素導致遊戲介面變得更複雜，而複雜的介面則會讓使用者產生額外的負擔，進而造成使用者的負面觀感增加，因此，有必要考慮介面的可用性，以降低學習者的負面觀感。介面的可用性被廣泛地應用在系統設計中，主要之目的是滿足使用者的需求，以讓使用者操作系統。而可用性評估又分成專家評估和使用者測試，在眾多專家評估的方法中，尼爾森評估扮演了一個重要的角色，此評估方式涵蓋了較廣泛的評估面向，且能夠快速且有效地找到可用性問題，另一方面，使用者測試是一個新手的評估方式，雖不具備可用性的專業知識，亦可以經由自身經驗進行評估，因此，若能結合尼爾森評估與使用者測試進行系統評估，將可透過各自的優點來彌補相互的缺失，故能有效的找出問題，進而將系統設計的更完善。

因此，本研究進行了兩個實驗，在實驗一中，本研究開發了一個遊戲式學習系統探討專家和新手對於可用性評估的觀感差異。其結果指出，專家和新手在G3 (圖像/情節)、G4 (音樂/聲音)、H1 (系統狀態可見性)、H7 (靈活性與使用效率)與H9(幫助用戶認識、偵錯並從錯誤中恢復)有不同的觀感，以H1為例，新手僅需要遊戲結束後給予相對應的回饋機制，而專家則在遊戲開始與結束都需要給予相對應的回饋機制，以便更全面地了解整個遊戲內容發生的情況。這些結果將被用於實驗二中修改遊戲式學習系統，並更進一步探討專家和新手對於修改後的遊戲式學習系統有何不同的觀感。其結果顯示，專家和新手在G1 (規則)、G3、H7、H9與H10 (幫助與說明文件)有不同的觀感，以H9為例，以圖片搭配文字的返回按鈕設計能滿足新手的使用需求，然而，此種返回按鈕的設計對於專家而言是不夠的，專家需要音樂、音效與動畫等額外呈現方式來滿足使用需求，另一方面，在可用性問題的部分專家與新手在H1與H7的可用性問題在實驗二中已改善，這代表著修改後的遊戲式學習系統能夠有效的改善可用性問題。

最後，本研究綜合整理實驗一與實驗二的結果，而建立了一套遊戲式學習系統的設計準則，此設計準則不僅可以幫助遊戲設計者開發完善的遊戲式學習系統，亦可使遊戲式學習系統能滿足不同使用者的需求。

摘要(英)

In recent years, game-based learning systems have been very popular in educational settings. This is due to the fact that game-based learning systems provide many benefits which can support students learning. However, previous research also indicated that the interface of game-based learning systems may cause some problems. For example, game-based learning systems use a lot of game elements, which increase the complexity of user interface. The complex interface would increase the learners’ additional loads so that the learners would show the negative perceptions. Thus, there is a need to consider the usability of a user interface so that learners’ negative perceptions can be reduced. The usability refers to making systems easier to use, and matching them more closely to user needs and requirements. On the other hand, usability evaluation methods are divided into expert evaluations and user testing. Among various expert evaluations, Nielsen’s heuristics are widely applied to examine usability problems because they can rapidly and inexpensively identify usability problems. On the other hand, user testing can be conducted by novices, who do not understand Nielsen’s heuristics and find usability problems based on their past experience. In brief, both expert evaluation and user testing are complementary to each other so they should be considered together. By doing so, usability problems can be effectively identified.

Therefore, the research presented in this dissertation conducted two empirical studies. In Study One, a game-based learning system was developed to investigate the perceptions of experts and novices. The results of Study One demonstrated that experts and novices have different perceptions in G3 (Representation/Story), G4 (Music/Sound), H1 (Visibility of system Status), H7 (Flexibility and efficiency of use) and H9 (Help users recognise, diagnose and recover from errors). For instances, the results from H1 indicated that novices only pay attention to the final outcomes. Conversely, experts are not only concerned with the final outcomes, but also require detailed descriptions before they started to play the game-based learning system. On the other hand, the results from Study Two suggested that experts and novices have different perceptions in G1 (Rules), G3, H7, H9 and H10 (Help and documentation). For example, the results from H9 indicated that the “undo” button designed with both text and graphics can satisfy novices’ needs. Conversely, experts thought that there is also a need to use additional ways to highlight the “undo” button, such as voice, music and animation. On the other hand, experts and novices were satisfied with the design of the revised game-based learning system because usability problems in H1 and H7 are removed. In other words, the revised game-based learning system was better than the original game-based learning system.

Finally, design guidelines are proposed. This design guideline can be applied to support designers to develop the effectiveness of game-based learning system so that users needs and requirements can be satisfied.

關鍵字(中)

★ 遊戲式學習系統
★ 尼爾森評估
★ 使用者測試
★ 設計準則

關鍵字(英)

★ game-based learning system
★ Nielsen’s Heuristic
★ user testing
★ design guidelines

論文目次

摘要 i
ABSTRACT iii
Table of Contents v
List of Figures viii
List of Tables x
Chapter 1 Introduction 1
1.1 Background 1
1.2 Chapter Outline 4
1.3 Summary 5
Chapter 2 Literature Review 7
2.1 Game-based Learning 7
2.2 Usability 9
2.3 Prior knowledge 11
2.4 Summary 12
Chapter 3 Research Design 13
3.1 Introduction 13
3.2 Overview of the Research Design 13
3.3 Research Instruments 14
3.3.1 Game-based learning system 14
3.3.2 Task Sheet 23
3.3.3 Questionnaires 23
3.4 Data Analysis 32
3.5 Summary 32
Chapter 4 Study One: To revise the game-based learning system 33
4.1 The Game-Based Learning System in Study One 33
4.2 Empirical Study 33
4.2.1 Participants 33
4.2.2 Experimental Procedures 33
4.2.3 Data Analyses 34
4.3 Results and Discussions 35
4.3.1 The results from quantitative measurement 35
4.3.2 The results from qualitative assessment 36
4.4 Summary 41
Chapter 5 Study Two: To develop design guidelines 45
5.1 The Game-Based Learning System in Study Two 45
5.1.1 The first quest 49
5.1.2 The second quest 53
5.1.3 The third quest 56
5.1.4 The fourth quest 58
5.2 Empirical Study 62
5.2.1 Participants 62
5.2.2 Experimental Procedures 62
5.2.3 Data Analyses 63
5.3 Results and Discussions 64
5.3.1 The results from quantitative measurement 64
5.3.2 The results from qualitative assessment 68
5.4 Summary 72
Chapter 6 Conclusions 73
6.1 Main conclusions 73
6.2 Contributions 74
6.3 Limitations and Future Work 82
References 83

參考文獻

[1] Burguillo, J. C. (2010). Using game theory and competition-based learning to stimulate student motivation and performance. Computers & Education, 55(2), 566-575.
[2] Björklund, T. A. (2013). Initial mental representations of design problems: Differences between experts and novices. Design Studies, 34(2), 135-160.
[3] Chen, S. (2002). A cognitive model for non–linear learning in hypermedia programmes. British journal of educational technology, 33(4), 449-460.
[4] Chen, S. Y., & Paul, R. J. (2003). Editorial: Individual differences in web‐based instruction–an overview. British Journal of Educational Technology, 34(4), 385-392.
[5] Clarke, T., Ayres, P., & Sweller, J. (2005). The impact of sequencing and prior knowledge on learning mathematics through spreadsheet applications. Educational Technology Research and Development, 53(3), 15-24.
[6] Chen, S. Y., & Macredie, R. D. (2005). The assessment of usability of electronic shopping: A heuristic evaluation. International journal of information management, 25(6), 516-532.
[7] Chen, S. Y., Fan, J. P., & Macredie, R. D. (2006). Navigation in hypermedia learning systems: experts vs. novices. Computers in Human Behavior, 22(2), 251-266.
[8] Clewley, N., Chen, S. Y., & Liu, X. (2009). Cognitive styles and web-based instruction: field dependent/independent vs. Holists/Serialist. In Proceedings of International conference of IEEE systems, man, and cybernetics 2009.
[9] Cheng, C. H., & Su, C. H. (2012). A Game-based learning system for improving student′s learning effectiveness in system analysis course. Procedia-Social and Behavioral Sciences, 31, 669-675.
[10] Dickey, M. D. (2011). Murder on Grimm Isle: The impact of game narrative design in an educational game‐based learning environment. British Journal of Educational Technology, 42(3), 456-469.
[11] Doty, J., Doty, M., & Dworkin, J. (2011). Web-based family life education: Spotlight on user experience. Journal of Extension, 49(6).
[12] Fullerton, K. (2000). The interactive effects of field dependence-independence and Internet document manipulation style on student achievement from computer-based Instruction. Unpublished doctoral dissertation, University of Pittsburgh.
[13] Ghinea, G., & Chen, S. Y. (2003). The impact of cognitive styles on perceptual distributed multimedia quality. British Journal of Educational Technology, 34(4), 393-406.
[14] Gillispie, L., Martin, F., & Parker, M. (2009). Effects of the dimension-M 3D video gaming experience on middle school student achievement and attitude in mathematics. In Society for Information Technology & Teacher Education International Conference, 2009(1), 1462-1469.
[15] González, M., Masip, L., Granollers, A., & Oliva, M. (2009). Quantitative analysis in a heuristic evaluation experiment. Advances in Engineering Software, 40(12), 1271-1278.
[16] Granić, A., Mitrović, I., & Marangunić, N. (2011). Exploring the usability of web portals: A Croatian case study. International Journal of Information Management, 31(4), 339-349.
[17] Hong, J. C., & Liu, M. C. (2003). A study on thinking strategy between experts and novices of computer games. Computers in Human Behavior, 19(2), 245-258.
[18] Hickey, D. T., Ingram-Goble, A. A., & Jameson, E. M. (2009). Designing assessments and assessing designs in virtual educational environments. Journal of Science Education and Technology, 18(2), 187-208.
[19] Hsieh, C. W., Chen, H. X., Hsu, Y. C., & Chen, S. Y. (2011). The Usability Assessment of Web-Based Learning Systems. In HCI International 2011–Posters’ Extended Abstracts, 151-155. Springer Berlin Heidelberg.
[20] Hwang, G. J., Wu, P. H., & Chen, C. C. (2012). An online game approach for improving students’ learning performance in web-based problem-solving activities. Computers & Education, 59(4), 1246-1256.
[21] Hung, P. H., Hwang, G. J., Lee, Y. H., & Su, I. (2012). A cognitive component analysis approach for developing game-based spatial learning tools. Computers & Education, 59(2), 762-773.
[22] Ivory, M. Y., & Megraw, R. (2005). Evolution of web site design patterns. ACM Transactions on Information Systems (TOIS), 23(4), 463-497.
[23] Kalyuga, S., Chandler, P., & Sweller, J. (2001). Learner experience and efficiency of instructional guidance. Educational Psychology, 21(1), 5-23.
[24] Kang, B., & Tan, S. (2008). Impact of digital games on intrinsic and extrinsic motivation, achievement, and satisfaction. In Society for Information Technology & Teacher Education International Conference, 2008(1), 1825-1832.
[25] Kazimoglu, C., Kiernan, M., Bacon, L., & MacKinnon, L. (2012). Learning programming at the computational thinking level via digital game-play. Procedia Computer Science, 9, 522-531.
[26] Lee, Koo-Chul, & Lee, Julian. (2007). Programming physics softwares in Flash. Computer physics communications, 177(1), 195-198.
[27] Liu, T. Y., & Chu, Y. L. (2010). Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation. Computers & Education, 55(2), 630-643.
[28] Liu, E. Z. F., & Chen, P. K. (2013). The Effect of Game-Based Learning on Students’ Learning Performance in Science Learning–A Case of “Conveyance Go”. Procedia-Social and Behavioral Sciences, 103, 1044-1051.
[29] Michailidou, E., Harper, S., & Bechhofer, S. (2008). Visual complexity and aesthetic perception of web pages. In Proceedings of the 26th annual ACM international conference on Design of communication, 215-224. ACM.
[30] Norman, D. A. (1983). Design principles for human-computer interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 1-10. ACM.
[31] Nielsen, J., & Molich, R. (1990). Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems, 249-256. ACM.
[32] Nielsen, J. (1994). Usability inspection methods. In Conference companion on Human factors in computing systems, 413-414. ACM.
[33] Orvis, K. A., Horn, D. B., & Belanich, J. (2008). The roles of task difficulty and prior videogame experience on performance and motivation in instructional videogames. Computers in Human Behavior, 24 (5), 2415-2433.
[34] Prensky, M. (2003). Digital game-based learning. Computers in Entertainment (CIE), 1(1), 21-21.
[35] Papastergiou, M. (2009). Digital game-based learning in high school computer science education: Impact on educational effectiveness and student motivation. Computers & Education, 52(1), 1-12.
[36] Petrie, H., & Power, C. (2012). What Do Users Really Care About? A Comparison of Usability Problems Found by Users and Experts on Highly Interactive Websites. CHI ′12 Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, 2107-2116.
[37] Spyridakis, J. H. & Isakson C.S. (1991) Hypertext: a new tool and its effect on audience comprehension. IEEE-IPCC, 91, 37-44.
[38] Shneiderman, B. (1992). Designing the user interface: strategies for effective human-computer interaction, 2. Reading, MA: Addison-Wesley.
[39] Stephen, P. & Hornby, S. (1997). Simple Statistics for Library and Information Professionals. London: Library Association.
[40] Sutherland, L. (2002). Developing problem solving expertise: the impact of instruction in a question analysis strategy. Learning and Instruction, 12(2), 155-187.
[41] Scanlon, E. (2000). How gender influences learners working collaboratively with science simulations. Learning and Instruction. 10, 463-481.
[42] Swink, S. (2009). Game feel: a game designer′s guide to virtual sensation. US: Taylor & Francis.
[43] Tabatabai, D., & Shore, B. M. (2005). How experts and novices search the web. Library and Information Science Research, 27, 222-248.
[44] Tan, W. S., Liu, D., & Bishu, R. (2009). Web evaluation: Heuristic evaluation vs. user testing. International Journal of Industrial Ergonomics, 39(4), 621-627.
[45] Tüzün, H., Yılmaz-Soylu, M., Karakuş, T., İnal, Y., & Kızılkaya, G. (2009). The effects of computer games on primary school students’ achievement and motivation in geography learning. Computers & Education, 52(1), 68-77.
[46] Vos, N., van der Meijden, H., & Denessen, E. (2011). Effects of constructing versus playing an educational game on student motivation and deep learning strategy use. Computers & Education, 56(1), 127-137.
[47] Wang, T. H. (2008). Web-based quiz-game-like formative assessment: Development and evaluation. Computers & Education, 51(3), 1247-1263.
[48] Wrzesien, M., & Alcañiz Raya, M. (2010). Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project. Computers & Education, 55(1), 178-187.
[49] Wang, P. Y., Vaughn, B. K., & Liu, M. (2011). The impact of animation interactivity on novices’ learning of introductory statistics. Computers & Education, 56(1), 300-311.
[50] Zou, J., Liu, Q., & Yang, Z. (2012). Development of a Moodle course for schoolchildren’s table tennis learning based on Competence Motivation Theory: Its effectiveness in comparison to traditional training method. Computers & Education, 59(2), 294-303.

指導教授

陳攸華(Sherry Y. Chen)

審核日期

2014-11-11

推文