A Precise Mouse Path Navigation Applied to Capture/Replay Test Automation System for GUI Applications

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：18

、訪客IP：3.145.88.130

姓名

方琮貿(Tsung-Mao Fang) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

(A Precise Mouse Path Navigation Applied to Capture/Replay Test Automation System for GUI Applications)

相關論文

★ 使用PolyTraceAid進行程式文件覆蓋率計算與分群	★ Support Visual Debugging in Electronic Design Automation Software by xDIVA
★ 設計與實作視覺化追蹤點以支援xDIVA進行程式動畫	★ Combine Internal Test Oracles and Capture/Replay GUI Testing for Precise Replay and Higher Validation Power
★ Dissimilarity of Polymorphic Execution Sequences	★ The Analysis of Capturing System Test Cases into Unit Test Cases
★ 動態延遲載入的測試覆蓋率	★ 建構於JMeter之自動化分散式壓力測試架構
★ 模組化因修改具耦合的程式碼所伴隨的成本漣漪	★ Design a Pluggable Architecture for Layout Algorithms in xDIVA
★ 重複性程式碼檢測之外掛模組設計	★ Visual Perception of Realistic Rendering in xDiva 3D Environment
★ Why and When GUI Test Automation Fails in Practice and Our Solutions to The Problem	★ Why and When GUI Test Automation Fails in Practice and Our Solutions to The Problem
★ Very High Precision Optical Character Recognition For Clean-Fixed-Sized True Type Characters	★ Enhance Korat by Branch Capability in Capture/Replay User Scenario to Industrial Test Case Automation

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

軟體產品開發的過程中，通常會使用回歸測試（regression testing）確保釋出的新版本品質。因為回歸測試的過程通常繁複且耗費資源，所以許多測試工具致力於讓整個測試流程自動化。其中應用最為廣泛的方法為Capture/Replay（CR）Approach，只需要一點程式技能就能產生測試案例。過去我們開發出了一套能夠獨立於待測系統（System Under Test，SUT）並且與測試平台無關的自動化測試系統KORAT，但是僅支援鍵盤訊號的錄製與播放，目前應用於非GUI的環境中。
為了增加KORAT測試的能力，在本篇論文我們探討KORAT支援滑鼠設備的方法，讓KORAT也能夠應用於GUI輸入的錄製與重播中。市面上已知的測試工具[1-3]，當使用到滑鼠操作時，通常會因為probe effect，讓錄製以及播放的滑鼠路徑不一致。甚至這些工具根本不提供滑鼠路徑的紀錄。因為KORAT直接錄製與播放滑鼠原始訊號的關係，巧妙的避開probe effect，所以能夠精確的錄製與播放滑鼠訊號。在本研究中整合了一套軟硬體環境，透過STM32F4 DISCOVERY微控制器工程模板，來接收、處理、模擬滑鼠原始訊號。並且我們利用進階的影像處理技術，開發出導航模式，在GUI元件可能變動的情況下，KORAT也能夠引導滑鼠到正確的事件觸發點上。另外，KORAT也設計出追蹤模式，保留滑鼠的原始訊號，精確的紀錄滑鼠的移動路徑。
經實驗結果證實，本研究設計出來的軟硬體環境，用來錄製與重播滑鼠原始訊號，的確能夠精確的紀錄、播放滑鼠的移動路徑。克服過往CR工具都普遍困擾的probe effect。並設計出導航機制以及追蹤模式，幫助測試者錄製以及播放更複雜的滑鼠動作，使之能夠應用於GUI環境的自動化測試上。

摘要(英)

In software development, regression testing is used for ensuring that the quality of new version software is not damaged by the changes. Since regression testing is repetitive, tedious, and time consuming, different approaches have been proposed to automate the task. One popular approach is the Capture/Replay (CR) technique which requires little programming skills to create the tests. In the past, we have developed a testing automation tool called KORAT. It is isolated from system under test（SUT）and allows testing the applications from different platforms. KORAT only supports keyboard device for capturing and replaying. It can be applied to non-GUI testing for now.
To extend KORAT′s testing capability, supporting mouse device is studied in this thesis. Existing CR tools often suffers from the probe effect problem, which causes imprecise mouse path in replay runs. Because KORAT captures and replay hardware mouse signal, the probe effect is kept to minimum. Precise mouse path replay can be achieved in a much more promising way. In this paper, we integrate the necessary software and hardware components for KORAT. KORAT can intercept and emulate mouse signals by a microcontroller unit（MCU）named STM32F4 DISCOVERY. And then, we implement a navigation mode using advanced image recognition technique to navigate the mouse by image analysis. It can help KORAT navigate the mouse to a correct event point, even if location of GUI components changed. KORAT also provides track mode which can keeps the mouse signals for recording the mouse path precisely.
Our experiments indicate that our design and implementation can record and replay mouse signals precisely. KORAT overcomes the probe effect problem which cannot be achieved by existing testing tools.

關鍵字(中)

★ 回歸測試
★ 測試自動化
★ 滑鼠導航

關鍵字(英)

★ Capture/Replay tools

論文目次

目錄
一、緒論 1
二、研究背景 3
2-1 Capture and Replay 3
2-1-1 Non-Intrusive Capture-and-Replay 5
2-1-2 Intrusive Capture-and-Replay 5
2-2 Probe Effect 7
2-3 Test Automation Tools 9
2-3-1 KORAT 9
2-3-2 Sikuli 11
2-3-3 T-Plan Robot 14
2-3-4 eggPlant 17
三、 Hardware Environment 19
3-1 滑鼠訊號資料流 20
3-2 滑鼠訊號傳遞延遲 20
3-3 STM32F4 Discovery 22
3-4 Open407V-D 23
3-5 Host Emulator 24
3-6 Device Emulator 26
3-7 Video Capture Card 28
四、 Software Environment 29
4-1 滑鼠訊號轉換模組 29
4-2 偵測滑鼠座標 29
4-3 滑鼠事件定義 31
4-4 追蹤模式 33
4-5 導航機制 34
4-5-1 圖像錨點 36
五、實驗結果與評估 38
5-1 實驗目的與方法 38
5-2 起點和終點結果探討 39
5-3 錄製以及播放過程結果探討 40
5-3-1 實驗方式一 40
5-3-2 實驗方式二 44
5-4 工具評估 48
六、結論 51
七、參考文獻 52

參考文獻

[1] T.-H. C. T. Yeh, and R. C. Miller, "Sikuli: Using GUI Screenshots for Search and Automation," ACM New York, NY, USA ©2009, 2009, pp. 183-192.
[2] T.-P. R. Enterprise. "T-PLAN ROBOT," 7th of April, 2015; http://www.t-plan.com/robot/.
[3] eggPlant. "eggPlant Tools For Software Application Testing by TestPlant," 0412, 2015.
[4] H. H. Raphael Pham, Kurt Schneider, “Beyond plain video recording of GUI tests: Linking test case instructions with visual response documentation,” in Automation of Software Test (AST), International Workshop, Zurich, 2012, pp. 103 - 109.
[5] J. R. H. W. Eric Wong, Saul London, Hira Agrawal, "A study of effective regression testing in practice." pp. 264-274.
[6] Microsoft. "Hooks," 30th of April, 2015; https://msdn.microsoft.com/en-us/library/windows/desktop/ms632589(v=vs.85).aspx.
[7] D. X. Omar El Ariss, Santosh Dandey, Brad Vender, Phil McClean, and Brian Slator, "A Systematic Capture and Replay Strategy for Testing Complex GUI based Java Applications." pp. 1038-1043.
[8] P. C. John Steven, Bob Fleck, Andy Podgurski, "jRapture: A Capture/Replay Tool for Observation-Based Testing." pp. 158-167.
[9] K. D. B. Michiel Ronsse, “RecPlay: a fully integrated practical record/replay system,” ACM Transactions on Computer Systems (TOCS), vol. 17, no. 2, pp. 133-152 1999.
[10] Microsoft. "Verifying Code by Using UI Automation," 7th of April, 2015; https://msdn.microsoft.com/en-us/library/dd286726.aspx.
[11] Y.-P. C. Chien-Hsin Hsueh, Wei-Cheng Pan, “Intrusive Test Automation with Failed Test Case Clustering,” in Software Engineering Conference (APSEC), Ho Chi Minh, 2011, pp. 89 - 96.
[12] W.-C. Pan, “Combine Internal Test Oracles and Capture/Replay GUI Testing for Precise Replay and Higher Validation Power,” Computer Science & Information Engineering, Natoinal Central Univercity, Natoinal Central Univercity, 2013.
[13] Wikipedia. "Probe effect," 10th of April, 2015; http://en.wikipedia.org/wiki/Probe_effect.
[14] A. A. Milan Jovic, Dmitrijs Zaparanuks, Matthias Hauswirth, "Automating performance testing of interactive Java applications."
[15] X.-C. Chen, “Korat: An O.S.-independent Capture/Replay Test Automation System,” Computer Science & Information Engineering, Natoinal Central Univercity, Natoinal Central Univercity, 2014.
[16] Q. S.-F. Tristan Richardson, Kenneth R. Wood and Andy Hopper, “Virtual Network Computing,” IEEE Internet Computing, vol. 2, no. 1, pp. 33-38, 1998.
[17] A. T. L. Cambridge. "Virtual Network Computing," 20th of April, 2015; http://www.hep.phy.cam.ac.uk/vnc_docs/winvnc.html.
[18] STMicroelectronics. "STM32F4Discovery - STMicroelectronics," 11/17, 2014; http://www.st.com/web/catalog/tools/FM116/SC959/SS1532/PF252419.
[19] S. F. Discovery. "All STM32F4 libraries - STM32F4 Discovery," 0120, 2015; http://stm32f4-discovery.com/2014/05/all-stm32f429-libraries-at-one-place/.
[20] ADLINK. "PCIe-HDV62, HDTV Frame Grabber / HDMI Video Capture Card(formerly HDV62)," 20th of June; http://www.adlinktech.com/PD/web/PD_detail.php?cKind=&pid=1358&seq=&id=&sid=.
[21] D. H. Ballard, “Generalizing the hough transform to detect arbitrary shapes,” vol. 13, pp. 111-122, 1981.

指導教授

鄭永斌(Yung-Pin Cheng)

審核日期

2015-7-29

推文