GUI Component Detection for Cross-Platform Applications–Using Input Device and Image Change Synergistic Detection Method

NCU Institutional Repository > 資訊電機學院 > 軟體工程研究所 > 博碩士論文 > Item 987654321/83778

jsp.display-item.identifier=請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/83778

题名:	GUI Component Detection for Cross-Platform Applications–Using Input Device and Image Change Synergistic Detection Method
作者:	黃聖傑;Huang, Sheng-Chieh
贡献者:	軟體工程研究所
关键词:	GUI自動化測試;測試案例自動產生;GUI模型;GUI元件偵測;圖形化使用者介面;GUI automated testing;test case generation;GUI model;GUI component detection;GUI;Graphic User Interface
日期:	2020-07-15
上传时间:	2020-09-02 17:05:01 (UTC+8)
出版者:	國立中央大學
摘要:	在軟體工程領域，為了維持軟體的品質，「軟體測試」便是一門很重要的課題。軟體測試領域發展至今，回歸測試用來確保既有的功能不受系統修改與維護的影響。回歸測試自動化軟體技術相對成熟且種類多樣也實用化。但目前對於「測試案例自動產生」的實務應用目前仍然有很多實務上的困難。「GUI模型」的建立是目前針對GUI自動化測試的一項前置作業，如果能夠準確且快速的建立待測系統(如應用程式、網頁…等)的GUI模型，便能以GUI模型為基礎來達成測試案例產生的工作。目前對於GUI模型的建立，大多都是針對特定平台或環境進行逆向工程式解構，或將程式的原始碼進行分析，以及使用開發框架提供的API進行GUI元件(或稱控制項)的提取及操作，這些方法的準確度雖然高但相對地對平台的依存度以及平台的開發知識也非常的高，而且往往要努力跟上該平台的底層升級。例如針對網頁開發的技術，就無法適用於Windows或是 Linux。更不用提手機的各式平台。本論文將針對偵測待測系統的GUI元件提出新的方法，該方法將透過影像處理並與基本的通用輸入裝置進行協同識別，以偵測GUI元件；此方法具有高度與平台無關，並且無懼於平台的底層技術升級的特性。 ;In the field of software engineering, software testing is an important and major method to ensure software quality. In practical software testing, regression testing software tools have matured and varied. Regression test automation is to make sure that the system features that function correctly are not affected by software changes. On the other hand, “automated test case generation” remains to be very difficult in practice. The construction of the “GUI Model” is an important step toward GUI test case generation. If we can construct the GUI model of the system under test (such as application, webpage, etc.) accurately and quickly, it can be used to achieve GUI test case generation. Most attempts to construct the GUI model are done by reverse engineering the program on specific platform, environment, or even analyzing the source code of the program when there is poor support from platforms. In some modern platforms, they can use the API provided by the platforms to extract and operate GUI components (called “control-items”). However, these approaches introduce very high dependency and coupling to the underlying platform and the results are not applicable to another platform. For example, approaches that aim for web technology are not applicable to Windows or Linux. This paper proposes a new method for GUI component detection of the system under test using image processing and basic universal input devices. It is totally platform-independent. Finally, we will use this method to test different types of system under test to verify and evaluate the feasibility of the method.
显示于类别:	[軟體工程研究所 ] 博碩士論文

文件中的档案:

档案	描述	大小	格式	浏览次数
index.html		0Kb	HTML	215	检视/开启

在NCUIR中所有的数据项都受到原著作权保护.

社群 sharing

数据加载中.....