迴歸測試中測試用例非覆蓋率優先級技術研究-以A公司行動裝置產品開發為例

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：123

、訪客IP：3.145.74.215

姓名

張志堅(Chih-Chien Chang) 查詢紙本館藏

畢業系所

資訊管理學系在職專班

論文名稱

迴歸測試中測試用例非覆蓋率優先級技術研究-以A公司行動裝置產品開發為例
(A Study of Test Case Prioritization for Regression Testing: The Case of Software Testing of Mobile Devices)

相關論文

★ 影響ERP導入過程及成效因素之研究 - 單一公司兩次導入SAP系統之比較分析	★ 運用資料倉儲技術建置物力動員資訊系統之開發
★ 買方採用自有電子市集之個案研究─以台塑企業為例	★ DEA模型評估經營效率之研究—以某綜合證券商為例
★ 尋求卓越：中小企業資訊部門的管理之個案研究	★ 「證券商共同網路交易平台」之可行性分析
★ 產業競合模式策略探討－以自行車產業為例	★ RFID導入航空貨運站出口作業流程應用之研究
★ 綠色供應鏈活動建構之個案研究-以筆記型電腦製造業為例	★ 導入資訊科技服務管理之評估-以遠東銀行為例
★ 資訊系統導入歷程中專案團隊決策衝突之探討	★ 應用資源基礎理論探討持久競爭優勢-以智慧型手機H公司為例
★ 服務導向架構為基礎的企業流程管理之探討 - 以瀚宇博德股份有限公司為例	★ 沙賓法案實施與企業遵循個案研究--以K公司為例
★ 資訊服務委外之個案分析－以銀行簡訊為例	★ 有線電視業者經營IPTV之競爭優勢分析—以個案公司為例

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

迴歸測試是軟體演化過程中頻繁進行的且開銷巨大的一項任務，為了減少迴歸測試的成本，可以使用測試用例優先級技術。測試用例優先級技術是一種高效實用的迴歸測試技術，目的是提高迴歸測試的效率。Qu et al. (2009) 對優先級技術的研究指出，優先級技術大體可以分為覆蓋率相關技術和其它非覆蓋率技術。部分文獻考慮非覆蓋率特徵對測試用例重要程度的影響做出相關的研究，例如測試用例運行時間、測試用例對需求的滿足情況等，但是對一些存在的問題，例如，怎樣將各種影響測試用例的重要特徵進行綜合考慮、新的軟體工程方法是否帶來其它影響優先級的特徵等，已有的研究成果還不能很好的回答。
行動裝置的系統測試是一種基於規格說明，不要求考察程式碼，以使用者的觀點進行測試，又稱為功能測試或黑箱測試，測試用例設計的本質上適用於非覆蓋率的方法。本研究針對Qu等人所提出非覆蓋率技術怎樣將各種影響測試用例的重要特徵進行綜合考慮這一問題上，提出一個可以在實務上利用的模型。
研究結果發現重要特徵與公司管理的相關性，並且將特徵分為兩類，一類的特徵與公司的規範有關，另一類的特徵與公司效率有關。進一步的分析發現，與公司效率有關的特徵在模型裡面出現模糊的徵狀，本研究的模型利用了模糊的特性積極的提高了優先級偵錯的效率。此外本研究也發現，用時間考慮錯誤的價值比起用比例考慮錯誤的價值更為恰當。

摘要(英)

Software testing is a strenuous and expensive process. In order to reduce the cost of regression-testing activities, we can adopt test case prioritization techniques (TCP). Test case prioritization is an effective and practical technique applied in regression testing. In a survey of test case prioritization for regression testing, Qu et al. (2009) indicate the current techniques can be divided into code coverage-based (statement, branch or other coverage) and non-coverage-based. Some studies have considered the importance of characteristics of non-coverage-based for testing cases in test case run time and fulfillment of test case requirements. But for the problems such as how to consider the combined effects of various characteristics on testing cases, the existing research has not been able to provide a good answer.
System testing for mobile devices is based on the system specification without inspecting the code, tested from the user’s point of view, which is also known as functional testing. The design and analysis of test cases is suitable for the non-coverage-based techniques. This study focuses on applying the non-coverage-based technology to comprehensively examine how important the characteristics of the test case affecting testing results. The results of the study should provide a model useful for software testing practice.
In the study, we found the relationship between these important characteristics and management of company. We divided these characteristics into two types, one type belongs to the specification of company, and the other type belongs to enficiency of company. To further analysis, we found the characteristics belong to the type of enficiency of company that show fuzzy symptoms, we use these sympotoms to importve our model. Besides, we also found it is more appropriate to consider the fault detection capabilities of test cases with the time value of fault than with the ration of fault.

關鍵字(中)

★ 測試用例優先級技術
★ 迴歸測試
★ 軟體測試
★ 行動裝置

關鍵字(英)

★ Test Case Prioritization
★ Regression Testing
★ Software Testing
★ Mobile Devices

論文目次

目錄
摘要 I
Abstract II
誌謝 III
目錄 IV
圖目錄 VI
表目錄 VII
第一章緒論 1
1.1 研究背景 1
1.2 研究動機 2
1.3 研究目的 3
第二章文獻探討 4
2.1 產品開發 4
2.2 迴歸測試相關技術 7
2.3 測試用例優先級技術與相關研究 11
第三章研究方法 15
3.1 研究方法 15
3.2 研究流程 15
3.3 研究對象 16
第四章個案分析 17
4.1 個案公司介紹 17
4.2 行動裝置開發流程資料的確認 21
4.3 行動裝置軟體測試流程資料的確認 27
4.4 行動裝置軟體測試系統資料的確認 31
4.5 資料的定義 38
4.6 資料的整理及轉換 43
4.7 建立模型 45
4.8 評估結果 65
第五章結論 89
5.1 研究結論 90
5.2 研究限制 92
5.3 未來研究方向 92
參考文獻 93
附錄一：消費者對行動裝置滿意面向與解決方案分析 98
附錄二：行動裝置軟體開發與試產階段主要測試流程分析 99
附錄三：行動裝置軟體測試結果判定標準分析 100
附錄四：行動裝置軟體開發特徵代碼表 101
附錄五：測試任務C特徵資料 102
附錄六：測試任務D特徵資料 104
附錄七：測試任務C數字型特徵原始分數 106
附錄八：測試任務C數字型特徵標準分數 107
附錄九：測試任務C分類型特徵原始分數 108
附錄十：測試任務C分類型特徵標準分數(一) 110
附錄十一：測試任務C分類型特徵標準分數(二) 111
附錄十二：測試任務C綜合特徵分數(一) 112
附錄十三：測試任務C特徵weka分析執行結果 113
附錄十四：測試任務C綜合特徵分數(二) 115
附錄十五：測試任務C綜合特徵分數(三) 116
附錄十六：測試任務C綜合特徵分數(四) 117
附錄十七：初步模型優先級獲利結果 118
附錄十八：模型第一次修正優先級獲利結果 119
附錄十九：模型第二次修正優先級獲利結果 120
附錄二十：20次測試任務特徵資訊獲利結果 121
附錄二十一：專案B各測試套件投入資源 123

圖目錄
圖 4-1 行動裝置開啟應用程式當機比例分析直條圖 19
圖 4-2 行動裝置開發組織架構圖 20
圖 4-3 行動裝置開發流程與產品生命週期管理關係圖 22
圖 4-4 行動裝置軟體測試系統流程圖 31
圖 4-5 測試套件與測試用例關係圖 34
圖 4-6 行動裝置軟體錯誤追蹤流程圖 36
圖 4-7 優先級效度函數示例圖 47
圖 4-8 測試工程師執行測試優先級獲利趨勢圖 66
圖 4-9 初步模型的優先級獲利趨勢圖 68
圖 4-10 初步模型優先級獲利箱型圖 69
圖 4-11 模型第一次修正分類型特徵反轉優先級獲利比較趨勢圖 72
圖 4-12 模型第一次修正錯誤時間價值優先級獲利比較趨勢圖 73
圖 4-13 模型第一次修正優先級獲利比較箱型圖 74
圖 4-14 模型第二次修正優先級獲利趨勢圖 76
圖 4-15 模型第二次修正優先級獲利箱型圖 77
圖 4-16 錯誤時間價值與錯誤比例優先級獲利比較趨勢圖 78
圖 4-17 數字型－工程師填入特徵資訊獲利趨勢圖 80
圖 4-18 數字型－系統計算特徵資訊獲利趨勢圖 81
圖 4-19 分類型－工程師填入與工程師填入後系統計算特徵資訊獲利趨勢圖 83
圖 4-20 分類型－編輯人員填寫特徵資訊獲利趨勢圖 84
圖 4-21 第八次與第16次測試任務資訊獲利比較趨勢圖 86

表目錄
表 2‑1 迴歸測試主要技術效益比較表 10
表 4‑1 特徵評估分類表 79

參考文獻

Amland, S., 1999, “Risk Based Testing and Metrics,” EuroSTAR Conference, Barcelona, Spain, pp. 1-20.
Basili, V., L. Briand and W. L. Melo, 1996, “A Validation of Object-Oriented Design Metrics as Quality Indicators,” IEEE Transactions on Software Engineering, vol. 22 (10) , pp. 751-761.
Beizer, B., 1990, Software Testing Techniques, Van Nostrand Reinhold, NY.
Binder, R. V., 2000, Testing Object Oriented Systems, Addison Wesley, Masschusetts.
Boehm, B. and L. Huang, 2003, “Value-Based Software Engineering: A Case Study,” IEEE Computer Society, vol. 36 (3) , pp. 33-41.
Boehm, B. W., 1981, Software Engineering Economics, Englewood Cliffs: Prentice-Hall, Inc., NJ.
Booz-Allen & Hamilton Inc., 1982, New Products Management for the 1980s, Booz-Allen & Hamilton Inc., NY.
Bouckaert, R. R., E. Frank, M. Hall, R. Kirkby, P. Reutemann, A. Seewald and D. Scuse, 2010, “Weka Manual for Version 3-6-2,” University of Waikato, New Zealand.
Bryce, R. C., A. M. Memon, 2007, “Test Suite Prioritization by Interaction Coverage,” DOSTA ’07 Workshop on Domain Specific Approaches to Test Automation: in conjunction with the 6th ESEC/FSE joint meeting, pp. 1-7.
Briand, L. C., J. Wust, S. V. Ikonomovski and H. Lounis, 1999, “Investigating Quality Factors in Object Oriented Designs: An Industrial Case Study,” IEEE International Conference on Software Engineering, pp. 345-354.
Carlson, R., D. Hyunsook and A. Denton, 2011, “A Clustering Approach to Improving Test Case Prioritization: An Industrial Case Study,” IEEE International Conference on Software Maintenance, pp. 382-391.
Chen, G. and D. Kotz, 2000, “A Survey of Context-Aware Mobile Computing Research,” Technical Report TR2000-381, Dartmouth College, Hanover, New Hampshire.
Chidamber, S. R. and C.F. Kemerer, 1994, “A Metrics Suite for Object-Oriented Design,” IEEE Transactions on Software Engineering, vol. 20 (6) , pp. 476-493.
Cooper, R. G., 1984,“The Strategy-Performance Link in Product Innovention,” R&D Management, vol. 14 (4), pp. 247-259.
Cooper, R. G., 1998, Product Leadership: Creating and Launching Superior New Products, Perseus Books, NY.
Cooper, R. G. and E.J. Kleinschmidt,1993, “Uncover the Keys to New Product Success,” Engineering Management Review, 1993, pp. 5-18.
Crawford, C. M., 1997, New Product Management, IRWIN, NY.
Crittercism Inc., 2012, Crashes by OS Version Normalized, San Francisco, CA.
Dallmeier, V., N. Knopp, C. Mallon, G. Fraser, S. Hack and A. Zeller, 2012, “Automatically Generating Test Cases for Specification Mining,” IEEE Transactions on Software Engineering, vol. 38 (2) , pp. 234-257.
Do, H., G. Rothermel and A. Kinneer, 2004, “Empirical Studies of Test Case Prioritization in a JUnit Testing Environment,” IEEE Symposium on Software Reliability Engineering, pp. 113-124.
Do, H., G. Rothermel and A. Kinneer, 2006, “Prioritizing JUnit Test Cases: An Empirical Assessment and Cost-Benefits Analysis,” Journal of Empirical Software Engineering, vol. 11 (1) , pp. 33-70.
Do, H. and G. Rothermel, 2006, “On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques,” IEEE Transactions on Software Engineering, vol. 32 (9) , pp. 733-752.
Eppinger, S. D. and K.T. Ulrich, 2000, Product Design and Development, McGraw Hill, Boston, MA.
Elbaum,S., D. Gable and G. Rothermel, 2001, “Understanding and Measuring the Sources of Variation in the Prioritization of Regression Test Suites,” IEEE Symposium on Software Metrics, pp. 169-179
Elbaum, S., A.G. Malishevsky and G. Rothermel, 2000, “Prioritizing Test Cases for Regression Testing,” Symposium on Software Testing and Analysis, pp. 102-112.
Elbaum, S., A.G. Malishevsky and G. Rothermel, 2002, “Test Case Prioritization: A Family of Empirical Studies,” IEEE Transactions on Software Engineering, vol. 28 (2) , pp. 159-182.
Elbaum,S., G. Rothermel, S. Kanduri and A. G. Malishevsky, 2004, “Selecting a Cost-Effective Test Case Prioritization Technique,” Software Quality Journal, vol. 12 (3) , pp. 185-210.
Engstrom, E., P. Runeson and A. Ljung, 2011, “History-Based Prioritization - An Industrial Case Study,” IEEE International Conference on Software Testing, pp. 367-376.
Forouzan, B. A. , 2007, Data Communications and Networking, 4th ed., McGraw-Hill, NY.
Gupta, R, M.J. Harrold and M.L. Sofa, 1992, “An Approach to Regression Testing Using Slicing,” IEEE International Conference on Software Maintenance, pp. 299-308.
Guo, B., M. Subramaniam and P. Chundi, 2012, “Analysis of Test Clusters for Regression Testing,” IEEE International Conference on Software Testing, p. 736.
Harman, M., 2011, “Making the Case for MORTO: Multi Objective Regression Test Optimization,” IEEE International Conference on Software Testing, pp. 111-114.
Hemmati, H., A. Arcuri and L. Briand, 2011, “Empirical Investigation of the Effects of Test Suite Properties on Similarity-Based Test Case Selection,” IEEE International Conference on Software Testing, pp. 327-336.
Hisrich, R. D. and M. P. Peters, 1978, Marketing as a New Product, Menlo Park, CA.
Huang, Y. C. and K. L. Peng, 2012, “A history-Based Cost-Cognizant Test Case Prioritization Technique in Regression Testing,” Journal of Systems and Software, vol. 85 (3) , pp. 626-637.
Hutchings, A. and S. Knox, 1995, “Creating Products Customers Demand,” Communications of the ACM, vol. 38 (5) , pp. 72-80.
Institute of Electrical and Electronics Engineers (IEEE) , 1990, IEEE Standard Computer Dictionary: A Compilation of IEEE Standard Computer Glossaries , Washington.
International Telecommunications Union (ITU) , 2012, ITU Database World Telecommunications Indicators 2011 , Geneva.
Jiang, B., X. Long and X. Gao, 2007, “MobileTest: A Tool Supporting Automatic Black Box Test for Software on Smart Mobile Devices,” IEEE International Workshop on Automation of Software Test, pp. 20-27.
Johnson,Samuel C.and Conrad Jones, 1957, “How to Organize for New Products,” Harvard Business Review, May-June 1957, p. 52.
Jones, C., 1996, " Strategies for Managing Requirements Creep," IEEE Computer, vol. 29 (6) , pp. 92 - 94.
Karlsson, J. and K. Ryan, 1997, “A Cost-Value Approach for Prioritizing Requirements,” IEEE Software, vol. 14 (5) , pp. 67-74.
Kaushik, N., L. Tahvildari and M. Moore, 2011, “Reconstructing Traceability between Bugs and Test Cases: An Experimental Study,” IEEE Working Conference on Reverse Engineering, pp. 411-414.
Leon, D. and A. Podgurski, 2003, “A Comparison of Coverage-Based and Distribution-Based Techniques for Filtering and Prioritizing Test Cases,” IEEE International Symposium on Software Reliability Engineering, pp. 442-453.
Leung, H.K.N. and L. White, 1989, “Insights Into Regression Testing,” IEEE Conference on Software Maintenance, pp. 60-69.
Li, Z., M. Harman and R. M. Hierons, 2007, “Search Algorithms for Regression Test Case Prioritization,” IEEE Transactions on Software Engineering, vol. 33 (4) , pp. 225-237.
Malishevsky, A. G., J. R. Ruthru, G. Rothermel and S. Elbaum, 2006, “Cost-Cognizant Test Case Prioritization,” Technical Report TR-UNL-CSE-2006-0004, Department of Computer Science and Engineering, University of Nebraska, Lincoln, Nebraska.
Malaiya, Y. K. and J. Denton, 1999, “Requirements Volatility and Defect Density,” IEEE International Symposium on Software Reliability Engineering, Boca Ratan, Florida, pp. 285-298.
Mansour, N., H. Takkoush and A. Nehme, 2011, “UML-Based Regression Testing for OO Software,” Journal of Software Maintenance and Evolution: Research and Practice, vol. 23 (1) , pp. 51-68
Merk, L., 2001, Pervasive Computing Handbook, Springer-Verlag, Telos, Germany.
Mogyorodi, G., 2001, “Requirements-Based Testing: An Overview,” IEEE International Conference and Exhibition on Technology of Object-Oriented Languages and Systems, pp. 286-295.
Mohanty, S., A.A. Acharya and D.P. Mohapatra, 2011, “A Model Based Prioritization Technique for Component Based Software Retesting Using UML State Chart Diagram,” IEEE International Conference on Electronics Computer Technology, vol. 2, pp. 364-368.
Moisiadis, F., 2000, “Prioritising Use Cases and Scenarios,” IEEE International Conference on Technology of Object-Oriented Languages and Systems, pp. 108-119.
Musa, J., 1999, Software Reliability Engineering, McGraw-Hill, New York, NY.
Munson, J. C. and S. Elbaum, 1999, “Software Reliability as a Function of User Execution Patterns and Practice,” IEEE International Conference of System Sciences, vol. Track8, pp. 255-285.
O’Neal, J. and D. Carver, 2001, “Analyzing the Impact of Changing Requirements,” IEEE International Conference on Software Maintenance, pp. 190-195.
Onoma, K., W.T. Tsai, M. Poonawala and H. Suganuma, 1998, “Regression Testing in an Industrial Environment,” Communications of the ACM, vol. 41 (5) , pp. 81-86.
Park, H., H. Ryu and J. Baik, 2008, “Historical Value-Based Approach for Cost-Cognizant Test Case Prioritization to Improve the Effectiveness of Regression Testing,” IEEE International Conference on Secure System Integration and Reliability Improvement, pp. 39-46.
Qu, B., C. Nie and B. Xu, 2009, " Survey of Test Case prioritization for Regression Testing," Journal of Frontiers of Computer Science and Technology, 3 (3), pp. 225-233.
Quinlan, J. R., 1987, “Simplifying Decision Trees,” International Journal Man-Machine Studies, vol. 27 (3) , pp. 221-234.
Raju, S. and G. V. Uma, 2012, “Factors Oriented Test Case Prioritization Technique in Regression Testing using Genetic Algorithm,” European Journal of Scientific Research , vol.74 (3) , pp. 389-402.
Rothermel, G. and M.J. Harrold, 1996, “Analyzing Regression Test Selection Techniques,” IEEE Transactions on Software Engineering, vol. 22 (8) , pp. 529-551.
Rothermel, G. and M.J. Harrold, 1997, “A Safe, Efficient Regression Test Selection Technique,” ACM Transactions on Software Engineering and Methodology, vol. 6 (2) , pp. 173-210.
Rothermel, G., M.J. Harrold, J. Ostrin and C. Hong, 1998, “An Empirical Study of the Effects of Minimization on the Fault Detection Capabilities of Test Suites,” IEEE International Conference on Software Maintenance, pp. 34-43.
Rothermel, G., R.H. Untch and C. Chu, 1999, “Test Case Prioritizing: An Empirical Study,” IEEE International Conference on Software Maintenance, pp. 179-188.
Rothermel, G., R.H. Untch, C. Chu and M.J. Harrold, 2001, “Prioritizing Test Cases for Regression Testing,” IEEE Transactions on Software Engineering, vol. 27 (10) , pp. 929-948.
Sampson, P., 1970, “Can Consumer Create New Products,” Journal of the Marketing Research Society, vol. 12 (1) , pp. 40-P52.
Sands, S. and L. M. Warwick, 1997, “Successful Business Innovation:A Survey of Current Professional View,” Califonian Management Review, vol. 20 (2) , pp. 5-16.
Shull, F., V. Basili, B. Boehm, W. Brown, P. Costa, M. Lindvall, D. Port, I. Rus, R. Tesoriero and M. Zelkowitz, 2002, “What We Learned about Fighting Defects,” IEEE Symposium on Software Metrics, pp. 249-258.
Souder, W. E., 1988, “Managing Relations between R&D and Marketing in New Product Development Projects,” Journal of Product Innovation Management, vol. 5 (1) , pp. 6-19.
Srikanth, H. and L. Williams, 2005, “On the Economics of Requirements-Based Test Case Prioritization,” ACM SIGSOFT International Symposium on Software Engineering Notes, vol. 30 (4) , pp. 1-3.
Srikanth, H., L. Williams and J. Osborne, 2005, “System Test Case Prioritization of New and Regression Test Cases,” IEEE Symposium on Empirical Software Engineering, pp. 62-71.
Srivastava, A. and J. Thiagarajan, 2002, “Effectively Prioritizing Tests in Development Environment,” ACM SIGSOFT International Symposium on Software Testing and Analysis, pp. 97-106.
Tahat, L., B. Vaysburg, B. Korel and A. Bader, 2001, “Requirement-Based Automated Black-Box Test Generation,” IEEE International Conference on Computer Software and Applications, pp. 489-495.
Tews, J. and S. Perryman, 2010, Average Length of Time Wireless Customers Keep Their Mobile Phones Increases Notably , J. D. Power and Associates, Agoura Hills, CA.
Trott, p., 1998, Innovation Management and New Product Development, Trans-Atlantic Publications, Philadelphia , PA.
Wong, W. E., J. R. Horgan, S. London and A. P. Mathur, 1995, “Effect of Test Set Minimization on Fault Detection Effectiveness,” IEEE International Conference on Software Engineering, p. 41.

指導教授

王存國(Eric T.G. Wang)

審核日期

2013-5-20

推文