Windows桌面應用程式的擴增實境

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：5

、訪客IP：3.14.133.162

姓名

劉蓉綺(Rong-Chi Liu) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

Windows桌面應用程式的擴增實境
(Yet Another Augmented Reality of Windows Desktop Applications)

相關論文

★ 使用PolyTraceAid進行程式文件覆蓋率計算與分群	★ Support Visual Debugging in Electronic Design Automation Software by xDIVA
★ 設計與實作視覺化追蹤點以支援xDIVA進行程式動畫	★ Combine Internal Test Oracles and Capture/Replay GUI Testing for Precise Replay and Higher Validation Power
★ Dissimilarity of Polymorphic Execution Sequences	★ The Analysis of Capturing System Test Cases into Unit Test Cases
★ 動態延遲載入的測試覆蓋率	★ 建構於JMeter之自動化分散式壓力測試架構
★ 模組化因修改具耦合的程式碼所伴隨的成本漣漪	★ Design a Pluggable Architecture for Layout Algorithms in xDIVA
★ 重複性程式碼檢測之外掛模組設計	★ Visual Perception of Realistic Rendering in xDiva 3D Environment
★ Why and When GUI Test Automation Fails in Practice and Our Solutions to The Problem	★ Why and When GUI Test Automation Fails in Practice and Our Solutions to The Problem
★ Very High Precision Optical Character Recognition For Clean-Fixed-Sized True Type Characters	★ Enhance Korat by Branch Capability in Capture/Replay User Scenario to Industrial Test Case Automation

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 (2027-8-3以後開放)

摘要(中)

一般當一個軟體開發出來後，功能基本上就已經固定無法改變了。若要變更或擴充功能，原則上必須要有原始程式碼(source code)。為了要讓擴充簡化，或讓第三方在沒有原始程式碼的環境下可以進行擴充，軟體工程開發出了API (Application Programming Interface)、外掛程式(Plugin)、擴充套件(Extension)、框架(Framework)等方式，讓第三方開發者在不碰觸到或沒有核心程式碼的情況下可以進行擴充開發。
本論文中，我們提出了一個運用在Windows作業系統中的桌面應用程式上新的擴充方法「桌面應用程式的擴增實境」 (The Augmented Reality of Desktop Applications，簡稱ARDA )。ARDA允許第三方的開發者對一個應用程式做類似擴增實境(Augmented Reality)方式的擴充。這是透過本實驗室開發出的輔助工具，在目標應用程式上新增一層透明視窗，並在上面安裝新的按鈕及功能。這些ARDA上的按鈕及功能被觸發時，可以與目標程式互動，讓使用者在使用體驗上會覺得ARDA與目標程式是一體的。例如，在目標應用程式頁面捲動時，透明視窗上顯示的各物件位置也會隨之改變。

摘要(英)

Generally, when a software is developed, its functions are basically fixed and cannot be changed. To change or expand the function, we must have the source code in principle. In order to simplify the extension, or allow third parties to extend the application without source code, software engineering has developed API (Application Programming Interface), Plugin, Extension, Framework and so on, so that third-party developers can carry out extended development without touching the source code or without the source code.
In this paper, we propose a new extension method, that used on application in Windows operating system, "The Augmented Reality of Desktop Applications" (ARDA). ARDA allows third-party developers to extend an application in a manner similar to Augmented Reality. Through the auxiliary tool developed in our lab, we’ll add a transparent window on the target application, and create new buttons and functions on it. When the buttons and functions on the ARDA are triggered, they can interact with the target program, so that the user will feel that the ARDA and the target application are one. For example, when the target application page is scrolled, the position of each object displayed on the transparent window will also change accordingly.

關鍵字(中)

★ 擴充程式
★ 擴增實境

關鍵字(英)

★ API

論文目次

摘要 i
Abstract ii
目錄 iii
圖目錄 v
表目錄 vii
一、緒論 1
二、研究背景與相關研究 5
2-1 API 5
2-2 外掛程式(Plugin)與擴充套件(Extension) 6
2-3 擴增實境 (Augmented Reality，AR) 7
2-4 RPA (Robotic Process Automation) 8
2-5 UI自動化 (UI Automation) 11
2-6 Google Vision 12
2-7 Visual Studio Code 13
2-8 GeekyNote 14
三、問題描述與分析 16
3-1 目標應用程式的擴充限制 16
3-2 ARDA (Augmented Reality of Desktop Application) 的發想 17
3-2-1 新增功能 18
3-2-2 螢幕顯示即時更新 19
3-2-3 繪製圖表 20
3-2-4 資訊與動作截取 20
四、系統設計與實作 22
4-1 透明視窗的應用 22
4-2 落實兩個應用程式的連結 23
4-2-1 目標應用程式的資料取得與傳送 24
4-2-2 擴充應用程式的資料取得與傳送 25
4-3 擴充資料與物件的顯示 26
4-3-1 UI自動化 (UI automation) & Google Vision 26
4-3-2 OCR定錨 28
五、討論與評估 30
5-1 擴充方式ARDA與API及外掛程式的差異 30
5-2 TWAE與Visual Studio Extension的差異 31
5-3 透過TWAE支援其他IDE擴充問題 33
六、結論與未來展望 35
七、參考資料 36

參考文獻

[1] Yung-Pin Cheng, Wei-Nien Hsiung, Yu-Shan Wu, Li-Hsuan Chen:GeekyNote: a technical documentation tool with coverage, backtracking, traces, and couplings. ICSE (Companion Volume) 2020: 73-76
[2] “Visual Studio Code” [Online]. Available: https://code.visualstudio.com/. [Accessed 5 Jun 2022].
[3] Chrome 外掛程式商店 [Online]. Available: https://chrome.google.com/webstore/category/extensions?hl=zh-TW. [Accessed 30 Jun 2022].
[4] Flash Player Chrome 停用 [Online]. Available: https://support.google.com/chrome/answer/6258784?hl=zh-Hant. [Accessed 30 Jun 2022].
[5] Augmented Reality [Online]. Available: https://zh.m.wikipedia.org/zh-tw/%E6%93%B4%E5%A2%9E%E5%AF%A6%E5%A2%83. [Accessed 30 Jun 2022].
[6] 李資瀚（2021）。利用多影像平均值以及高斯濾波方法提升RPA軟體的影像辨識準確度。國立中央大學資訊工程學系碩士論文。from < https://hdl.handle.net/11296/7vzm98 >
[7] Automation Anywhere. Apr 2022 [Online]. Available: https://www.automationanywhere.com/. [Accessed 30 Jun 2022].
[8] UiPath. [Online]. Available: https://www.uipath.com/ Apr 2022
[9] Paiva, Ana & Faria, Jo?o & Tillmann, Nikolai & Vidal, Raul. (2005). A Model-to-Implementation Mapping Tool for Automated Model-Based GUI Testing. 450-464. 10.1007/11576280_31.
[10] Jesper Lehtinen. (2016). Automated GUI Testing of Game Development Tools. Bachelor of Engineering Information Technology Software Engineering
[11] Windows Microsoft UI Automation [Online]. Available: https://docs.microsoft.com/zh-tw/dotnet/framework/ui-automation/. [Accessed 30 Jun 2022].
[12] UISpy [Online]. Available: https://github.com/2gis/Winium.Cruciatus/tree/master/tools/UISpy. [Accessed 30 Jun 2022].
[13] Google Vision [Online]. Available: https://cloud.google.com/vision/. [Accessed 30 Jun 2022].
[14] Google Vision example [Online]. Available: https://hkmci.com/zh-hant/%E7%B6%B2%E8%AA%8C/cloud-vision-api/. [Accessed 30 Jun 2022].
[15] J. Kim, M. Lorenz, S. Knopp and P. Klimant, "Industrial Augmented Reality: Concepts and User Interface Designs for Augmented Reality Maintenance Worker Support Systems," 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2020, pp. 67-69, doi: 10.1109/ISMAR-Adjunct51615.2020.00032.
[16] A. Costa, R. Lima and S. Tamayo, "Eva: A Virtual pet in Augmented Reality," 2019 21st Symposium on Virtual and Augmented Reality (SVR), 2019, pp. 47-51, doi: 10.1109/SVR.2019.00024.
[17] S. Chang and W. Chen, "Does visualize industries matter? A technology foresight of global Virtual Reality and Augmented Reality Industry," 2017 International Conference on Applied System Innovation (ICASI), 2017, pp. 382-385, doi: 10.1109/ICASI.2017.7988432.
[18] R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier and B. MacIntyre, "Recent advances in augmented reality," in IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34-47, Nov.-Dec. 2001, doi: 10.1109/38.963459.
[19] L. F. d. S. Cardoso and E. R. Zorzal, "An Augmented Reality Review on Production Environments," 2018 20th Symposium on Virtual and Augmented Reality (SVR), 2018, pp. 143-149, doi: 10.1109/SVR.2018.00030.
[20] R. Uskenbayeva, Z. Kalpeyeva, R. Satybaldiyeva, A. Moldagulova and A. Kassymova, "Applying of RPA in Administrative Processes of Public Administration," 2019 IEEE 21st Conference on Business Informatics (CBI), 2019, pp. 9-12, doi: 10.1109/CBI.2019.10089.
[21] D. Chen, D. Xiao, Y. Li, T. Shao and W. Meng, "Automatic approval method for financial reimbursement of electric power enterprises based on RPA robot," 2021 International Conference on Computer Technology and Media Convergence Design (CTMCD), 2021, pp. 231-234, doi: 10.1109/CTMCD53128.2021.00056.
[22] S. Gupta, S. Rani and A. Dixit, "Recent Trends in Automation-A study of RPA Development Tools," 2019 3rd International Conference on Recent Developments in Control, Automation & Power Engineering (RDCAPE), 2019, pp. 159-163, doi: 10.1109/RDCAPE47089.2019.8979084.
[23] R. Mehta and R. Chaher, "Implementation of Robotic Process Automation (RPA) in Digital Marketing," 2022 3rd International Conference for Emerging Technology (INCET), 2022, pp. 1-4, doi: 10.1109/INCET54531.2022.9824263.
[24] Isha, A. Sharma and M. Revathi, "Automated API Testing," 2018 3rd International Conference on Inventive Computation Technologies (ICICT), 2018, pp. 788-791, doi: 10.1109/ICICT43934.2018.9034254.
[25] G. Ajam, C. Rodríguez and B. Benatallah, "API Topic Issues Indexing, Exploration and Discovery for API Community Knowledge," 2020 XLVI Latin American Computing Conference (CLEI), 2020, pp. 178-185, doi: 10.1109/CLEI52000.2020.00028.
[26] P. Rodeghero, C. McMillan and A. Shirey, "API Usage in Descriptions of Source Code Functionality," 2017 IEEE/ACM 1st International Workshop on API Usage and Evolution (WAPI), 2017, pp. 3-6, doi: 10.1109/WAPI.2017.3.
[27] H. Kwon, J. Ahn, S. Choi, J. Siewierski, P. Kosko and P. Szydelko, "An Experience Report of the API Evolution and Maintenance for Software Platforms," 2018 IEEE International Conference on Software Maintenance and Evolution (ICSME), 2018, pp. 587-590, doi: 10.1109/ICSME.2018.00034.
[28] P. Nagarani and R. VenkataRamanaChary, "A tool based approach for automation of GUI applications," 2012 Third International Conference on Computing, Communication and Networking Technologies (ICCCNT′12), 2012, pp. 1-6, doi: 10.1109/ICCCNT.2012.6396013.
[29] Ni Jin, Wang Mingming and Wang Jiangqing, "Realization on intelligent GUI automation testing based-on .NET," 2010 3rd International Conference on Computer Science and Information Technology, 2010, pp. 14-17, doi: 10.1109/ICCSIT.2010.5563862.
[30] N. Patil, D. Bhole and P. Shete, "Enhanced UI Automator Viewer with improved Android accessibility evaluation features," 2016 International Conference on Automatic Control and Dynamic Optimization Techniques (ICACDOT), 2016, pp. 977-983, doi: 10.1109/ICACDOT.2016.7877733.
[31] F. Dobslaw, R. Feldt, D. Michaëlsson, P. Haar, F. Gomes de Oliveira Neto and R. Torkar, "Estimating Return on Investment for GUI Test Automation Frameworks," 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE), 2019, pp. 271-282, doi: 10.1109/ISSRE.2019.00035.
[32] D. Vaithiyanathan and M. Muniraj, "Cloud based Text extraction using Google Cloud Vison for Visually Impaired applications," 2019 11th International Conference on Advanced Computing (ICoAC), 2019, pp. 90-96, doi: 10.1109/ICoAC48765.2019.246822.
[33] Y. Pachipala, E. Nandhitha, K. Haritha, B. V. N. S. Chandrika and V. C. Jadala, "Face Recognition Application using Offloading Computation over Google Cloud," 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), 2022, pp. 1395-1400, doi: 10.1109/ICCMC53470.2022.9753980.
[34] M. Sugadev, Yogesh, P. K. Sanghamreddy and S. K. Samineni, "Rough Terrain Autonomous Vehicle Control Using Google Cloud Vision API," 2019 2nd International Conference on Power and Embedded Drive Control (ICPEDC), 2019, pp. 244-248, doi: 10.1109/ICPEDC47771.2019.9036621.

指導教授

鄭永斌(Yung-Pin Cheng)

審核日期

2022-8-4

推文