基於微控制器的嵌入式深度神經網路系統開發及快速應用佈署

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：13

、訪客IP：18.118.210.213

姓名

林榮豪(Jung-Hao Lin) 查詢紙本館藏

畢業系所

資訊工程學系在職專班

論文名稱

基於微控制器的嵌入式深度神經網路系統開發及快速應用佈署
(Microcontroller-based Embedded Deep Neural Network System Development and Rapid Application Deployment)

相關論文

★ 整合GRAFCET虛擬機器的智慧型控制器開發平台	★ 分散式工業電子看板網路系統設計與實作
★ 設計與實作一個基於雙攝影機視覺系統的雙點觸控螢幕	★ 智慧型機器人的嵌入式計算平台
★ 一個即時移動物偵測與追蹤的嵌入式系統	★ 一個固態硬碟的多處理器架構與分散式控制演算法
★ 基於立體視覺手勢辨識的人機互動系統	★ 整合仿生智慧行為控制的機器人系統晶片設計
★ 嵌入式無線影像感測網路的設計與實作	★ 以雙核心處理器為基礎之車牌辨識系統
★ 基於立體視覺的連續三維手勢辨識	★ 微型、超低功耗無線感測網路控制器設計與硬體實作
★ 串流影像之即時人臉偵測、追蹤與辨識─嵌入式系統設計	★ 一個快速立體視覺系統的嵌入式硬體設計
★ 即時連續影像接合系統設計與實作	★ 基於雙核心平台的嵌入式步態辨識系統

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 (2024-6-17以後開放)

摘要(中)

目前主流的 AI 技術多半依賴高性能之電腦主機，而運行於微控制器上之嵌入式系統並不多見。若是能將已趨成熟之 AI 技術運行於微控制器上，不僅可以讓 AI 技術在更多領域應用，還可在許多應用中帶來可觀的功耗的節約。本研究藉由加入了虛擬機器來使微控制器獲得靈活佈署的特性，從而使實作於微控制器之深度神經網路應用可用更方便的方式佈署。在彌補了微控制器與電腦主機應用深度神經網路在便利性上的差距後，前述之目標將變得切實可行。接著進行的實驗中也驗證了虛擬機器的功能以及實作神經網路的正確性。本研究在將深度神經網路應用帶進微控制的嵌入式系統中的同時，保留了微控制器的優點，並克服了它的缺點。與高耗能高成本主機相比，本研究極低的功率消耗將帶來可觀的節能效益。

摘要(英)

At present, mainstream AI technology mostly relies on high-performance computer hosts, and embedded systems running on microcontrollers are rare. If the mature AI technology can be run on the microcontroller, you can not only let AI technology be applied in more fields, but also bring considerable power saving in many applications. In this research, the virtual machine was added to enable the microcontroller to be flexibly deployed, so that the deep neural network application implemented in the microcontroller can be deployed in a more convenient manner. After making up for the gap in the convenience of the deep neural network between the microcontroller and the host computer, the aforementioned goals will become feasible. The subsequent experiments also verified the function of the virtual machine and the correctness of the implemented neural network. This research preserves the advantages of the microcontroller and overcomes its shortcomings while bringing deep neural network applications into the microcontroller-based embedded system. Compared with high-energy and high-cost hosts, the extremely low power consumption system of this research will bring considerable energy savings.

關鍵字(中)

★ 微控制器
★ 嵌入式
★ 神經網路

關鍵字(英)

★ AIoT
★ DNN
★ MCU

論文目次

摘要 i
Abstract ii
誌謝 iii
目錄 iv
圖目錄 vi
表目錄 vii
第一章緒論 1
1.1研究背景 1
1.2研究目的 2
1.3論文架構 2
第二章技術回顧 3
2.1 IEC61131、 PLCopen與Beremiz 3
2.2 機器視覺 4
2.3 深度神經網路 4
2.4 MIAT方法論 5
2.5 GVM 7
第三章神經網路模組化設計與新一代之GVM 9
3.1 深度神經網路 9
3.1.1 執行期間的資料結構 9
3.1.2 傳輸階段之拓撲編碼 11
3.2 GVM之改良 13
3.2.1擴展參數表 13
3.2.2主流程修改 14
第四章系統實作與驗證 18
4.1平台佈署概觀 18
4.2 GVM功能函式 19
4.3系統驗證 20
4.3.1 於PVC使用GVM之影像處理實作及系統驗證 20
4.3.1.1 SFC任務設計 20
4.3.1.2 解析XML為參數表 20
4.3.1.3 傳送參數表 21
4.3.1.4 驗證運行結果 22
4.3.2 DNN驗證 23
4.3.2.1 資料集以及網路結構 23
4.3.2.2 架構選定及參數調整 23
4.3.2.3 訓練環境、應用環境及測試結果 24
4.3.2.4 時間資源及空間資源分析 27
4.3.3整合驗證 28
4.3.3.1 SFC設計 29
4.3.3.2 軟體UART與4位七段顯示器外部設備 29
4.3.3.3 實驗環境 31
4.4系統比較 31
4.4.1 伺服主機和工業電腦 32
4.4.2 單一任務之嵌入式系統 32
第五章結論與未來方向 33
5.1結論 33
5.2未來方向 33
參考文獻 35

參考文獻

參考文獻
[1] B. Chen, J. Wan, L. Shu, P. Li, M. Mukherjee, and B. J. I. A. Yin, "Smart factory of industry 4.0: key technologies, application case, and challenges," vol. 6, pp. 6505-6519, 2018.
[2] R. Jain, R. Kasturi, and B. G. Schunck, Machine vision. McGraw-Hill New York, 1995.
[3] E. R. Davies, Machine vision: theory, algorithms, practicalities. Elsevier, 2004.
[4] M. Sonka, V. Hlavac, and R. Boyle, Image processing, analysis, and machine vision. Cengage Learning, 2014.
[5] 謝欣蓓, "整合 GRAFCET 虛擬機器的智慧型控制器開發平台," 中央大學資訊工程學系學位論文, pp. 1-74, 2011.
[6] C.-W. Cheng, "整合可程式邏輯控制與機器視覺的 PLCopen 開發平台," National Central University, 2017.
[7] R. W. Lewis, Programming industrial control systems using IEC 1131-3 (no. 50). Iet, 1998.
[8] M. Maslar, "PLC standard programming languages: IEC 1131-3," in Pulp and Paper Industry Technical Conference, 1996., Conference Record of 1996 Annual, 1996: IEEE, pp. 26-31.
[9] A. Otto and K. J. I. I. E. M. Hellmann, "IEC 61131: A general overview and emerging trends," vol. 3, no. 4, 2009.
[10] M. Tiegelkamp and K.-H. John, IEC 61131-3: Programming industrial automation systems. Springer, 1995.
[11] E. V. d. Wal, "Creating reusable, hardware independent motion control applications via IEC 61131-3 and PLCopen Motion Control Profile," in 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556), 8-12 July 2001 2001, vol. 2, pp. 769-774 vol.2, doi: 10.1109/AIM.2001.936763. [Online]. Available: https://ieeexplore.ieee.org/ielx5/7453/20266/00936763.pdf?tp=&arnumber=936763&isnumber=20266
[12] E. v. d. Wal, "Introduction into IEC 1131-3 and PLCopen," in IEE Colloquium on The Application of IEC 61131 to Industrial Control: Improve Your Bottom Line Through High Value Industrial Control Systems (Ref. No. 1999/076), 30-30 March 1999 1999, pp. 2/1-2/8, doi: 10.1049/ic:19990423. [Online]. Available: https://ieeexplore.ieee.org/ielx5/6267/16735/00771818.pdf?tp=&arnumber=771818&isnumber=16735
[13] T. Mitchell, B. Buchanan, G. DeJong, T. Dietterich, P. Rosenbloom, and A. Waibel, "Machine learning," Annual review of computer science, vol. 4, no. 1, pp. 417-433, 1990.
[14] E. P. Luke, D. W. Creavin, and R. R. Reetz, "System and method for automatic optical inspection," ed: Google Patents, 1996.
[15] R. Kauth, A. Pentland, and G. Thomas, "Blob: An unsupervised clustering approach to spatial preprocessing of mss imagery," 1977.
[16] J. M. Zurada, Introduction to artificial neural systems. West publishing company St. Paul, 1992.
[17] H. Bourlard and Y. Kamp, "Auto-association by multilayer perceptrons and singular value decomposition," Biological cybernetics, vol. 59, no. 4-5, pp. 291-294, 1988.
[18] R. Hecht-Nielsen, "Theory of the backpropagation neural network," in Neural networks for perception: Elsevier, 1992, pp. 65-93.
[19] T. Joachims, "Text categorization with support vector machines: Learning with many relevant features," in European conference on machine learning, 1998: Springer, pp. 137-142.
[20] D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization," arXiv preprint arXiv:1412.6980, 2014.
[21] J. Chen and Q. Gu, "Padam: Closing the generalization gap of adaptive gradient methods in training deep neural networks," 2018.
[22] N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: a simple way to prevent neural networks from overfitting," The Journal of Machine Learning Research, vol. 15, no. 1, pp. 1929-1958, 2014.
[23] X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks," in Proceedings of the thirteenth international conference on artificial intelligence and statistics, 2010, pp. 249-256.
[24] K. He, X. Zhang, S. Ren, and J. Sun, "Delving deep into rectifiers: Surpassing human-level performance on imagenet classification," in Proceedings of the IEEE international conference on computer vision, 2015, pp. 1026-1034.
[25] S. Ioffe and C. Szegedy, "Batch normalization: Accelerating deep network training by reducing internal covariate shift," arXiv preprint arXiv:1502.03167, 2015.

指導教授

陳慶瀚(Ching-Han Chen)

審核日期

2019-7-10

推文