即時連續影像接合系統設計與實作

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：10

、訪客IP：3.16.83.150

姓名

魏士堯(Shih-yao Wei) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

即時連續影像接合系統設計與實作
(Design and Implementation of a Real-time Continuous Image Mosaic System)

相關論文

★ 整合GRAFCET虛擬機器的智慧型控制器開發平台	★ 分散式工業電子看板網路系統設計與實作
★ 設計與實作一個基於雙攝影機視覺系統的雙點觸控螢幕	★ 智慧型機器人的嵌入式計算平台
★ 一個即時移動物偵測與追蹤的嵌入式系統	★ 一個固態硬碟的多處理器架構與分散式控制演算法
★ 基於立體視覺手勢辨識的人機互動系統	★ 整合仿生智慧行為控制的機器人系統晶片設計
★ 嵌入式無線影像感測網路的設計與實作	★ 以雙核心處理器為基礎之車牌辨識系統
★ 基於立體視覺的連續三維手勢辨識	★ 微型、超低功耗無線感測網路控制器設計與硬體實作
★ 串流影像之即時人臉偵測、追蹤與辨識─嵌入式系統設計	★ 一個快速立體視覺系統的嵌入式硬體設計
★ 基於雙核心平台的嵌入式步態辨識系統	★ Gigabit乙太網路的UDP/IP硬體加速器設計

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

由於單一鏡頭所能拍攝的視野有限，在需要大範圍視野的影像監控應用上是一大瓶頸。本研究基於雙攝影機架構，設計及實作一個適合應用於大型監控場景的即時連續影像接合系統，其目標在於達到串流視訊的即時效能同時確保影像接合區域的連續性。
本系統將繁複影像接合程序分割為離線校正階段與影像接合階段，用以減輕連續影像接合時的效能負擔；在影像扭曲校正方面，我們提出一區域性校正扭曲模型，可應用於非徑向扭曲影像。另外，本研究也提出一個方法，成功克服前景移動物於影像重疊區域出現鬼影的現象。最後，我們合併兩次座標轉換提出一次性影像插補方法以及加入離散小波轉換，除了大幅改善接合影像品質，也同時提升了系統效能。
影像接合階段演算法於個人電腦以及嵌入式處理器NIOS平台完成了軟體驗證。隨後我們分析各軟體模組執行時間找出系統瓶頸，再進行嵌入式硬體設計。我們以實驗室提出的MIAT高階系統硬體設計方法論將複雜計算模組合成至硬體電路，最後於元件可程式邏輯閘陣列(Field-Programmable Gate Array, FPGA)進行硬體驗證。
經由軟硬體驗證和實驗結果，顯示本系統不僅能針對具有移動物的視訊進行高品質的影像接合，軟硬體整合後更可達到即時需求。

摘要(英)

Because of the limited vision, a single lens is not appropriate for video surveillance applications in wide-angle vision. Based on the usage of dual cameras, a real-time continuous images mosaic system which is suitable for wide-angle monitoring is proposed in this study. The system can provide satisfactory real-time streaming video performance while ensuring the continuity of bonding area.
To reduce the computational burden, the complex image bonding procedure is divided into off-line calibration and image stitching phases. In addition, a regional distortion model for calibrating non-radial distortion images is developed. Moreover, the ghost image of overlapping region is removed by a new measure. Finally, both the one-time interpolation approach proposed in this study and the discrete wavelet transform can significantly improve image quality and system efficiency.
The system software has been verified in a personal desktop and an embedded NIOS processor, followed by an analysis of the execution time of each software module to identify and resolve system bottlenecks. The software module is then synthesized into a hardware circuit module by the MIAT hardware synthesis methodology and verified on a FPGA(Field-Programmable Gate Array).
The module verifications and experimental results show that the proposed system can provide a high-quality and high-performance solution, even in the case of moving objects.

關鍵字(中)

★ 即時系統
★ FPGA
★ 影像扭曲校正
★ 影像接合
★ 視訊監控

關鍵字(英)

★ FPGA
★ distortion correction
★ image stitching
★ image mosaic
★ video surveillance
★ real-time system

論文目次

摘要 i
Abstract ii
目錄 iii
圖目錄 vii
表目錄 xi
第一章　緒論 1
1.1　研究動機 1
1.2　文獻回顧 1
1.2.1　環場影像建構 2
1.2.2　鏡頭扭曲校正 3
1.2.3　影像接合 5
1.3　系統流程 9
1.4　論文架構 10
第二章　影像接合相關研究 11
2.1　概述 11
2.2　柱狀投影 12
2.3　平面轉換 14
2.4　角點特徵擷取 16
2.5　特徵匹配 19
2.5.1　鄰近區域相似比對 19
2.5.2　一致性隨機取樣 19
2.6　影像融合 21
2.6.1　亮度一致化 21
2.6.2　重疊區域影像混合 22
第三章　影像校正 24
3.1　影像扭曲校正 24
3.1.1　多項式扭曲模型 25
3.1.2　區域性校正扭曲模型 28
3.2　平面投影轉換 30
3.3　求解轉換參數 32
3.3.1　多項式扭曲模型參數 33
3.3.2　平面投影轉換矩陣 34
3.4　建立轉換對照表 35
第四章　影像接合 36
4.1　影像插補 37
4.2　重疊區域移動物偏移量 38
4.2.1　建立背景模型 39
4.2.2　建立移動物區域 41
4.2.3　特徵擷取比對 44
4.3　區域性影像混合 47
4.4　即時需求演算法改良 49
4.4.1　一次性影像插補 50
4.4.2　離散小波轉換 51
第五章　嵌入式硬體實作 54
5.1　高階系統硬體設計方法論 54
5.2　系統架構與分析 58
5.3　離散雙線性內插 62
5.4　整數化影像灰階值轉換 66
5.5　區域性影像混合 68
5.6　背景模型 70
5.7　高速侵蝕與膨脹模組 73
第六章　系統實作與實驗結果 78
6.1　實驗設備與開發環境 78
6.2　影像接合系統實作與驗證 79
6.2.1　靜態影像接合 79
6.2.2　即時連續影像接合 81
6.3　系統效能分析 86
6.3.1　演算法效能分析 86
6.3.2　硬體模組驗證與效能分析 87
6.4　扭曲校正與影像插補實驗 89
6.5　系統比較 92
第七章　結論與未來研究方向 95
7.1　結論 95
7.2　未來研究方向 96
參考文獻 97

參考文獻

[1] Kyoungju Park; Seungju Bang, "Motion estimation during photographing towards minimal solution for mobile panoramic images," Consumer Electronics, IEEE Transactions on , vol.54, no.3, pp.992-998, August 2008.
[2] Seong Jong Ha; Hyung Koo; Sang Hwa Lee; Nam Ik Cho; Soo Kyun Kim, "Panorama Mosaic Optimization for Mobile Camera Systems," Consumer Electronics, IEEE Transactions on , vol.53, no.4, pp.1217-1225, Nov. 2007.
[3] Seong Jong Ha; Sang Hwa Lee; Nam Ik Cho; Soo Kyun Kim; Byungjun Son, "Embedded Panoramic Mosaic System Using Auto-Shot Interface," Consumer Electronics, IEEE Transactions on , vol.54, no.1, pp.16-24, February 2008.
[4] R. Szeliski; H. Shum, "Creating Full View Panoramic Image Mosaics and Environment Maps," 1997.
[5] 黃禎福, "環場影像接合之研究," 國立台灣大學資訊工程學系碩士學位論文, 2002.
[6] Panli He; Xiaowei Han; Tianmin Deng, "A new method of color image mosaic," Intelligent Control and Automation, 2008. WCICA 2008. 7th World Congress on , vol., no., pp.7757-7761, 25-27 June 2008.
[7] Brown, M.; Lowe, D.G., "Recognising panoramas," Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on , vol., no., pp.1218-1225 vol.2, 13-16 Oct. 2003.
[8] F. Devernay; O. Faugeras, "Straight Lines Have to Be Straight, " IN SPIE, VOLUME 2567, vol. 2567, 2001.
[9] Stein, G.P., "Lens distortion calibration using point correspondences," Computer Vision and Pattern Recognition, 1997. Proceedings., 1997 IEEE Computer Society Conference on , vol., no., pp.602-608, 17-19 Jun 1997.
[10] 許捷皓, "運用校正板與鏡頭光學參數的內視鏡影像校正法,"中原大學電子工程學系碩士學位論文, 2004.
[11] M.A. Fischler; R.C. Bolles, "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, " Communications of the ACM, vol. 24, 1981, pp. 381-395.
[12] Uyttendaele, M.; Eden, A.; Skeliski, R., "Eliminating ghosting and exposure artifacts in image mosaics," Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on , vol.2, no., pp. II-509- II-516 vol.2, 2001
[13] A. Levin, A. Zomet, S. Peleg, Y. Weiss, "Seamless Image Stitching in the Gradient Domain," IN EIGHTH EUROPEAN CONFERENCE ON COMPUTER VISION (ECCV 2004, vol. 4, 2003, pp. 377-389.
[14] Junghee Jun; Choongwon Kim, "Robust camera calibration using neural network," TENCON 99. Proceedings of the IEEE Region 10 Conference , vol.1, no., pp.694-697 vol.1, 1999.
[15] Moravec, H. P., “Towards automatic visual obstacle avoidance,” in Proc. 5th International Joint Conference on Artificial Intelligence, Tokyo, 1977, pp.584.
[16] Harris, C. and M. Stephens, "A combined corner and edge detector," in Proc. of The Fourth Alvey Vision Conference, Manchester, Aug.31-Sep.2, 1988, pp.147-151.
[17] W. Long and Y.H. Yang, "Stationary background generation: an alternative to the difference of two images," in Proc. Of Pattern Recognition, Vol. 23, No. 12, pp.1351-1359, 1990.
[18] A. H. S. Lai and N.H.C. Yung, "A fast and accurate scoreboard algorithm for estimating stationary backgrounds in an image sequences," in Proc. Of IEEE Int’s Symp. On Circuits and Systems, Vol. 4, pp.241-244, 1998.
[19] S.Y. Chen, S. Y. Ma, and L. G. Chen, "Efficient moving object segmentation algorithm using background registration technique," IEEE Transactions on Circuits and Systems for Video Technology , pp. 577-586,2002.
[20] D. W. Lim, S.H. Choi, and J.S. Jun, "Automated detection of all kinds of violations at a street intersection using real Time individual vehicle tracking," in Proc. Of Fifth IEEE Southwest Symposium on Image Analysis and Interpretation, pp.126-129, 2002.
[21] Y. K. Jung and Y.S. Ho, "Traffic parameter extraction using video-based vehicle tracking," in Proc. Of IEEE Int’l Conf. on Intelligent Transportation Systems, pp.764-769, 1999.
[22] Y. C. Chung, J. M. Wang, and S. W. Chen, " Progressive Background Image Generation. " in Proc. of 15th IPPR Conf. on Computer Vision, Graphics and Image Processing, pp. 858-865, 2002.
[23] P. R. Beaudet, "Rotational invariant image operators," in Proceedings of the 4th International Joint Conference on Pattern Recognition, pp. 579–583, 1978.
[24] 邱國恩, "JPEG2000編碼器的VLSI架構,"義守大學電機工程學系碩士學位論文, 2006.
[25] Ching-Han Chen; Jia-Hong Dai, "Design and High-Level Synthesis of Discrete-Event Controller", National Conference of Automatic Control and Mechtronics System. Taiwan, R.O.C., pp. 75-80. , 2002.
[26] 鄒文姍, "動態視訊之即時影像階圖系統,"元智大學資訊工程學系碩士學位論文, 2002.
[27] S. Hsieh, C. Chen, "Adaptive image interpolation using probabilistic neural network," Expert Systems with Applications, vol. 36, 2009, pp. 6025-6029.
[28] DigiVFX., "Image Stitching." [Online]. Available: http://www.csie.ntu.edu.tw/~cyy/courses/vfx/09spring/lectures/ lec06_stitching-1.ppt
[29] C.F.Lin and S.C.Sung, "A featureless image registration method with high accuracy," Thesis of the institute of Electrical Engineering and Computer Engineering and Science, Yuan-Ze University. 2000.
[30] R.Jain, E.Kasturi and B.G.Schunck, Machine Vision, McGraw-Hill. Inc., New York, U.S.A., 1995.
[31] Li Zhong-xin; Xu Wan-he; Wu Zhi-lin; Zhang Yue, "Video Mosaic with Motion Estimation," Information and Computing Science, 2009. ICIC '09. Second International Conference on , vol.2, no., pp.106-109, 21-22 May 2009.
[32] Patil, R.; Rybski, P.E.; Kanade, T.; Veloso, M.M., "People detection and tracking in high resolution panoramic video mosaic," Intelligent Robots and Systems, 2004. (IROS 2004). Proceedings. 2004 IEEE/RSJ International Conference on , vol.2, no., pp. 1323- 1328 vol.2, 28 Sept.-2 Oct. 2004.
[33] 謝東成, "保留邊緣特性之影像放大方法,"國立台灣科技大學電機工程學系碩士學位論文, 2006.

指導教授

陳慶瀚(Ching-han Chen)

審核日期

2010-7-26

推文