適應航向變化的移動相機即時影像穩定技術

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：45

、訪客IP：3.144.47.27

姓名

王定謙(Ting-Chien Wang) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

適應航向變化的移動相機即時影像穩定技術
(Yaw-adapted Real-time Image Stabilization for Moving Camera)

相關論文

★ 適用於大面積及場景轉換的視訊錯誤隱藏法	★ 虛擬觸覺系統中的力回饋修正與展現
★ 多頻譜衛星影像融合與紅外線影像合成	★ 腹腔鏡膽囊切除手術模擬系統
★ 飛行模擬系統中的動態載入式多重解析度地形模塑	★ 以凌波為基礎的多重解析度地形模塑與貼圖
★ 多重解析度光流分析與深度計算	★ 體積守恆的變形模塑應用於腹腔鏡手術模擬
★ 互動式多重解析度模型編輯技術	★ 以小波轉換為基礎的多重解析度邊線追蹤技術(Wavelet-based multiresolution edge tracking for edge detection)
★ 基於二次式誤差及屬性準則的多重解析度模塑	★ 以整數小波轉換及灰色理論為基礎的漸進式影像壓縮
★ 建立在動態載入多重解析度地形模塑的戰術模擬	★ 以多階分割的空間關係做人臉偵測與特徵擷取
★ 以小波轉換為基礎的影像浮水印與壓縮	★ 外觀守恆及視點相關的多重解析度模塑

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

裝置在行動載具上的相機拍攝連續影像例如，汽車、機車、自行車、電動輪椅、..等，由於道路品質不佳或行動載具避震效果不好，連續影像會有不自主晃動及震動的現象，而使得連續影像不適合人眼觀看，也不適合後續的3D電腦視覺分析。因此在本論文的研究中，我們分析影像像素的移動向量 (motion vector)，藉以尋找補償影像不自主晃動及震動的問題。
影像中的移動向量有主要三個來源：i.景觀中自主運動 (autonomous motion) 的物體，ii.行動載具帶動相機左右及上下自我轉動 (ego-motion)，iii.道路品質不佳或行動載具避震效果不好所造成的相機不自主晃動及震動 (involuntary motion)。本研究目的只是要消除影像中的第三種不自主晃動及震動，並盡量保留第一、二種本來就存在的運動資訊。
本研究進行步驟有比對區塊及估計區塊移動向量、篩除不可靠的移動向量、篩除自主運動物體的移動向量、估計影像的等距轉換 (isometric transformation) 參數與補償影像並保留自我移動向量。
首先利用PMVFAST (predictive motion vector field adaptive search technique) 快速比對區塊並取得區塊移動向量。接著，利用邊強度與SAD (sum of absolute difference) 值篩除不可靠區塊移動向量以減去不準確移動向量的影響。第三步驟，我們使用篩選後的移動向量，利用最小平方誤差估計法計算出初始影像轉換參數，接著利用初始影像轉換參數轉換後的移動向量與原始移動向量之間的差異值來篩除自主運動物體的移動向量。第四步驟，將所有保留下來的區塊移動向量再使用相同的最小平方誤差估計法，估計目前影像的等距轉換參數。第五步驟，分析影像移動向量並估算最大不自主震動量，以其為門檻值來辨別自我轉動。然後再依據此門檻值來決定是否修正影像補償向量，以保留自我轉動。最後依據補償向量補償影像，也就是補償不自主震動，使得前後時刻影像內的背景能夠保持穩定。
我們在不同的載具上測試我們的系統，穩定後影像的PSNR (peak signal to noise ratio) 值平均提升約20.85%，而具有適應航向時的系統PSNR值則高於無適應航向約53.4%。我們也比較了固定門檻值搭配最低個數百分比與固定個數百分比之間的做法，而利用前者確實可以使系統得到較好的穩定效果，若以數據表示則約為0.97%。

摘要(英)

Because of poor quality of roads or bad shock absorber of moving platform, there will be shaking or vibration in the image sequences captured by camcorder installed in moving platforms such as cars, motorcycle, bicycle, and power wheelchair. Then these image sequences are not suitable for watching with eyes or analyzing with computer. So in this thesis, we estimate the motion vector of image pixels to overcome the involuntary shaking and vibration problems of these image sequences.
There are three kinds of motion vector in image sequences. The first kind is from object with autonomous motion in the scene. The second kind is camera ego-motion made by moving platform. And the third kind is involuntary motion made by poor quality of roads or back shock absorber of moving platform. Our purpose is only compensating third kind of motion and keeping first and second kinds of motion in the stabilized image sequences as many as possible.
The stabilization system consists five step processes. First we use PMVFAST (predictive motion vector field adaptive search technique) to get motion vectors of every image block. Then we filter out unreliable block motion vectors by edge responses and SAD (sum of absolute difference) value. Then we estimate the first isometric transformation parameter by least-squares. Then we use the first isometric transformation parameter to estimate new block motion vector of and then compare new block motion vector with original ones to filter out the autonomous motion of moving object. Then we can estimate the isometric transformation parameter by least-squares again with remained block motion vectors. Then we analyze image motion vector to estimate the max involuntary shaking value as a threshold to determine compensation motion vector. Then we use the compensation motion vector to compensate involuntary motion and preserve camera ego-motion. So finally we keep the background stabilized in the output image sequences.
In our experiment, we have test five different moving platforms. The PSNR (peak signal to noise ratio) value of output image sequences is 20.85% larger than the original image sequences in average. The frame rate is about 30 frames per second.

關鍵字(中)

★ 影像穩定

關鍵字(英)

★ Image Stabilization

論文目次

摘要 i
Abstract iii
致謝 v
目錄 vi
圖目錄 viii
表目錄 xi
第一章緒論 1
1.1 研究動機 1
1.2 系統概述 2
1.3 論文架構 4
第二章相關研究 6
2.1 估測區域移動向量 6
2.2 篩除區域移動向量 10
2.3 估測影像移動向量 13
2.4 鏡頭移動補償 21
第三章區塊匹配與區塊移動向量篩除 26
3.1 估測區域移動向量 26
3.1.1 菱形搜尋演算法簡介 27
3.1.2 MVFAST演算法簡介 28
3.1.3 PMVFAST演算法簡介 29
3.1.4 分割影像區塊 31
3.2 篩除不可靠移動向量 32
3.3 篩除自主運動物體移動向量 35
3.4 影像移動向量估計 38
第四章移動向量分析與補償移動向量 40
4.1 分析影像移動向量 40
4.2 補償移動向量 42
第五章實驗 45
5.1 實驗環境 45
5.2 影像穩定結果 48
5.3 篩選方法的比較 56
第六章結論與未來展望 59
參考文獻 61

參考文獻

[1] Battiato, S., A. R. Bruna, and G. Puglisi, "A robust block-Based image/video registration approach for mobile imaging Devices," IEEE Trans. Multimedia, vol.12, no.7, pp.622-635, 2010.
[2] Canon, Lens image stabilization, in http://www.usa.canon.com/cusa/ consumer/standard_display/Lens_Advantage_IS
[3] Censi, A., A. Fusiello, and V. Roberto, "Image stabilization by features tracking," in Proc. Int. Conf. of Image Analysis and Processing, Kobe, Japan, Oct.24-28, 1999, pp.665-667.
[4] Chang, J.-Y., W.-F. Hu, M.-H. Cheng, and B.-S. Chang, "Digital image translational and rotational motion stabilization using optical flow technique," IEEE Trans. Consumer Electronics, vol.48, no.1, pp.108-115, 2002.
[5] Chen, C.-H., Y.-L. Kuo, T.-Y. Chen, and J.-R. Chen, "Real-time video stabilization based on motion compensation," in Proc. Fourth Int. Conf. Innovative Computing, Information and Control, Kaohsiung, Taiwan, Dec.7-9, 2009, pp.1495-1498.
[6] Chen, H. H., C.-K. Liang, Y.-C. Peng, and H.-A. Chang, "Integration of digital stabilizer with video codec for digital video cameras," IEEE Trans. Circuits and Systems for Video Technology, vol.17, no.7, pp.801-813, 2007.
[7] Duric, Z. and A. Rosenfeld, "Image sequence stabilization in real time," Real-Time Imaging, vol.2, pp.271-284, 1996.
[8] Egusa, Y., H. Akahori, A. Morimura, and N. Wakami, "An application of fuzzy set theory for an electronic video camera image stabilizer," IEEE Trans. Fuzzy Systems, vol.3, no.3, pp.351-356, 1995.
[9] Ertürk, S., "Real-time digital image stabilization using Kalman filters," Real-Time Imaging, vol.8, no.4, pp.317-328, 2002
[10] Ertürk, S., "Digital image stabilization with sub-image phase correlation based global motion estimation," IEEE Trans. Consumer Electronics, vol.49, no.4, pp.1320-1325, 2003.
[11] Hosur, P. I. and K.-K. Ma, "Motion Vector Field Adaptive Fast Motion Estimation," in Proc. 2nd Int. Conf. on Information Communications and Signal Processing, Singapore, Dec.7-10, 1999, pp.234-237
[12] Hsu, S.-C., S.-F. Liang, and C.-T. Lin, "A robust digital image stabilization technique based on inverse triangle method and background detection," IEEE Trans. Consumer Electronics, vol.51, no.2, pp.335-345, 2005.
[13] Jin, J. S., Z. Zhu, and G. Xu, "Digital video sequence stabilization based on 2.5-D motion estimation inertial motion ﬁltering," Real-Time Imaging, vol. 7, no.4, pp.357–365, 2001.
[14] Kao, W.-C., S.-H. Chen, and P.-Y. Hsiao, "Real-time image stabilization for digital video cameras," in Proc. IEEE Asia Pacific Conf. Circuits and Systems, Singapore, Dec.4-7, 2006, pp.1651-1654.
[15] Ko, S.-J., S.-H. Lee, S.-W. Jeon, and E.-S. Kang, "Fast digital image stabilizer based on gray-coded bit-plane matching," IEEE Trans. Consumer Electronics, vol.45, no.3, pp.598-603, 1999.
[16] Ko, S.-J., S.-H. Lee, and K.-H. Lee, "Digital image stabilizing algorithms based on bit-plane matching," in Proc. Int. Conf. Consumer Electronics, Los Angeles, CA, Jun.2-4, 1998, pp.126-127.
[17] Liang, Y.-M., H.-R. Tyan, S.-L. Chang, H.-Y. M. Liao, and S.-W. Chen, "Video Stabilization for a camcorder mounted on a moving vehicle", IEEE Trans. on Vehicular Technology, vol.53, no.6, pp.1636-1648, 2004.
[18] Litvin, A., J. Konrad, and W. C. Karl, "Probabilistic video stabilization using Kalman filtering and mosaicking," in Proc. SPIE Conf. Electronic Imaging, Santa Clara, CA, Jan.21-24, 2003, pp.663-674.
[19] Morimoto, C. and R. Chellappa, "Evaluation of image stabilization algorithms," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Seattle, WA, May.12-15, 1998, pp.2789-2792.
[20] Morimoto, C. and R. Chellappa, "Fast electronic digital image stabilization for off-road navigation," Real-Time Imaging, vol.2, no.5, pp.285-296, 1996.
[21] Oshima, M., T. Hayashi, S. Fujioka, T. Inaji, H. Mitani, J. Kajino, K. Ikeda, and K. Komoda, "VHS camcorder with electronic image stabilizer," IEEE Trans. Consumer Electronics, vol.35, no.4, pp.749-758, 1989.
[22] Paik, J. k., Y. C. Park, and D. W. Kim, "An adaptive motion decision system for digital image stabilizer based on edge pattern matching," IEEE Trans. Consumer Electronics, vol.38, no.3, pp.607-616, 1992.
[23] Soldatov, S., K. Strelnikov, and D. Vatolin, "Low complexity global motion estimation from block motion vectors," in Proc. Spring Conf. Computer Graphics, Budmerice, Slovakia, Apr.20-22, 2006, pp.1-8.
[24] Song, C., H. Zhao, W. Jing and H. Zhu, "Robust video stabilization based on particle filtering with weighted feature points," IEEE Trans. Consumer Electronics, vol.58, no.2, pp.570-577, 2012.
[25] Tang, C., X. Yang, L. Chen, and G. Zhai, "A fast video stabilization algorithm based on block matching and edge completion," in Proc. IEEE 13th Int. Workshop Multimedia Signal Processing, Hangzhou, China, Oct.17-19, 2011, pp.1-5.
[26] Tourapis, A. M., O. C. Au, M. L. Liou, "Predictive motion vector field adaptive search technique (PMVFAST) - enhancing block based motion estimation," in In The Optimitzation MEL 1.0, ISO/IEC JTC1/SC29/WG11 MPEG2000/M6194, pp.883-892, 2001.
[27] Uomori, K., A. Morimura, H. Ishii, T. Sakaguchi, and Y. Kitamura, "Automatic image stabilizing system by full-digital signal processing," IEEE Trans. Consumer Electronics, vol.36, no.3, pp.510-519, 1990.
[28] Yang, S. H., F. M. Jheng, and Y. C. Cheng, "Two-dimensional adaptive image stabilization," Electronics Letters, vol.43, no.8, p.446, 2007.
[29] Yeh, Y.-M., S.-J. Wang, and H.-C. Chiang, "A digital camcorder image stabilizer based on gray coded bit-plane block matching," in Proc. The 13th IPPR Conf. on Computer Vision Graphics and Image Processing, Taipei, Taiwan, Jul.26-27, 2000, pp.244-251.
[30] Zhu, J. and B. Guo, "A panoramic image stabilization system based on block motion iteration," in Proc. 8th Int. Conf. on Intelligent Systems Design and Application, Kaohsiung, Taiwan, Nov.26-28. 2008, pp.473-477.
[31] Zhu, S. and K.-K. Ma, "A new diamond search algorithm for fast block-matching motion estimation," IEEE Trans. Image Processing, vol.9, no.2, pp.287-290, 2000.

指導教授

曾定章(Din-Chang Tseng)

審核日期

2013-7-25

推文