以高品質合成視角為導向之快速深度視訊編碼模式決策

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：24

、訪客IP：3.16.70.101

姓名

呂志宏(Chih-Hung Lu) 查詢紙本館藏

畢業系所

通訊工程學系

論文名稱

以高品質合成視角為導向之快速深度視訊編碼模式決策
(View Synthesis Oriented Fast Mode Decision for Depth Video Coding)

相關論文

★ 應用於車內視訊之光線適應性視訊壓縮編碼器設計	★ 以粒子濾波法為基礎之改良式頭部追蹤系統
★ 應用於空間與CGS可調性視訊編碼器之快速模式決策演算法	★ 應用於人臉表情辨識之強健式主動外觀模型搜尋演算法
★ 結合Epipolar Geometry為基礎之視角間預測與快速畫面間預測方向決策之多視角視訊編碼	★ 基於改良式可信度傳遞於同質區域之立體視覺匹配演算法
★ 以階層式Boosting演算法為基礎之棒球軌跡辨識	★ 多視角視訊編碼之快速參考畫面方向決策
★ 以線上統計為基礎應用於CGS可調式編碼器之快速模式決策	★ 適用於唇形辨識之改良式主動形狀模型匹配演算法
★ 以運動補償模型為基礎之移動式平台物件追蹤	★ 基於匹配代價之非對稱式立體匹配遮蔽偵測
★ 以動量為基礎之快速多視角視訊編碼模式決策	★ 應用於地點影像辨識之快速局部L-SVMs群體分類器
★ 以運動補償模型為基礎之移動式相機多物件追蹤	★ 基於匹配代價曲線特徵之遮蔽偵測之研究

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

利用多視角深度視訊壓縮技術可將3D視訊進行有效率的壓縮，但運算複雜度高，因此，如何達成高品質合成視角，同時有效降低編碼計算複雜度為一個重要的議題。由於色彩視訊與其深度視訊編碼具關聯性，本論文提出以高品質合成視角為導向之快速深度視訊編碼模式決策演算法，共包含二個部分，第一部分為快速模式決策方案，由於深度視訊之物件與色彩視訊之物件的運動行為十分相似，而深度視訊又具有大量平滑區域，因此本論文參考色彩視訊中同位置的最佳編碼模式，以及深度視訊畫面內上方已編碼區塊的最佳編碼模式，深度畫面之複雜度，決定候選編碼模式。由於深度視訊須使用於產生虛擬合成視角視訊，因此，本論文之第二部分決定以達成高品質合成視角視訊為目標，參考色彩影像中同位置區塊之水平方向的灰階變化，判斷是否為易造成合成視角影像失真的區域，再決定合適的RD代價函式，以選擇最佳編碼模式，提高合成視角的品質。由修改JMVC 6.0.3編碼軟體之實驗結果顯示，本論文所提出之快速演算法，平均可節省約53.08%，BDBR平均上升約1.12%，且合成視角之BDPSNR幾乎無改變。

摘要(英)

3D video data can be compressed efficiency by using multi-view video plus depth (MVD) coding technology, but the computational complexity is pretty high. In order to accelerate the encoding process, the correlation between a texture video and its depth video should be explored. Moreover, how to achieve the good synthesized viewing quality is an important issue. In this thesis, we propose a view synthesis oriented fast mode decision for depth video coding. The algorithm is composed of two parts. The first part is a fast mode decision algorithm for depth video coding, which considers that object motion in texture video and depth video is similar, and depth videos has many smooth regions. We refer to the optimal mode of the co-located MB in the texture video, and the upper encoded MB in the depth video, and the complexity of the current MB in depth video. Finally, the candidates for mode decision are derived for fast depth video coding. In the second part, to achieve high synthesized viewing quality, we check the variation of intensity along the horizontal direction in the texture video. Then, an appropriate RD cost function is selected. Our experimental results show that the proposed scheme reduces up to 53.08% of encoding time with 1.12 dB BDBR increment and almost no BDPSNR loss in virtual views compared with the original JMVC 6.0.3.

關鍵字(中)

★ 深度視訊編碼
★ 合成視角
★ 快速模式決策

關鍵字(英)

★ depth video coding
★ fast mode decision
★ view synthesis

論文目次

摘要 I
Abstract II
致謝 IV
圖目錄 VIII
表目錄 XI
第一章緒論 1
1.1 前言 1
1.2 研究動機 2
1.3 研究方法 2
1.4 論文架構 3
第二章深度視訊編碼器之介紹 4
2.1 單視角視訊編碼器之介紹 4
2.1.1最佳預測模式決策 5
2.2 多視角視訊編碼器之介紹 7
2.3 深度視訊編碼器之現況介紹 10
2.3.1 3D視訊編碼器架構 10
2.3.2 增進深度視訊編碼效能之3D運動估測方案 13
2.4合成視角導向之失真函式(Distortion Function) 15
2.5 總結 16
第三章深度視訊編碼之快速演算法現況 17
3.1以Depth video資訊為基礎之快速深度視訊編碼演算法 17
3.2以Texture資訊為基礎之快速深度視訊編碼演算法 21
3.2.1 快速運動估測演算法 21
3.2.2 快速模式決策演算法 22
3.3以高品質View Synthesis為導向之深度視訊編碼演算法 23
3.4 總結 24
第四章本論文提出之以高品質合成視角為導向快速模式決策演算法 25
4.1本論文採用之深度視訊編碼預測架構 25
4.2以Texture與Depth資訊為基礎之快速模式決策演算法 26
4.2.1最佳編碼模式之統計分析 27
4.2.2深度畫面變異數之統計分析 35
4.2.3本論文提出之以Texture與Depth資訊為基礎之深度視訊編碼快速模式決策演算法(Fast Mode Decision Using Texture and Depth Information for Depth Video Coding) 38
4.3以視角合成品質為導向之RD代價函式(View Synthesis Oriented RD Cost Function) 41
4.3.1合成視角導向之失真函式 41
4.3.2本論文提出之以視角合成品質為導向之RD cost函式決策 50
4.4結合以Texture與Depth資訊及視角合成品質為導向的RD Cost函式之快速模式決策演算法 51
4.5 總結 52
第五章實驗結果與分析 53
5.1 實驗環境與參數設定 53
5.2以Texture與Depth資訊為基礎之快速模式決策演算法之實驗結果分析 55
5.3以高品質合成視角為導向之快速深度視訊編碼模式決策演算法之實驗結果分析 60
5.4 總結 78
第六章結論與未來展望 79
References 80
List of Symbols 84

參考文獻

[1] T. Wiegand, G. Sullivan, G. Bjøntegaard, and A. Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 560-576, July 2003.
[2] Y.-S. Ho and K.-J. Oh, “Overview of multi-view video coding,” in Proceedings of IEEE International Workshop on Systems, Signals and Image Processing, pp. 5-12, June 2007.
[3] ISO/IEC MPEG & ITU-T VCEG, “Multi-view Video plus Depth (MVD) Format for Advanced 3D Video System,” Doc. JVT-W-100, Apr. 2007.
[4] L. Onural, A. Smolic, and T. Sikora, “An overview of a new European consortium: integrated three-dimensional television—capture, transmission and display (3DTV),” in Proceedings of European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies, pp. 25-26, November 2004.
[5] A. Smolic, K. Müller, P. Merkle, C. Fehn, P. Kauff, P. Eisert, and T. Wiegand, “3D video and free viewpoint video—technologies, applications and MPEG standards,” in Proceedings of IEEE International Conference on Multimedia and Exposition, pp. 2161-2164, July 2006.
[6] T. Wiegand, H. Schwtarz, A. Joch, F. Kossentini, and G. J. Sullivan, “Rate-constrained coder control and comparison of video coding standards,” IEEE Transactions on Circuits and Systems for Video Technology ,Vol. 13, No. 7, pp. 688-703, July 2003.
[7] ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, “Joint multiview video model (JMVM) 1.0,” JVT-T209, Klagenfurt, Austria, July 2006.
[8] ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, “JMVC 1.0 software,” JVT-AA212, Geneva, April 2008.
[9] H. Schwarz, D. Marpe, and T. Wiegand, “Analysis of hierarchical B pictures and MCTF,” in Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1929-1932, July 2006.
[10] P. Merkle, A. Smolic, K. M‥uller, and T. Wiegand, “Efficient prediction structures for multiview video coding,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 17, No. 11, pp. 1461-1473, November 2007.
[11] ISO/IEC JTC1/SC29/WG11, “Overview of 3D video coding,” Doc. N9784, May 2008.
[12] ISO/IEC JTC1/SC29/WG11, “Test model under consideration for AVC-based 3D video coding (3DV-ATM),” Doc. N12349, Dec. 2011.
[13] ISO/IEC JTC1/SC29/WG11, “Test model under consideration for HEVC based 3D video coding,” Doc. M12350, Nov. 2011.
[14] ISO/IEC JTC1/SC29/WG11, “Applications and requirements on 3D video coding, “ Doc. N12035, March 2011.
[15]K. Müller, P. Merkle, G. Tech, and T. Wiegand, “3D video formats and coding methods,” in Proceedings of IEEE International Conference on Image Processing, pp.2389-2392, Sept. 2010.
[16] ISO/IEC JTC1/SC29/WG11, “Report on experimental framework for 3D video coding,” Doc. N11631, Oct. 2010.
[17] D. V. S. X. De Silva, W. A. C. Fernando, and S. L. P. Yasakethu, “Object based coding of the depth maps for 3D video coding,” IEEE Transactions on Consumer Electronics, Vol. 55, No. 3 pp.1699-1706, Sept. 2009.
[18] P. Lai, A. Ortega, C. Dorea, P. Yin, and C. Gomila, “Improving view rendering quality and coding efficiency by suppressing compression artifacts in depth-image coding,” in Proceedings of Visual Communications and Image Processing, Jan. 2009.
[19] M. Wang, C. Liu, T. Zhang, X. Jin, and S. Goto, “Region of interest oriented fast mode decision for depth map coding in DIBR,” in Proceedings of IEEE International Colloquium on Signal Processing and its Applications, March 2011.
[20] Z. Peng, M. Yu, G. Jiang, Y. Si and F. Chen, “Virtual view synthesis oriented fast depth video encoding algorithm,” in Proceedings of IEEE International Conference on Industrial and Information System, Sept. 2010.
[21] D.-H. Yoon and Y.-S. Ho, “Fast mode decision algorithm for depth coding in 3D video systems using H.264/AVC,” Lecture Notes in Computer Science, Vol. 7088, pp. 25-35, Nov. 2011.
[22] Y. H. Lin and J. L. Wu, “A depth information based fast mode decision algorithm for color plus depth-map 3D videos,” IEEE Transactions on Broadcasting, Vol. 57, No. 7, pp. 542-550, June. 2011.
[23] Q. Zhang, P. An, Y. Zhang, L. Shen, and Z. Zhang, “Low complexity multiview video plus depth coding,” IEEE Transactions on Consumer Electronics, Vol. 57, No. 7, pp. 1857-1865, Nov. 2011.
[24] H. Oh and Y.-S. Ho, “H.264-based depth map sequence coding using motion information of corresponding texture video,” Lecture Notes in Computer Science, Vol. 4319, pp. 898-907, Dev. 2006.
[25] M. Naccari, F. Jaureguizar, J. Cabrera, E. Pereira, and N. Garcia, “A new fast motion estimation and mode decision algorithm for h.264 depth maps encoding in free viewpoint TV,” in Proceedings of IEEE International Conference on Image Processing, pp.1013-1016, Sept. 2011.
[26] B. Zhu, G. Jiang, Y. Zhang, Z. Peng, and M. Yu, “View synthesis oriented depth map coding algorithm,“ in Proceedings of IEEE Asia-Pacific Conference on Information Processing, July 2009.
[27] W.-S. Kim, A. Ortega, P. Lai, T. Dong, and C. Gomila, “Depth map distortion analysis for view rendering and depth coding,” in Proceedings of IEEE International Conference on Image Processing, pp.721-724, Nov. 2009.
[28] B. T. Oh, J. Lee, and D.-S. Park, “Depth map coding based on synthesized view distortion function,” IEEE Journal of Selected Topics in Signal Processing, Vol. 5, No. 7, pp. 1344-1352, Nov. 2011.
[29] H. Yuan, Y. Chang, J. Huo, F. Yang, and Z. Lu, “Model-based joint bit allocation between texture videos and depth maps for 3-D video coding,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 21, No. 7, pp. 485-497, April. 2011.
[30] ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, “Common test conditions for multiview video coding,” JVT-T207, Klagenfurt, Austria, July 2006.
[31] ISO/IEC JTC1/SC29/WG11, “View synthesis algorithm in view synthesis reference software 2.0(VSRS2.0),” Doc. M16090, Feb. 2009.
[32] G. Bjontegaard, “Calculation of average PSNR difference between RD-curves,” ITU-T Q6/SG16, Doc. VCEG-M33, April 2001.
[33] F. Pereira and T. Ebrahimi, The MPEG-4 Book. Upper Saddle River, NJ: Prentice-Hall, 2002, pp. 669-675.

指導教授

唐之瑋(Chih-Wei Tang)

審核日期

2012-7-18

推文