摘要(英) |
Since 2015, JVET (Joint Video Exploration Team) has started to discuss the latest video compression standard H.266/VVC (Versatile Video Coding). Compared with the previous generation standard, the CU coding structure of QTMT (Quad Tree with nested Multi-type Tree coding block structure) is adopted. It supports square and rectangular coded blocks from a maximum of 128×128 to a minimum of 4×4. This structure can better subdivide the video texture and improve the coding quality, but such a complex structure will also be accompanied by a lot of time-consuming algorithms, so how to use fast algorithms to balance the coding quality and time-consuming will be the focus of this paper the goal.
This paper proposes a fast MT algorithm based on feature analysis, which can reduce the modes that can be used in BT partition and TT partition respectively. Among them, the judgment structure of binary tree and tri-tree partition is the same. There are three parts, the establishment and analysis of feature maps, the establishment of traditional classification methods and neural network models. First, a feature map based on the MT unit partition is established, and the feature map is used to generate a feature data set of the coding partition. Then, the traditional analysis method is used to find the best judgment formula, and judges the characteristic group with significant data. If the feature group has slight changes, the feature map will enter the proposed convolutional neural network model for classification. |
參考文獻 |
[1] L. S. H. Yang, X. Dong, Q. Ding, P. An and G. Jiang, "Low-Complexity CTU Partition Structure Decision and Fast Intra Mode Decision for Versatile Video Coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 6, Jun. 2020.
[2] J. Chen, Y. Ye, and and S.- H. Kim, "Algorithm Description for Versatile Video Coding and Test Model 11 (VTM 11)," Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, Doc JVETT2002-v2, Oct. 2020.
[3] VTM Reference Software. Available: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM
[4] JEM Reference Software. Available: https://jvet.hhi.fraunhofer.de/svn/svn_HMJEMSoftware/
[5] E. A. J. Chen, G. J. Sullivan, J. R. Ohm, and J. Boyce, "Algorithm Description of Joint Exploration Test Model 4 (JEM4)," Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 3rd Meeting, Doc. JVET-C1001, May 2016.
[6] B. Bross et al., "Overview of the Versatile Video Coding (VVC) Standard and its Applications," IEEE Transactions on Circuits and Systems for Video Technology ( Early Access ), Aug. 2021.
[7] J.-A. C. Y. Fan, H. Sun, J. Katto, and M.-E Jing, "A Fast QTMT Partition Decision Strategy for VVC Intra Prediction," IEEE Access, Jun. 2020.
[8] J. R. O. G. J. Sullivan, W. J. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) Standard," IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, pp. 1649-1668, Dec. 2012.
[9] L. Zhao et al., "Wide Angular Intra Prediction for Versatile Video Coding," presented at the Data Compression Conference (DCC), Mar., 2019.
[10] Y-J Chang et al., "Multiple Reference Line Coding for Most Probable Modes in Intra Prediction," presented at the Data Compression Conference (DCC), Mar., 2019.
[11] S. D.-L. Hernández et al., "An Intra Subpartition Coding Mode for VVC," presented at the IEEE International Conference on Image Processing (ICIP), Sept., 2019.
[12] X. Zhao et al., "Transform Coding in the VVC Standard," IEEE Transactions on Circuits and Systems for Video Technology ( Early Access ), Jun. 2021.
[13] F. Bossen, J. Boyce, X. Li, a. V. Seregin, and K. Sühring, "VTM Common Test Conditions and Software Reference Configurations for SDR Video," Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29-Doc. JVET-T2010-v1, 2020.
[14] S.-H. Park and a. J.-W. Kang, "Fast Multi-type Tree Partitioning for Versatile Video Coding Using a Lightweight Neural Network," IEEE Transactions on Multimedia ( Early Access ), Dec. 2020.
[15] M. X. T. Li, and X. Deng, "A Deep Convolutional Neural Network Approach for Complexity Reduction on Intra-mode HEVC," presented at the IEEE International Conference on Multimedia and Expo (ICME), Jul., 2017.
[16] Kodak Lossless True Color Image Suite. Available: http://r0k.us/graphics/kodak/
[17] Z. L. G. Huang, L. V. D. Maaten, and K. Q. Weinberger, "Densely Connected Convolutional Networks," presented at the International Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
[18] Z. Z. K. He, S. Ren, and J. Sunw, "Deep Residual Learning for Image Recognition," presented at the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun., 2016.
[19] G. Bjontegaard, "Calculation of Average PSNR Difference Between RDcurves," ITU-T Q.6/SG16 VCEG 13th Meeting, Doc. VCEG-M33, 2001. |