在本論文中，我們探討H.264的編碼核心技術，H.264編碼器可以對每一個Marcoblock選擇不同的編碼模式，本論文中，我們將探討如何利用Rate-Distortion Optimization的觀念。論文中會介紹如何用Rate-Distortion Optimization來選擇最佳編碼模式。由於多重編碼模式和其他工具的引進，使得H.264比以往視訊標準有更好的編碼效率；但相對的也要付出更多的計算資源，以獲得更好的視訊品質。 由於各種編碼模式出現的機率不同，我們主要是根據Marcoblock mode 出現頻率的不同而提出模式選擇策略，並且提供一系列的簡化準則：如Dynamic mode checking、 early termination、 pseudo motion vector等；根據這些準則，期望能在付出一點畫質損失的代價而增加編碼效率。 In this thesis, we study the core of the encoding process for H.264. To improve the performance of H.264 encoding, we allow H.264 encoder to select different decision modes for variant encoding process in each marcoblock. Based on the multiple encoding modes and more developed tools, H.264 has better coding efficiency than the previous video standard; however, such an improvement on H.264 needs more computation resources to get better video quality. In this thesis, we propose the mode selection strategy, early termination criterion, fast intra/inter mode switch, dynamic mode checking, and pseudo motion vector prediction to speed up the encoding. The mode selection strategy is the core of this study. The selection criterion is based on Rate-Distortion Optimization, and the strategy is based on the principle of probability distribution. In experiments, we make a comparison between the standard method and proposed method and achieve the balance between the image quality and the encoding speed.
