結合多圖像的光流估測法及其應用

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：5

、訪客IP：18.119.123.252

姓名

王嘉銘(Chia-Ming Wang) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

結合多圖像的光流估測法及其應用
(Multi-Frame Optical Flow Estimation and its Applications)

相關論文

★ 使用視位與語音生物特徵作即時線上身分辨識	★ 以影像為基礎之SMD包裝料帶對位系統
★ 手持式行動裝置內容偽變造偵測暨刪除內容資料復原的研究	★ 基於SIFT演算法進行車牌認證
★ 基於動態線性決策函數之區域圖樣特徵於人臉辨識應用	★ 基於GPU的SAR資料庫模擬器：SAR回波訊號與影像資料庫平行化架構 (PASSED)
★ 利用掌紋作個人身份之確認	★ 利用色彩統計與鏡頭運鏡方式作視訊索引
★ 利用欄位群聚特徵和四個方向相鄰樹作表格文件分類	★ 筆劃特徵用於離線中文字的辨認
★ 利用可調式區塊比對並結合多圖像資訊之影像運動向量估測	★ 彩色影像分析及其應用於色彩量化影像搜尋及人臉偵測
★ 中英文名片商標的擷取及辨識	★ 利用虛筆資訊特徵作中文簽名確認
★ 基於三角幾何學及顏色特徵作人臉偵測、人臉角度分類與人臉辨識	★ 一個以膚色為基礎之互補人臉偵測策略

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

光流資訊在電腦視覺與圖形識別領域中，是連續影像的一種重要的對應資
訊。有別於多數的傳統光流演算法僅使用於前後兩張影像，在本篇論文中，我們
提出了一個結合多張影像的新式光流估測法，此法具有下列特徵：(1)以微分為
基礎，不受區塊比對法的子像素限制；(2)以特徵點為基礎，可以在影像各點獨
立運作；(3)時間軸的資訊加入使得歧義對應的減少，因此也適用於以光流場為
基礎的應用。在實驗結果中，我們驗證了這個方法在整體光流場而言，具有較少
的歧義對應及較低的平均估測誤差。若是在好的特徵點上，估測值會更為準確。
為了進一步驗證我們所提出的光流估測法的實用性及有效性，在本論文中，
我們將此光流估測法應用在兩個實際問題上。第一，在智慧型交通運輸系統中，
藉由影像中車輛特徵點的光流估測值，投影至道路平面，可以用來估測車輛的真
實速度。實驗結果顯示在特徵點準確的光流估測之下，可以得到與車輛真實速度
接近的估測速度。第二，我們提出了一套基於運動模式的真假臉辨認系統。藉由
觀察真人臉與照片臉的光流場分布差異，我們提出了基於線性區分分析與直方統
計圖比對兩種不同的辨識方法來區分照片臉的偽裝。實驗結果顯示，利用我們所
提出的光流估測法，可以在真臉運動與假臉運動之間產生顯著的差異，並可產生
準確的辦識率。最後，我們對於提出的多圖像光流估測法作出結論並提出未來可
以改進的方向。

摘要(英)

Optical flow reveals important correspondence information in the fields of computer vision and pattern recognition. Different from the traditional methods which only use two successive frames, we propose a novel optical flow method by integrating multiple frames. This method has the following characteristics: (1) It is a gradient-based method so that it will not be constrained by the subpixel matching problem, (2) It is a feature-based method so that it can estimate independently of each image point, (3) The reduction of ambiguous matching because of the temporal information included, so that it can also be adopted in the applications based on the dense optical flow field. In the experimental results, we have verified that the
proposed method will produce less ambiguous matching and estimation error. Moreover, the estimation results will be more accurate at good feature points.
To further verify the practicability and effectiveness of the proposed optical flow method, we apply this method to two practical problems in this dissertation. First, in
an intelligent transportation system, the real vehicle speed can be estimated by optical flow at feature points through an image-road mapping. Experimental results show that if optical flow can be successfully and accurately estimated, the speed estimationresults will be close to the real speed. Second, we propose a system to distinguish true faces and face photos based on their motion models. By observing the difference of both models, an LDA-based method and a histogram-based method are proposed to
detect the falsification by using face photo. Experimental results demonstrate that if the multi-frame optical flow method is adopted, the motion difference between true
face and face photo is obvious so that the satisfactory verification rate can be obtained. Finally, concluding remarks of the proposed method are given and the improvement
methods for future works are listed.

關鍵字(中)

關鍵字(英)

★ true face/face photo discrimination
★ vehicle speed estimation
★ multi-frame optical flow estimation

論文目次

ABSTRACT................................................................................................................... i
CONTENTS...................................................................................................................v
LIST OF FIGURES ................................................................................................... viii
LIST OF TABLES .........................................................................................................x
CHAPTER 1 INTRODUCTOIN ...................................................................................1
1.1 Motion Estimation and Optical Flow...............................................................1
1.2 Application to Vehicle Speed Estimation.........................................................4
1.3 Application to True Face and Face Photo Discrimination ...............................5
1.4 Organization of the Dissertation ......................................................................6
CHAPTER 2 MULTI-FRAME OPTICAL FLOW ESTIMATION...............................7
2.1 Previous Works of Optical Flow Estimation....................................................8
2.1.1 Computational Method 1: the Gradient-Based Approach.....................8
2.1.2 Computational Method 2: the Matching-Based Approach .................11
2.1.3 Discussion of Flow Field Density: Feature-Based vs. Field-Based....12
2.1.4 Discussion of Frame Number: Two Frames vs. Multiple Frames ......13
2.2 Multi-Frame Optical Flow Estimation...........................................................18
2.3 Weighted Assignment in Spatial and Temporal Domain ...............................25
2.4 Experimental Results .....................................................................................26
2.4.1 Qualitative Comparison ......................................................................27
2.4.2 Quantitative Comparison ....................................................................29
2.4.3 Analysis of the Computational Cost ...................................................33
2.5 Conclusions....................................................................................................34
CHAPTER 3 ESTIMATION OF VEHICLE SPEED BASED ON MULTI-FRAME
OPTICAL FLOW ........................................................................................................36
3.1 Introduction to Vehicle Speed Estimation......................................................37
3.1.1 Preliminary Works ..............................................................................40
3.2 Vehicle Detection ...........................................................................................44
3.2.1 Primary Background Construction .....................................................44
3.2.2 False Detection Removal ....................................................................47
3.2.3 Feature Points Selection of the Detected Vehicles..............................49
3.3 Image Motion Estimation ..............................................................................51
3.4 Transforming from Image Motion to Real Vehicle Speed .............................52
3.5 Experimental Results .....................................................................................55
3.6 Conclusions....................................................................................................61
CHAPTER 4 DISTINGUISHING FALSIFICATION OF HUMAN FACE BY FACE
PHOTO BASED ON OPTICAL FLOW INFORMATION.........................................64
4.1 Introduction....................................................................................................65
4.1.1 Preliminary Studies.............................................................................66
4.2 The LDA-Based Approach ............................................................................71
4.2.1 System Overview................................................................................71
4.2.2 Optical Flow Estimation of True Face and Face Photo ......................73
4.2.3 The Verification Method .....................................................................75
4.2.4 Experimental Results ..........................................................................78
4.2.5 Discussions .........................................................................................87
4.3 The Histogram Based Approach ....................................................................88
4.3.1 Introduction.........................................................................................88
4.3.2 Polar Data Transformation of Optical Flow........................................91
4.3.3 Data Classification and Matching.......................................................92
4.3.4 Experimental Results ..........................................................................94
4.3.5 Discussions .......................................................................................102
4.4 Comparison of LDA-Based and Histogram-Based Approaches..................103
4.5 Other Falsification Objects ..........................................................................105
4.6 Conclusions..................................................................................................109
CHAPTER 5 CONCLUSIONS .................................................................................111
5.1 Concluding Remarks....................................................................................111
5.2 Future Works................................................................................................113
REFRENCES.............................................................................................................115
APPENDIX A LINEAR MOTION MODEL IN MULTI-FRAME OPTICAL FLOW
ESTIMATION............................................................................................................124
APPENDIX B ADAPTIVE SPATIAL AND TEMPORAL INFORMATION
SELECTION IN MULTI-FRAME OPTICAL FLOW ESTIMATION.....................126

參考文獻

[1] P. Anandan, “A Computational Framework and an Algorithm for the Measurement of Visual Motion”, International Journal of Computer Vision, Vol. 2, pp.283-310, 1989.
[2] S. Baker and I. Matthews, “Lucas-Kanade 20 Years On: A Unifying Framework”, International Journal of Computer Vision, Vol. 56, pp. 221-255, 2004.
[3] J. L. Barron, D. J. Fleet, and S. S. Beauchemin, “Performance of Optical Flow Techniques”, International Journal of Computer Vision, Vol. 12, 1994, pp.43-77.
[4] F. Bartolini and A. Piva, “Median Based Relaxation of Smoothness Constraints in Optical Flow Computation”, Pattern Recognition Letters, Vol. 18, pp. 649-655, 1997.
[5] J. R. Bergen, P. Anandan, K. J. Hanna and R. Hingorani, “Hierarchical Model-Based Motion Estimation”, in European Conference on Computer Vision, pp.237-252, 1992.
[6] J. R. Bergen, P. J. Burt, R. Hingorani, and S. Peleg, “A three-frame algorithm for estimating two-component image motion”, IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 14, pp. 886-895, 1992.
[7] M. J. Black, P. Anandan, “The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields”, Computer Vision and Image Understanding, Vol. 63, pp. 75-104, 1996.
[8] J.Y. Bouguet, “ Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm,” Intel Corporation Microprocessor Research Labs, 1999.
[9] T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, “High Accuracy Optical Flow Estimation Based on a Theory for Warping”, Proceedings of 8th European Conference on Computer Vision, Vol. 4, pp. 25-36, 2004.
[10] A. Bruhn, J. Weickert, T. Kohlberger, and C. Schnorr, “A Multigrid Platform for Real-Time Motion Computation with Discontinuity-Preserving Variation Methods”, International Journal of Computer Vision, Vol. 70, pp.257-277, 2006.
[11] A. Bruhn, J. Weickert and C. Schnörr, “Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow Methods”, International Journal of Computer Vision, Vol. 61, pp. 211-231, 2005.
[12] R. Brunelli and O. Mich, “Histogram Analysis for Image Retreival”, Pattern Recognition, Vol. 34, pp.1625-1637, 2001.
[13] J. H. Chen, C. S. Chen and Y. S. Chen, “Fast Algorithm for Robust Template Matching with M-estimators”, IEEE trans. on Signal Processing, Vol. 51, no. 1, pp. 230-243, 2003.
[14] L. F. Chen, H. Y. Mark Liao, and J. C. Lin, “Person Identification using facial motion”, in Proceedings of IEEE international Conference of Image Proceeding, vol. 2, pp. 7-10, Oct. 2001.
[15] Y. S. Chen, Y. P. Hung and C. S. Fuh, “Fast Block Matching Algorithm Based on Winner-Update Strategy”, IEEE trans. on Image Processing, Vol. 10, no. 8, pp. p1212-1222, 2001.
[16] Y. Cho and J. Rice, “Estimating Velocity Fields on a Freeway from Low Resolution Video”, IEEE Transaction on Intelligent Transportation Systems, 2005.
[17] R. O. Duda, P. E. Hart and D. G. Stork, Pattern Classification, Wiley-Interscience, Second Edition, 2001.
[18] A. Elgammal, D. Harwood, L. S. Davis, “Non-parametric Model for Background Subtraction” IEEE 7th ICCV, Kerkyra, Greece, September, 1999.
[19] A. Giachetti, M. Campani and V. Torre, “The Use of Optical Flow for Road Navigation”, IEEE trans. on Robotics and Automation, Vol. 14, pp.34-48
[20] R. C. Gonzalez and R. E. Woods, Digital Image Processing, Addison-Wesley, 2002.
[21] J. Hafner, H. S. Sawhney, W. Equitz, M. Flickner, and W. Niblack, “Efficient color histogram indexing for quadratic form distance functions”, IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 17, pp.729–736, July 1995.
[22] R. M. Haralick and L. G. Shapiro, Computer and Robot Vision (Vol. I,II), Prentice Hall, 1992.
[23] X. He and N. Yung, “A Novel Algorithm for Estimating Vehicle Speed from Two Consecutive Images”, IEEE Workshop on Applications of Computer Vision, 2007.
[24] T. Hirayama, K. F. Lew, Y. Iwai and M. Yachida, “Face Detection and Facial Personation Prevention by Using Infrared Images”, SICE Annual Conference in Sapporo, Japan, Aug. 2004.
[25] B. K. P. Horn, Robot Vision, MIT Press, 1986.
[26] B. K. P. Horn, and B. G. Schunck, “Determining Optical Flow”, Artificial Intelligence, Vol. 17, pp.185-203, 1981.
[27] T. Horprasert, D. Harwood, L. S. Davis, “A Statistical Approach for Real-time Robust Background Subtraction and Shadow Detection”. Proc. IEEE ICCV FRAME-RATE Workshop, Kerkyra, Greece, pp.1-19, 1999.
[28] M. Irani, “Multi-frame Correspondence Estimation Using Subspace Constraints”, International Journal of Computer Vision, Vol. 48, pp.173-194, 2002.
[29] M. Irani, B. Rousso and S. Peleg, “Computing Occluding and Transparent Motions”, International Journal of Computer Vision, Vol. 12, pp.5-16, 1994.
[30] A. K. Jain, and A. Vailaya, “Image retrieval using color and shape”, Pattern Recognition, Vol. 29, No. 8, pp.1233-1244, 1996.
[31] F. D. Jou, K. C. Fan and Y. L. Chang, “Efficient matching of large-size histograms”, Pattern Recognition Letters, vol. 25, issue: 3, pp. 277-286, 2004.
[32] P. Kruizina and N. Petkov, “Optical flow applied to person identification”, in Proceedings of the EUROSIM Conference on Massively Parallel Processing Applications and Development, pp. 871-878, Netherlands, June 1994.
[33] S.H. Lai and B.C. Vemuri, “Robust and efficient computation of optical flow”, International Journal of Computer Vision, Vol. 29, pp. 87-105, 1998.
[34] Y. P. Li, J. Kittler, and J. Matas, “On matching scores of LDA-based face verification.” In M. Mirmehdi and B. Thomas, editors, Proc British Machine Vision Conference BMVC2000, vol. 1, pp. 42-51, London, UK, September 2000. University of Bristol, British Machine Vision Association.
[35] X. Liu, T. Chen, and B. V. K.V. Kumar, “On modeling variations for face authentication”, in Proceedings of Fifth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 369-374, May 2002.
[36] J. Luetin and G. Maitre, “Evaluation Protocol for the extended M2VTS Database(XM2VTSDB),” IDIAP-COM 05, IDIAP, 1998.
[37] B. D. Lucas and T. Kanade, “An iterative image registration technique with an application to stereo vision”, Image Understanding Workshop, 1981, pp.121-130.
[38] W. N. Martin and Jagdishkumar Keshoram Aggarwal, Motion Unserstanding: Robot and Human Vision, Springer, 1988.
[39] J. Matas, M. Hamouz, K. Jonsson, J. Kittler, Y. Li, C. Kotropoulos, A. Tefas, I. Pitas, Teewoon Tan, Hong Yan, F. Smeraldi, J. Bigun, N. Capdevielle, W. Gerstner, S. Ben-Yacoub, Y. Abdeljaoued, E. Mayoraz, “Comparison of face verification results on the XM2VTS database”, in Proceedings of 15th International Conference on Pattern Recognition, pp.858-863, 2000.
[40] B. McCane and K. Novins, “On Benchmarking Optical Flow”, Computer Vision and Image Understanding, Vol. 84, pp.126-143, 2001.
[41] K.Messer, J.Matas, J. Kittler, J. Luettin and G. Maitre, “XM2VTSBD: The Extended M2VTS database”, International Conference on Audio- and Video-based Biometric Authentication (AVBPA 99), Washington D.C., 1999.
[42] B. M. Mehtre, M. S. Kankanhalli, A. D. Narasimhalu, and G. C. Man, “Color matching for image retrieval” Pattern Recognition Letters, Vol. 16, pp.325-331, 1995.
[43] B. Noble and J. W. Daniel, Applied Linear Algebra, Prentice Hall, 1998.
[44] N. Papenberg, A. Bruhn, T. Brox, S. Didas, and J. Weickert, “Highly Accurate Optic Flow Computation with Theoretically Justified Warping” International Journal of Computer Vision. Vol. 67, pp. 141-158, 2006.
[45] G. Pass and R. Zabih, “Histogram Refinement for Content-Based Image Retreival”, Applications of Computer Vision, pp.96-102, 1996.
[46] P. J. Phillips, H. Moon, P. Rauss, and S.A. Rizvi, “The FERET Evaluation Methodology for Face-Recognition Algorithm”, in Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, pp.137-143, 1997.
[47] P.J. Phillips, H. Moon, S. Rizvi, and P. Rauss, “The FERET Evaluation Methodology for Face-Recognition Algorithm”, IEEE Trans. On Pattern Analysis and Machine Intelligence, Vol. 22, pp.1090-1104, 2000.
[48] P.J. Phillips, H. Moon, S. Rizvi, and P. Rauss, “The FERET Testing Protocol,” in Face Recognition” From Theory to Application (H. Wechsler, P.J. Phillips, V. Bruce, F.F. Soulie and T.S. Huang, eds.), Berlin: Springer-Verlag, pp.244-261, 1998.
[49] P. J. Phillips, P. Rauss, and S. Der, “FERET (Face Recognition Technology) Recognition Algorithm Development and Test Report”, Technical Report ARL-TR 995, U.S. Army Research Laboratary.
[50] S. A. Rizvi, P. J. Phillips, and H. Moon, “A verification Protocol and Statistical Performance Analysis for Face Recognition Algorithms”, in Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, pp.833-838, 1998.
[51] T. N. Schoepflin, D. J. Dailey, “Dynamic Camera Calibration of Roadside Management Cameras for Vehicle Speed Estimation”, IEEE Transactions on Intelligent Transportation Systems, 2003.
[52] H. Shariat and K. E. Price, “Motion Estimation with More than Two Frames”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 12, No.5, pp.417-434, 1990.
[53] C. Stauffer and W. E. L. Grimson, “Adaptive background mixture models for real-time tracking”, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.246-252, 1999.
[54] G. P. Stein and A. Shashua, “Model-Based Brightness Constraints: On Direct Estimation of Structure and Motion”, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.400-406, 1997.
[55] T. Suzuki and T. Kanade, “Measurement of Vehicle Motion and Orientation using Optical Flow”, Proceedings of IEEE Conference on Intelligent Transportation Systems, Tokyo, Japan, Oct, 25-30, 1999.
[56] J. T. Tou and R. C. Gonzalez, Pattern Recognition Principles, Addison-Wesley, 1974.
[57] A. M. Tourapis, “Enhanced Predictive Zonal Search for Single and Multiple Frame Motion Estimation”, Proceedings of Visual Communications and Image Processing (VCIP), pp.1069-1079, 2002.
[58] T, Tsuda, K. Yamamoto, K. Kato, “A Proposal of the Distinguish Technique between a Real Person and a Photograph”, 6th Asian Conference Computer Vision, vol. 1, pp.539-544, 2004.
[59] M. Turk and A. Pentland, “Eigenfaces for Recognition”, Journal of Cognitive Neuroscience, vol. 3, pp.71–96, 1991.
[60] A. Verri and T. Poggio, “Motion Field and Optical Flow: Qualitative Properties”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 11, 1989, pp.490-498.
[61] C. R. Wern, A. Azarbayejani, T. Darrell, and A. P. Pentland, “Pfinder: Real-time tracking of human body”, IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 19, pp.780-785, 1997.
[62] W. Zhao, R. Chellappa, and A. Krishnaswamy, “Discriminant Analysis of Principal Components for Face Recognition”, in Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, pp.336-341, 1998.

指導教授

范國清(Kuo-Chin Fan)

審核日期

2008-7-24

推文