串流影像之即時人臉偵測、追蹤與辨識─嵌入式系統設計

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：17

、訪客IP：13.59.2.242

姓名

何曉平(Hsiao-Ping H0) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

串流影像之即時人臉偵測、追蹤與辨識─嵌入式系統設計
(Real Time Face Detection, Tracking and Recognition for Streaming Images: Embedded System Design)

相關論文

★ 整合GRAFCET虛擬機器的智慧型控制器開發平台	★ 分散式工業電子看板網路系統設計與實作
★ 設計與實作一個基於雙攝影機視覺系統的雙點觸控螢幕	★ 智慧型機器人的嵌入式計算平台
★ 一個即時移動物偵測與追蹤的嵌入式系統	★ 一個固態硬碟的多處理器架構與分散式控制演算法
★ 基於立體視覺手勢辨識的人機互動系統	★ 整合仿生智慧行為控制的機器人系統晶片設計
★ 嵌入式無線影像感測網路的設計與實作	★ 以雙核心處理器為基礎之車牌辨識系統
★ 基於立體視覺的連續三維手勢辨識	★ 微型、超低功耗無線感測網路控制器設計與硬體實作
★ 一個快速立體視覺系統的嵌入式硬體設計	★ 即時連續影像接合系統設計與實作
★ 基於雙核心平台的嵌入式步態辨識系統	★ Gigabit乙太網路的UDP/IP硬體加速器設計

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

在現今科技發達且資訊流通快速的時代，以生物特徵辨識為基礎的身份認證方法已經是重要的趨勢，人臉辨識便是其中一項廣泛被應用的技術。為了因應各種可攜的(portable)、獨立平台(standalone)的人臉辨識需求，設計一個高性能嵌入式人臉辨識系統成為一個重要的課題。本論文提出一個融合水平投影特徵及幾何特徵等雙模態特徵為基礎的人臉偵測、追綜與辨識系統，利用人臉左右對稱特性，以及人臉獨特的五官幾何比例，融合此兩類特徵成為具有高鑑別度的分類特徵。
傳統人臉辨識研究大都是對單張靜態影像進行辨識，其辨識結果容易受到取像環境影響。本研究將人臉偵測、追蹤、辨識演算法結合應用在連續串流影像，可持續對同一個人進行多次人臉特徵比對，提供更可靠的人臉身份辨識。我們首先利用膚色模型以及人臉形態學比例篩選出人臉區域；接著以粒子群最佳化演算法追蹤移動人臉位置；再擷取偵測的人臉目標影像的雙模態特徵向量；最後利用機率式神經網路進行人臉辨識。
我們分別對人臉偵測、追蹤以及辨識演算法進行功能驗證和實驗。人臉偵測部份比起傳統的Viola-Jones detector有較佳的偵測率以及複雜影像環境容忍度；人臉追蹤部份使用粒子群最佳化演算法(PSO，Particle Swarm Optimization)搜索局部區域人臉位置，比起每次都對整張影像作全域搜尋有更快的執行速度以及正確性較好的搜尋結果；人臉辨識部份相較於特徵臉(eigenface)演算法，有較佳的相等錯誤率(EER)辨識結果以及更少的特徵資料庫儲存空間需求。
最後將本系統在個人電腦以及嵌入式處理器NIOS II平台上完成嵌入式軟體的設計和驗證，並分析系統效能，找出效能瓶頸的功能模組，再依照MIAT機器智慧自動化技術實驗室提出的硬體設計方法論，將其實作為嵌入式硬體，以提昇整體系統效能。

摘要(英)

In recent years, using biometric features to recognize people has becoming an important topic. This thesis proposed a high performance embedded face recognition system, based on geometric feature/projection feature biometric decision fusion.
We perform our face recognition system on continuous stream images. Most of the traditional research implement their face recognition algorithm on static images, therefore, the final result would depend on the image quality. We can identify a person in stream image many times, and getting a more reliable result. First, we uses the facial color filter and the ellipse mask to partition the possible facial areas, then we using the Particle Swarm Optimization to locate the facial position, After extracting the bi-modal biometrics from human face, we finally recognize human by Probabilistic Neural Network(PNN).
We compare our face detection subsystem with Viola-Jones detector, the experiment reveals a better detection rate and tolerance of bad image quality. Besides, both the operated speed and detection rate, using Particle Swarm Optimization tracking is better than performing detection on every single image. We compare our face recognition subsystem with eigenface algorithm, the former has better EER result and less database storage requirement than the latter.
In this thesis , we verify our face detection、tracking and recognition system on personal computer and embedded platform. Furthermore, according to the MIAT methodology , the system is divided into independent modules, we analyze every modules to find system bottleneck , and then implementing such modules on embedded hardware .

關鍵字(中)

★ 嵌入式系統
★ 人臉辨識
★ 人臉偵測

關鍵字(英)

★ FPGA
★ PNN
★ PSO
★ face detection
★ face recognition

論文目次

摘要 i
Abstract ii
目錄 iii
圖目錄 v
表目錄 viii
第一章、緒論 1
1.1研究動機 1
1.2相關文獻探討 2
1.2.1人臉偵測方法回顧 2
1.2.2人臉追蹤方法回顧 4
1.2.3人臉辨識方法回顧 7
1.3系統流程與狀態組織 9
第二章、人臉偵測與追蹤 11
2.1人臉偵測 11
2.2 PSO人臉追蹤 21
2.2.1 PSO原理 21
2.2.2 PSO人臉位置追蹤 23
2.3實驗結果 27
第三章、人臉特徵抽取與辨識 34
3.1人臉特徵抽取 34
3.1.1幾何特徵抽取 34
3.1.2水平投影特徵抽取 46
3.2機率式神經網路分類器 52
3.2.1貝式決策定理 52
3.2.2 Parzen視窗法 53
3.2.3 PNN架構 55
3.3實驗結果 57
第四章、嵌入式系統設計實作 63
4.1高階系統硬體設計方法論 63
4.2系統架構 67
4.3嵌入式系統設計 71
4.4硬體合成 74
4.5實驗結果 100
第五章、結論與未來工作 102
5.1結論 102
5.2未來工作 103
參考文獻 104

參考文獻

[1]Rein-Lien Hsu; Abdel-Mottaleb, M.; Jain, A.K.; , "Face detection in color images," Image Processing, 2001. Proceedings. 2001 International Conference on , vol.1, no., pp.1046-1049 vol.1, 2001
[2]Garcia, C.; Tziritas, G.; , "Face detection using quantized skin color regions merging and wavelet packet analysis," Multimedia, IEEE Transactions on , vol.1, no.3, pp.264-277, Sep 1999
[3]Berbar, M.A.; Kelash, H.M.; Kandeel, A.A.; , "Faces and Facial Features Detection in Color Images," Geometric Modeling and Imaging--New Trends, 2006 , vol., no., pp.209-214, 16-18 Aug. 1993
[4]Chen Aiping; Pan Lian; Tong Yaobin; Ning Ning; , "Face Detection Technology Based on Skin Color Segmentation and Template Matching," Education Technology and Computer Science (ETCS), 2010 Second International Workshop on , vol.2, no., pp.708-711, 6-7 March 2010
[5]Qieshi Zhang; Kamata, S.-i.; Jun Zhang; , "Face detection and tracking in color images using color centroids segmentation," Robotics and Biomimetics, 2008. ROBIO 2008. IEEE International Conference on , vol., no., pp.1008-1013, 22-25 Feb. 2009
[6]Sun, Q.B.; Huang, W.M.; Wu, J.K.; , "Face detection based on color and local symmetry information," Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on , vol., no., pp.130-135, 14-16 Apr 1998
[7]Jeonghee Park; Jungwon Seo; Dongun An; Seongjong Chung; , "Detection of human faces using skin color and eyes," Multimedia and Expo, 2000. ICME 2000. 2000 IEEE International Conference on , vol.1, no., pp.133-136 vol.1, 2000
[8]Kovac, J.; Peer, P.; Solina, F.; , "Illumination independent color-based face detection," Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the 3rd International Symposium on , vol.1, no., pp. 510- 515 Vol.1, 18-20 Sept. 2003
[9]Xia, S.; Li, J.; Xia, L.; , "Robust Face Tracking Using Self-Skin Color Segmentation," Signal Processing, 2006 8th International Conference on , vol.2, no., 16-20 2006
[10]T. Sakai , M. Nagao, and S. Fujibayashi, "Line extraction and pattern recognition in Marchionini, photograph,"Patt.Recog.,vol. 1, pp. 233-248, 1969.
[11]Shi-Hong Jeng; Hong-Yuan Liao; Yao-Tsorng Liu; Ming-Yang Chern; , "An efficient approach for facial feature detection using geometrical face model," Pattern Recognition, 1996., Proceedings of the 13th International Conference on , vol.3, no., pp. 426- 430 vol.3, 25-29 Aug 1996
[12]Chiunhsiun Lin; Kuo-Chin Fan; , "Human face detection using geometric triangle relationship," Pattern Recognition, 2000. Proceedings. 15th International Conference on , vol.2, no., pp.941-944 vol.2, 2000
[13]Wei Chen; Tongfeng Sun; Xiaodong Yang; Li Wang; , "Face detection based on half face-template," Electronic Measurement & Instruments, 2009. ICEMI '09. 9th International Conference on , vol., no., pp.4-54-4-58, 16-19 Aug. 2009
[14]Haizhou Ai; Luhong Liang; Guangyou Xu; , "Face detection based on template matching and support vector machines," Image Processing, 2001. Proceedings. 2001 International Conference on , vol.1, no., pp.1006-1009 vol.1, 2001
[15]Rowley, H.A.; Baluja, S.; Kanade, T.; , "Neural network-based face detection," Pattern Analysis and Machine Intelligence, IEEE Transactions on , vol.20, no.1, pp.23-38, Jan 1998
[16]Cheol Hun Han; Kwee-Bo Sim; , "Real-time face detection using AdaBoot algorithm," Control, Automation and Systems, 2008. ICCAS 2008. International Conference on , vol., no., pp.1892-1895, 14-17 Oct. 2008
[17]Anagnostopoulos, C.; Anagnostopoulos, I.; Vergados, D.; Papaleonidopoulos, I.; Kayafas, E.; Loumos, V.; Stasinopoulos, G.; , "A probabilistic neural network for face detection on segmented skin areas based on fuzzy rules," Electrotechnical Conference, 2002. MELECON 2002. 11th Mediterranean , vol., no., pp. 493- 497, 2002
[18]Ming-Jung Seow; Valaparla, D.; Asari, V.K.; , "Neural network based skin color model for face detection," Applied Imagery Pattern Recognition Workshop, 2003. Proceedings. 32nd , vol., no., pp. 141- 145, 15-17 Oct. 2003
[19]Tsai, C.C.; Cheng, W.C.; Taur, J.S.; Tao, C.W.; , "Face Detection Using Eigenface and Neural Network," Systems, Man and Cybernetics, 2006. SMC '06. IEEE International Conference on , vol.5, no., pp.4343-4347, 8-11 Oct. 2006
[20]Lin-Lin Huang; Shimizu, A.; Hagihara, Y.; Kobatake, H.; , "Face detection from cluttered images using a polynomial neural network," Image Processing, 2001. Proceedings. 2001 International Conference on , vol.2, no., pp.669-672 vol.2, 7-10 Oct 2001
[21]Lalonde, M.; Byrns, D.; Gagnon, L.; Teasdale, N.; Laurendeau, D.; , "Real-time eye blink detection with GPU-based SIFT tracking," Computer and Robot Vision, 2007. CRV '07. Fourth Canadian Conference on , vol., no., pp.481-487, 28-30 May 2007
[22]張榮勝,"使用膚色比例前處理之即時性人臉偵測系統",交通大學電信工程學系碩士論文,2007
[23]黃泰祥,"具備人臉追蹤與辨識功能的一個智慧型數位監視系統",私立中原大學電子工程學系碩士學位論文,2004
[24]陳彥劭,"即時人臉辨識系統之研製",南台科技大學電機工程研究所碩士學位論文,2008
[25]沈韋穎,"即時人臉偵測系統",國立台灣大學資訊工程學研究所,2003
[26]Ming-Hsuan Yang; Kriegman, D.J.; Ahuja, N.; , "Detecting faces in images: a survey," Pattern Analysis and Machine Intelligence, IEEE Transactions on , vol.24, no.1, pp.34-58, Jan 2002
[27]Birchfield, S. and S. Rangarajan, " Spatiograms versus histograms for region-based tracking," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition ,Volume 2, pp. 1158- 1163, 20-25 June 2005.
[28] Roller, D., K. Daniilidis, and H. Nagel, "Model-based object tracking in monocular image sequences of road traffic scenes." International Journal of Computer Vision, 1993. 10(3): p. 257-281.
[29] Delamarre, Q. and O. Faugeras, "3D Articulated Models and Multi-View Tracking with Silhouettes" in Proc. of the Seventh IEEE International Conference on Computer Vision, Volume 2 , pp. 716 - 721, 20-27 Sept. 1999
[30] Karaulova, I., P. Hall, and A. Marshall, "A hierarchical model of dynamics for tracking people with a single video camera," in Proc. of British Machine Vision Conference, pp. 262-352, 2000.
[31] Hayashi, Y. and H. Fujiyoshi, "Mean-Shift-Based Color Tracking in Illuminance Change," Robot Soccer World Cup XI, p. 302-311,2007.
[32] KaewTraKulPong, P. and R. Bowden, "An Adaptive Visual System for Tracking Low Resolution Color Targets," in Proc .of British Machine Vision Conference , pp. 243-252, 2001.
[33] Sturges, J.a.W., T. W. A," Locating basic colours in the Munsell space." Color Research and Application, in Proc .of Color Research and Application, pp. 364-376, 1995.
[34] Bourezak, R. and G. Bilodeau, "Object detection and tracking using iterative division and correlograms," in Proc. of the 3rd Canadian Conference of Computer and Robot Vision, pp. 38 - 38, 07-09 June 2006.
[35] Jharna Majumdar, Y.D.," Image Registration And Target Tracking."
[36] Mei, H,"A detection-based multiple object tracking method," in Proc. of International Conference on Image Processing( ICIP) , Volume 5, pp.3065 - 3068, 24-27 Oct. 2004.
[37]張簡大敬、杜維昌, "Multiple-Object Tracking for Low-Resolution Surveillance Video," in Proc. of the Workshop on Consumer Electronics and Signal Processing , Dec. 17-18, 2005.
[38] Di Stefano, L. and E. Viarani, "Vehicle Detection and Tracking Using the Block Matching Algorithm." in Proc. of Recent Advances in Signal Processing and Communications, 1999.
[39] Chang, F., L. Ma, and Y. Qiao," Target Tracking Under Occlusion by Combining Integral-Intensity-Matching with Multi-block-voting," in Proc. of Lecture Notes, Volume 3644, pp.77-86, 2005.
[40] Pierre F. Gabriel, J.G.V., Justus H. Piater, and Andre Genon, "The State of the Art in Multiple Object Tracking Under occlusion in video sequences," in Proc. of Advanced Concepts for Intelligent Vision Systems, Belgium ,September 2-5, 2003.
[41] Katja Nummiaro, E.K.-M.a.L.V.G., "An Adaptive Color-Based Particle Filter." in Proc. of Image And Vision Computing, Volume 21, pp. 99-110, 2003.
[42] Po-Feng Cheng, W.-H.W., Chih-Yang Lin," Adaptive Object Detection and Tracking." ICL TECHNICAL JOURNAL, Volume 20, pp. 78-84, 2007.
[43] Yoshinori Satoh, T.O.a.K.D., "A Color-based Tracking by Kalman Particle Filter." in Proc. of the 17th International Conference on Pattern Recognition, Volume 3, pp. 502 - 505, 23-26 Aug. 2004.
[44] M. Turk and A. Pentland, "Eigenfaces for recognition",Journal of Cognitive Neuroscience,Vol.3,no. 1,pp.71-86,1991.
[45]Belhumeur, P.N.; Hespanha, J.P.; Kriegman, D.J.; , "Eigenfaces vs. Fisherfaces: recognition using class specific linear projection," Pattern Analysis and Machine Intelligence, IEEE Transactions on , vol.19, no.7, pp.711-720, Jul 1997
[46]Yu, H., Yang, J.: A direct LDA algorithm for high-dimensional data with application to face recognition. Pattern Recognition, Vol. 34. No. 11. (2001) 2067-2070
[47]Jun Qin; Zhong-Shi He; , "A SVM face recognition method based on Gabor-featured key points," Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on , vol.8, no., pp.5144-5149 Vol. 8, 18-21 Aug. 2005
[48] Kennedy, J. and R. Eberhart., "Particle swarm optimization, " in Proc. Of IEEE International Conference on Neural Networks, Volume 4, pp.1942 – 1948, 27 Nov.-1 Dec. 1995.
[49] Mehtre, B.M., et al., "Color matching for image retrieval, " Pattern Recognition Letters, pp. 325-331, 1995.
[50]顏妙純,"一個即時移動物偵測與追蹤的嵌入式系統",國立中央大學資訊工程學系碩士論文,2009
[51]Viola, P.; Jones, M.; , "Rapid object detection using a boosted cascade of simple features," Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on , vol.1, no., pp. I-511- I-518 vol.1, 2001
[52]Maio, D.; Maltoni, D.; Cappelli, R.; Wayman, J.L.; Jain, A.K ., “FVC2000: fingerprint verification competition“, IEEE Transactions on Pattern Analysis and Machine Intelligence, , Volume: 24 Issue: 3 , Mar 2002 Page(s): 402 –412
[53] Ching-Han Chen; Jia-Hong Dai, “Design and High-Level Synthesis of Discrete-Event Controller”, National Conference of Automatic Control and Mechtronics System. Taiwan, R.O.C., pp. 75-80. , 2002.

指導教授

陳慶瀚(GING-HAN CHEN)

審核日期

2010-7-26

推文