基於AI技術之對抗部分遮蔽的即時臉部辨識系統

NCU Institutional Repository > 資訊電機學院 > 電機工程研究所 > 博碩士論文 > Item 987654321/86580

請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/86580

題名:	基於AI技術之對抗部分遮蔽的即時臉部辨識系統
作者:	儲健峰;Chu, Chien-Feng
貢獻者:	電機工程學系
關鍵詞:	深度學習;物件追蹤;臉部偵測;臉部辨識;臉部遮蔽;注意力機制;deep learning;object tracking;face detection;face recognition;partially covered faces;attention mechanism
日期:	2021-07-06
上傳時間:	2021-12-07 12:59:40 (UTC+8)
出版者:	國立中央大學
摘要:	本論文旨在使用深度學習技術並結合追蹤演算法，實現一套對抗部分遮蔽的即時臉部辨識系統。儘管臉部受到部分遮蔽，如：口罩、帽子、墨鏡，我們提出的系統還是能夠順利的進行辨識，並可運行在即時影像與離線影像上。進行臉部辨識之前，僅需藉由註冊系統完成身分註冊後，系統可以立即辨識，無須重新訓練。系統在辨識的同時，會記錄該身分進入、離開畫面的時間點，方便使用者用於影像搜索、紀錄等場景。目前遮蔽的臉部辨識面臨以下幾個問題，首先對於未學習過的臉部遮蔽情況，會影響網路辨識的準確性。或是僅適用於正臉，對於不同角度的人臉，其準確性也會大幅下降。再者，也有文獻提出使用臉部修復的方法，但該方法需要大量的當地人臉做為訓練資料集，以修復被遮蔽的臉部區塊，但亞洲人臉的資料集相較於歐美人臉少非常多，可能會導致亞洲人臉還原後，具有歐美人臉特徵。一般人們辨識對方，對方人臉若有受到遮蔽之情況下，普遍會更關注臉部未被遮蔽的區塊。本論文就以此觀點進行研究，在網路中加入注意力機制模塊，以改良人臉辨識網路模型SeesawFaceNet的骨幹架構，並在訓練時使用遮蔽模塊，對訓練資料進行擴增，使得網路對部分遮蔽的人臉擷取特徵時，自動關注未遮蔽的臉部區域，加強擷取未遮蔽特徵，藉此減少遮蔽物對特徵的影響。並且避免原先需要大量亞洲人臉資料集，以及改善不同角度的遮蔽人臉辨識問題，使系統對於不同的遮蔽情況，能夠達到更好的辨識準確性。 ;This thesis attempts to use deep learning technology combining tracking algorithm to implement a real-time system to recognize a person whose face is partially covered. Although the face is partially covered by a mask, hat or sunglasses, the system can still accurately recognize the face of a person in real time or offline video. To perform facial recognition, we should use the enrollment system to complete the identity enrollment, and the system can recognize the enrolled person immediately without retraining even his/her face is partially covered by something. At the same time, the system will record the time points when the enrolled person enters or leaves the screen. This function is very convenient to be used to search a specific person in a long video. The partially covered facial recognition has some problems to be overcome. One is if there is no learning about all covered face cases, it is hard to have an accurate recognition result. The other is the covered face should be the exactly front face, otherwise the recognition accuracy will be reduced. Furthermore, some studies used facial repair method to recover the covered part of the face, but it needs a lot of local people’s faces as training data for training. However, the data set of Asian faces is much less than that of European and American faces, which may cause Asian faces having European and American facial features after face repair. It is known that when people recognize a partially covered face, they usually pay more attention to the uncovered areas of the face. This thesis studies from this point of view and adds the attention mechanism to the network model to improve the backbone architecture of the face recognition network SeesawFaceNet. During the training process, let the covered block be used to augment the training data set. When the network extracts feature of the partially covered faces, it will automatically focus on the uncovered face areas, and strengthen the extraction of the uncovered features to mitigate the impact of feature reduction. Two more contributions of this study are that we do not need a large data set of Asian faces, and can recognize the partially covered faces with different angles.
顯示於類別:	[電機工程研究所] 博碩士論文

文件中的檔案:

檔案	描述	大小	格式	瀏覽次數
index.html		0Kb	HTML	104	檢視/開啟

在NCUIR中所有的資料項目都受到原著作權保護.

社群 sharing

資料載入中.....