dc.description.abstract | In modernized society, security and privacy are the two issues that people concern most. Due to the rapid progress of technology development, the price of hard discs and photographic equipments reduce dramatically such that digital video information can be accessed more easily. Therefore, there is a growing need for automatic identity recognition systems to protect the misusing of personal private information. Biometrics recognition by using biometrics features, such as facial features, finger-print, voice, and signature, is an ultimate technique to resolve the problem because of its uniqueness and convenience. There are many bimodal identity authentication systems proposed recently which use two and or more biometrics features to improve the reliability of the authentication system. In this thesis, we propose a video-based identity authentication system which uses both audio and visual information. By asking a user a random question, the system can operate without the need of pre-recorded voice patterns. Since static features can be usually deceived by using photos, the system uses both static and dynamic features extracted from face images because the variations of dynamic features of a speaker are hard to be forged. In our work, the lip movement and mouth opening patterns are simultaneously adopted as the dynamic features to recognize the speaker’’s identity.
First, the audio information and the lip information are inputted to check if the user has said the correct password. After the password has been checked, the identity of the user is then to be verified. Here, the static features like facial features and the dynamic features like the movement of lips and the jaw are utilized in identity recognition.。Finally, the two recognition results are fused to determine the identity.
The proposed system can achieve 92.96% accuracy in password checking, and 98.89% accuracy in face recognition. Experimental results verify the validity of the proposed system in identity authentication. | en_US |