本研究提出一個多模態掌紋身分識別方法，本系統透過智慧型手機拍攝手掌影像，採用基於最大內切圓的方法擷取感興趣的掌紋區域，再使用灰度共生矩陣( GLCM)、灰度梯度共生矩陣(GGCM)、局部二值模式(LBP)，三種紋理特徵提取方式提取掌紋紋理特徵向量，分別將三組特徵向量結合機率神經網路分類器(PNN)，以得到三組最佳的推論機率，最後我們將每一個模組的推論機率進行加權融合，得到辨識結果。針對自建的手掌影像資料庫實驗結果顯示，在訓練資料為10筆的情況下，GLCM、GGCM、LBP三種模態各自的準確率分別為82%、86%及89%，結合決策融合PNN的準確率則提升為96%。我們還使用穆塔大學(Mutah University)提供的公開掌紋資料庫所進行比較實驗，準確率可達99.5%，相較於VGG-19和AlexNet，我們的多模態掌紋身分識別系統具有良好的辨識性能。;This study proposes a multimodal palm tattoo recognition method. This system captures palm images through a smartphone, using the method based on the largest inscribed circle to capture the area of interest palm print, and then uses the gray level co-occurrence matrix (GLCM), gray scale Gradient co-occurrence matrix (GGCM) and local binary pattern (LBP), three texture feature extraction methods to extract palmprint texture feature vectors respectively, and three sets of feature vectors are combined with a probabilistic neural network classifier (PNN) to obtain the three sets of best inferences probability. Finally, we weighted and fused the inference probabilities of each module to obtain the recognition result. The experimental results of the self-built palm image database show that with 10 training data, the accuracy of the three modalities of GLCM, GGCM, and LBP are 82%, 86%, and 89%, respectively. The accuracy was increased to 96%. We also use the public palm print database provided by Mutah University for comparative experiments, and the accuracy can reach 99.5%. Compared with VGG-19 and AlexNet, our multi-modal palm tattoo sub-recognition system has good recognition performance.
