基於多層自組織映射圖之手語辨識演算法;A Hierarchical Self-Organizing Maps-based Sign Language Recognition Algorithm

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Computer Science and Information Engineering > Electronic Thesis & Dissertation > Item 987654321/86689

Please use this identifier to cite or link to this item: https://ir.lib.ncu.edu.tw/handle/987654321/86689

Title:	基於多層自組織映射圖之手語辨識演算法;A Hierarchical Self-Organizing Maps-based Sign Language Recognition Algorithm
Authors:	鄭書?;Cheng, Shu-Yu
Contributors:	資訊工程學系
Keywords:	手語辨識;自組織映射圖;深度學習;Sign language recognition;Self-Organizing Maps;Deep learning
Date:	2021-08-16
Issue Date:	2021-12-07 13:07:08 (UTC+8)
Publisher:	國立中央大學
Abstract:	手語辨識可以讓很多聽語障人士受益，也能縮短聽語障人士與親友之間溝通的橋樑。多年來，深度學習在手語辨識的領域達成了很大的成就。有很多方法可以提取手部骨架或符號的特徵。這些不同的特徵被許多研究用作深度神經網絡（DNN）的輸入，以用來辨識手語。然而，特徵提取的效率和手語辨識的準確度仍有進步的空間。本文中，我們提出了一種新的手語辨識演算法，此演算法先用多層自組織映射圖（SOM）來將動態手語轉成靜態的響應圖 (response map)。由於卷積神經網路（CNN）在圖像分類方面具有非凡的性能，因此，我們就將此靜態的響應圖當成特徵輸入卷積神經網路予以達成手語辨識之目的。從美國手語詞典視頻資料集 (ASLLVD) 中選出來 36 個單字作為我們的資料集來測試所提之手語辨識演算法之有效性，我們在資料集上達到了 78.57% 的辨識準確率。;The recognition of sign language can bene?t many dumb deaf people and bridge the gap of communication between them and their families and friends. For many years, deep learning has achieved great results in the ?eld of sign language recognition. There are lots of methods for extracting features of hand shapes or signs. These di?erent features are used as input of deep neural networks (DNN) in many studies for sign language recognition. However, the e?ciency of feature extraction and the recognition accuracy still have room for improvement. In this study, we proposed a novel algorithm for sign language recognition. The algorithm ?rst uses a hierarchical self-organizing map (SOM) to covert dynamic sign language into a static response map. Since the convolutional neural network (CNN) has an extraordinary performance in image classi?cation, we take the static response maps as input features to CNN to achieve the purpose of sign language recognition. We selected 36 signs from the American sign language lexicon video dataset (ASLLVD) as our dataset to test the e?ectiveness of our proposed algorithm. Finally, We reached a recognition accuracy of 78.57% on the dataset.
Appears in Collections:	[Graduate Institute of Computer Science and Information Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	230	View/Open

社群 sharing

Loading...