基於多層自組織映射圖之手語辨識演算法;A Hierarchical Self-Organizing Maps-based Sign Language Recognition Algorithm

NCU Institutional Repository > 資訊電機學院 > 資訊工程研究所 > 博碩士論文 > Item 987654321/86689

jsp.display-item.identifier=請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/86689

题名:	基於多層自組織映射圖之手語辨識演算法;A Hierarchical Self-Organizing Maps-based Sign Language Recognition Algorithm
作者:	鄭書?;Cheng, Shu-Yu
贡献者:	資訊工程學系
关键词:	手語辨識;自組織映射圖;深度學習;Sign language recognition;Self-Organizing Maps;Deep learning
日期:	2021-08-16
上传时间:	2021-12-07 13:07:08 (UTC+8)
出版者:	國立中央大學
摘要:	手語辨識可以讓很多聽語障人士受益，也能縮短聽語障人士與親友之間溝通的橋樑。多年來，深度學習在手語辨識的領域達成了很大的成就。有很多方法可以提取手部骨架或符號的特徵。這些不同的特徵被許多研究用作深度神經網絡（DNN）的輸入，以用來辨識手語。然而，特徵提取的效率和手語辨識的準確度仍有進步的空間。本文中，我們提出了一種新的手語辨識演算法，此演算法先用多層自組織映射圖（SOM）來將動態手語轉成靜態的響應圖 (response map)。由於卷積神經網路（CNN）在圖像分類方面具有非凡的性能，因此，我們就將此靜態的響應圖當成特徵輸入卷積神經網路予以達成手語辨識之目的。從美國手語詞典視頻資料集 (ASLLVD) 中選出來 36 個單字作為我們的資料集來測試所提之手語辨識演算法之有效性，我們在資料集上達到了 78.57% 的辨識準確率。;The recognition of sign language can bene?t many dumb deaf people and bridge the gap of communication between them and their families and friends. For many years, deep learning has achieved great results in the ?eld of sign language recognition. There are lots of methods for extracting features of hand shapes or signs. These di?erent features are used as input of deep neural networks (DNN) in many studies for sign language recognition. However, the e?ciency of feature extraction and the recognition accuracy still have room for improvement. In this study, we proposed a novel algorithm for sign language recognition. The algorithm ?rst uses a hierarchical self-organizing map (SOM) to covert dynamic sign language into a static response map. Since the convolutional neural network (CNN) has an extraordinary performance in image classi?cation, we take the static response maps as input features to CNN to achieve the purpose of sign language recognition. We selected 36 signs from the American sign language lexicon video dataset (ASLLVD) as our dataset to test the e?ectiveness of our proposed algorithm. Finally, We reached a recognition accuracy of 78.57% on the dataset.
显示于类别:	[資訊工程研究所] 博碩士論文

文件中的档案:

档案	描述	大小	格式	浏览次数
index.html		0Kb	HTML	86	检视/开启

在NCUIR中所有的数据项都受到原著作权保护.

社群 sharing

数据加载中.....