| DC 欄位 |
值 |
語言 |
| DC.contributor | 資訊工程學系 | zh_TW |
| DC.creator | 徐嘉彤 | zh_TW |
| DC.creator | Chia-Tung Hsu | en_US |
| dc.date.accessioned | 2024-8-12T07:39:07Z | |
| dc.date.available | 2024-8-12T07:39:07Z | |
| dc.date.issued | 2024 | |
| dc.identifier.uri | http://ir.lib.ncu.edu.tw:444/thesis/view_etd.asp?URN=111522083 | |
| dc.contributor.department | 資訊工程學系 | zh_TW |
| DC.description | 國立中央大學 | zh_TW |
| DC.description | National Central University | en_US |
| dc.description.abstract | 台灣的聽障人口數超過 13 萬人，手語是這些人的主要溝通方式。對於手語翻譯以及手語辨識等應用，準確的手部姿態預測模型至關重要。然而，由於雙手的互動與手部的遮擋，此任務對單一鏡頭的 RGB 影像是一大挑戰。因此，本研究旨在提升雙手手語場景的手部姿態預測結果。
本論文提出了一種應用 Extract-and-adaptation network(EANet)與彩色手套的手部姿態預測方法，並針對彩色手套手語影像進行優化。我
們使用將資料集渲染成彩色手套的方式增加手指的資訊，並採用基於Transformer 架構的 EANet 進行模型訓練，再使用多種影像處理技術來優化手部關鍵點的預測結果。實驗結果顯示，該方法在彩色手套手語資料
集上完整偵測雙手的穩定性高於 Mediapipe 55%，亦在測試資料集中得到
比使用原始資料集訓練的 EANet 更好的結果。 | zh_TW |
| dc.description.abstract | With over 130,000 hearing-impaired individuals in Taiwan, sign language serves as their primary mode of communication. Accurate hand pose estimation models are crucial for applications such as sign language translation and recognition. However, due to interactions between two hands and occlusions, this task poses a significant challenge for single RGB images. This study aims to enhance hand pose estimation in two-hand sign language scenarios.
This research proposes a hand pose estimation method using Extract-and-adaptation network (EANet) and colored gloves, optimized for sign language images with colored gloves. We enhance finger information by rendering the dataset into colored gloves and employ a Transformer-based EANet for model training. Additionally, multiple image processing techniques were employed to optimize the prediction result of hand keypoints. Experimental results demonstrate that our method achieves a 55% higher stability in detecting two hands on sign language datasets compared to Mediapipe and yields superior results on test datasets compared to EANet trained on the original dataset. | en_US |
| DC.subject | 深度學習 | zh_TW |
| DC.subject | 電腦視覺 | zh_TW |
| DC.subject | 電腦圖學 | zh_TW |
| DC.subject | 影像處理 | zh_TW |
| DC.subject | 3D 手部姿態辨識 | zh_TW |
| DC.subject | Deep Learning | en_US |
| DC.subject | Computer Vision | en_US |
| DC.subject | Computer Graphics | en_US |
| DC.subject | Image Processing | en_US |
| DC.subject | 3D Hand Pose Estimation | en_US |
| DC.title | 彩色手套影像下基於 EANet 的手部姿態預測方法 | zh_TW |
| dc.language.iso | zh-TW | zh-TW |
| DC.title | A Hand Pose Estimation Method Based on EANet with Colored Glove Images | en_US |
| DC.type | 博碩士論文 | zh_TW |
| DC.type | thesis | en_US |
| DC.publisher | National Central University | en_US |