基於遞迴神經網路於多重裝置下之硬舉動作辨識及應用;Deadlift Recognition and Application based on Multiple Modalities using Recurrent Neural Network

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Communication Engineering > Electronic Thesis & Dissertation > Item 987654321/80987

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/80987

Title:	基於遞迴神經網路於多重裝置下之硬舉動作辨識及應用;Deadlift Recognition and Application based on Multiple Modalities using Recurrent Neural Network
Authors:	牟庭辰;Mou, Ting-Chen
Contributors:	通訊工程學系
Keywords:	動作辨識;慣性測量;深度學習;多重裝置結合;深度攝影機;Kinect;behavior recognition;multiple modalities;deep learning;LSTM;smart gym
Date:	2019-07-29
Issue Date:	2019-09-03 15:23:34 (UTC+8)
Publisher:	國立中央大學
Abstract:	近年來隨者人工智慧的興起以及電腦硬體效能之提升，人體的動作辨識也漸漸受大家所歡迎，尤其在電腦視覺與圖形識別領域上更是發展迅速。相關應用像是遊戲、追蹤監控、智慧環境場所、醫療領域……等。本篇論文是針對重訓類動作進行辨識，以硬舉運動項目為例，一方面是因為這類型的動作屬於多關節運動，在重訓動作中屬於高效率的運動，然而對於初學者而言常會因為觀念不正確導致姿勢錯誤而受傷，而我們所出的系統可以分辨出不同類型的硬舉動作之外，在後續的應用方面可以有效的給予使用者相關的專業建議，找到問題所在，進而避免及預防受傷的風險。另一方面可以分擔健身教練的工作，讓教練可以專注於更專業的教學內容上。我們提出利用多台裝置的架構之下進行整套系統的運行，包括Kinect攝影機及x-OSC慣性測量裝置，利用時變性投影法及特徵串接等方法，將特徵資料送入深度學習中的多層長短期記憶架構去做訓練辨識訓練。使用多重裝置可以彌補單一裝置的不足，對於後續的應用也能有更多不同層面的處理方式。這套系統應用在我們自己所拍攝的Vap多重裝置之重訓動作資料庫上，且後續的應用也能有效的分析動做。 ;With the rise of artificial intelligence and the improvement of computer hardware performance in recent years, the human action recognition (HAR) has gradually been popular, especially in Computer Vision and Pattern Recognition. The application has been widely developed in various field. For example, games, tracking and surveillance systems, smart environment, medical field etc. This thesis is aimed at fitness behavior recognition, taking deadlift as an example. This exercise is a multi-joint movement, however beginners usually cause injury due to their incorrect concept and wrong posture. One of the purpose is for giving users some professional advice about fitness. The other is the system for the gym can share the work of the fitness instructor, so coaches can focus on the more professional teaching content to their students. We propose a multi-modality deadlift recognition and application system, including Kinect camera and inertial sensors (x-OSC). Using Time-Variant Skeleton Vector Projection method and feature concatenated method before we feed features to our network. Then, we use the Long short-term memory (LSTM) network, a type of recurrent neural network, as classifier. The dataset we used is VAP multi-modalities fitness behavior dataset. This dataset is we proposed, and contain 6 fitness behavior. Using multi-modality data can achieve a good recognition accuracy effectively and the applications of our system can also analyze uses results effectively.
Appears in Collections:	[Graduate Institute of Communication Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	251	View/Open

社群 sharing

Loading...