具口述影像與口語對話系統的智慧導盲眼鏡;Intelligent Guiding Glasses with Descriptive Video Service and Spoken Dialogue System for Visually Impaired

NCUIR > College of Electrical Engineering & Computer Science > Department of Computer Science and information Engineering > Research Project > Item 987654321/84698

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/84698

Title:	具口述影像與口語對話系統的智慧導盲眼鏡;Intelligent Guiding Glasses with Descriptive Video Service and Spoken Dialogue System for Visually Impaired
Authors:	陳慶瀚
Contributors:	資訊工程學系
Keywords:	對話系統;圖像描述;深度學習;街景辨識;自然語言;dialogue system;image captioning;deep learning;street recognition;natural language process
Date:	2020-12-08
Issue Date:	2020-12-09 10:44:39 (UTC+8)
Publisher:	科技部
Abstract:	為了克服視覺障礙者外出行走的不便，本計畫將設計一種創新的智慧穿戴式導引裝置，其主體為眼鏡，結合 3D 攝影機和語音對話功能的眼鏡，可為視障人士提供方便且安全的戶外行動引導。本計畫將分三年進行，第一年使用 3D 物件偵測和辨識，來處理戶外障礙物和環境資訊的視覺理解，並將理解的視覺資訊轉為口述語言。第二年將發展基於盲人需求的口語對話系統，藉由自然語言人機對話，釐清盲人眼前的街景、路況、與行走方向和距離的資訊。第三年將進行智慧導盲眼鏡軟硬體整合，完成適合視障人士使用的導盲助行系統驗證，我們將邀請盲人在戶外真實環境進行評測，藉以改善系統的實用性和性能。 ;In order to overcome the inconvenience of visually impaired people, this project proposes a novel smart wearable device for walking navigation. It is a pair of glasses combining 3D vision and microphone, which can help the visually impaired to be safe and convenient in outdoor activities. The project will take three years. In the first year, we used 3D detection and recognition to handle visual understanding of obstacles and the environment, and turn the recognized information into spoken language. Then the following year, a dialogue system based on the needs of the blind will be developed. Through man-machine dialogue in natural language, information on street views, road conditions, and walking directions and distances in front of blind people will be clarified. In the last year, the software and hardware integration of smart guide glasses will be finished to completed the development of a guide system for the visually impaired. We will invite blind people to evaluate the glasses in real environment for improving the practicability and performance of the system.
Relation:	財團法人國家實驗研究院科技政策研究與資訊中心
Appears in Collections:	[Department of Computer Science and information Engineering] Research Project

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	150	View/Open

社群 sharing

Loading...