具口述影像與口語對話系統的智慧導盲眼鏡;Intelligent Guiding Glasses with Descriptive Video Service and Spoken Dialogue System for Visually Impaired

NCU Institutional Repository > 資訊電機學院 > 資訊工程學系 > 研究計畫 > Item 987654321/84698

請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/84698

題名:	具口述影像與口語對話系統的智慧導盲眼鏡;Intelligent Guiding Glasses with Descriptive Video Service and Spoken Dialogue System for Visually Impaired
作者:	陳慶瀚
貢獻者:	資訊工程學系
關鍵詞:	對話系統;圖像描述;深度學習;街景辨識;自然語言;dialogue system;image captioning;deep learning;street recognition;natural language process
日期:	2020-12-08
上傳時間:	2020-12-09 10:44:39 (UTC+8)
出版者:	科技部
摘要:	為了克服視覺障礙者外出行走的不便，本計畫將設計一種創新的智慧穿戴式導引裝置，其主體為眼鏡，結合 3D 攝影機和語音對話功能的眼鏡，可為視障人士提供方便且安全的戶外行動引導。本計畫將分三年進行，第一年使用 3D 物件偵測和辨識，來處理戶外障礙物和環境資訊的視覺理解，並將理解的視覺資訊轉為口述語言。第二年將發展基於盲人需求的口語對話系統，藉由自然語言人機對話，釐清盲人眼前的街景、路況、與行走方向和距離的資訊。第三年將進行智慧導盲眼鏡軟硬體整合，完成適合視障人士使用的導盲助行系統驗證，我們將邀請盲人在戶外真實環境進行評測，藉以改善系統的實用性和性能。 ;In order to overcome the inconvenience of visually impaired people, this project proposes a novel smart wearable device for walking navigation. It is a pair of glasses combining 3D vision and microphone, which can help the visually impaired to be safe and convenient in outdoor activities. The project will take three years. In the first year, we used 3D detection and recognition to handle visual understanding of obstacles and the environment, and turn the recognized information into spoken language. Then the following year, a dialogue system based on the needs of the blind will be developed. Through man-machine dialogue in natural language, information on street views, road conditions, and walking directions and distances in front of blind people will be clarified. In the last year, the software and hardware integration of smart guide glasses will be finished to completed the development of a guide system for the visually impaired. We will invite blind people to evaluate the glasses in real environment for improving the practicability and performance of the system.
關聯:	財團法人國家實驗研究院科技政策研究與資訊中心
顯示於類別:	[資訊工程學系] 研究計畫

文件中的檔案:

檔案	描述	大小	格式	瀏覽次數
index.html		0Kb	HTML	150	檢視/開啟

在NCUIR中所有的資料項目都受到原著作權保護.

社群 sharing

資料載入中.....