為了克服視覺障礙者外出行走的不便，本計畫將設計一種創新的智慧穿戴式導引裝置，其主體為眼鏡，結合 3D 攝影機和語音對話功能的眼鏡，可為視障人士提供方便且安全的戶外行動引導。本計畫將分三年進行，第一年使用 3D 物件偵測和辨識，來處理戶外障礙物和環境資訊的視覺理解，並將理解的視覺資訊轉為口述語言。第二年將發展基於盲人需求的口語對話系統，藉由自然語言人機對話，釐清盲人眼前的街景、路況、與行走方向和距離的資訊。第三年將進行智慧導盲眼鏡軟硬體整合，完成適合視障人士使用的導盲助行系統驗證，我們將邀請盲人在戶外真實環境進行評測，藉以改善系統的實用性和性能。 ;In order to overcome the inconvenience of visually impaired people, this project proposes a novel smart wearable device for walking navigation. It is a pair of glasses combining 3D vision and microphone, which can help the visually impaired to be safe and convenient in outdoor activities. The project will take three years. In the first year, we used 3D detection and recognition to handle visual understanding of obstacles and the environment, and turn the recognized information into spoken language. Then the following year, a dialogue system based on the needs of the blind will be developed. Through man-machine dialogue in natural language, information on street views, road conditions, and walking directions and distances in front of blind people will be clarified. In the last year, the software and hardware integration of smart guide glasses will be finished to completed the development of a guide system for the visually impaired. We will invite blind people to evaluate the glasses in real environment for improving the practicability and performance of the system.
