基於AI技術之視障人士的路況分析及障礙物辨識與測距

NCU Institutional Repository > 資訊電機學院 > 電機工程研究所 > 博碩士論文 > Item 987654321/86590

jsp.display-item.identifier=請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/86590

题名:	基於AI技術之視障人士的路況分析及障礙物辨識與測距
作者:	城筱筑;Cheng, Hsiao-Chu
贡献者:	電機工程學系
关键词:	穿戴式裝置;視障者輔具;語義分割;物件偵測;wearable device;visually impaired people;semantic segmentation;object detection;walking guide
日期:	2021-07-07
上传时间:	2021-12-07 13:00:26 (UTC+8)
出版者:	國立中央大學
摘要:	本論文為視障人士提出一種穿戴式裝置，以協助視障人士安全地於設有人行道及斑馬線的戶行走。藉由識別室外路況資訊，並且辨識室外常見的障礙物，再透過定位裝置模組實現室外導航，綜合所有的室外路況資訊簡單扼要地以語音引導視障者安全地前往目的地。此篇研究內容包含四個部分，第一部分為穿戴式導盲裝置的設計與多個功能之間的整合，其中包含系統架構與硬體介紹，多個功能之間的行程間通訊與切換機制設計。第二部分我們使用語義分割神經網路和物件偵測神經網路，來正確地識別室外路況以及常見的障礙物。第三部分為行走路線規劃的設計與系統輸出之提示音的內容說明，透過不斷的比對路徑規劃點的方向與感測器所獲得的方向是否一致作為引導機制。第四部分為障礙物距離估測與語音播報優先序的設定，透過RGB-D攝影機回傳的深度圖，結合物件偵測神經網路，經過計算得知障礙物與視障者的距離，並語音播報出最優先需避免碰撞到的障礙物種類。在實際與視障者實驗後，證實本研究所提出的方法能夠正確的指引視障者行走在人行道及斑馬線上，並確實避開障礙物，最後能安全地抵達設定之目的地。;This paper proposes a wearable device for the visually impaired to help the visually impaired safely walk on the sidewalk and crosswalks. The device not only can recognize the sidewalk and crosswalk and obstacles ahead but also have navigation function so that the visually impaired people can walk to the destination safely with some simple guiding voice. This study consists of four parts. The first part is the design of a wearable guide device which contains system architecture and hardware introduction, inter-process communication, and switching mechanism design between multiple functions. In the second part, we use semantic segmentation and object detection neural network models, respectively, to recognize outdoor road conditions and common obstacles correctly. The third part is the walking route planning and the guiding voice content description By continuously comparing the direction of the path planning point with the direction obtained by the sensor as a guiding mechanism. The fourth part is the obstacle distance estimation and guiding voice broadcast priority setting. Based on the depth map measured by the RGB-D camera and the output of the object detection model, the distance between the obstacle and the visually impaired is calculated. Then, the voice broadcasts the obstacle name which is the highest priority to be avoided. Finally, we have a real experiment with visually impaired people, and the experiment shows that the visually impaired people can be guided to walk on sidewalks and crosswalks safely and avoid obstacles appropriately, and finally reach the set destination.
显示于类别:	[電機工程研究所] 博碩士論文

文件中的档案:

档案	描述	大小	格式	浏览次数
index.html		0Kb	HTML	73	检视/开启

在NCUIR中所有的数据项都受到原著作权保护.

社群 sharing

数据加载中.....