摘要(英) |
Visually impaired people occupy 0.24% of the total population in Taiwan, they are the minority people who need to be looked after. The major challenge encountered by them is that of way finding, i.e., the ability of a person to find his way to a destination. There are a lot of literatures about way finding for visually impaired people, they all have pros and cons comparing with each other. In this thesis, a computer vision based algorithm is proposed, using the color information and the marker encoding method used in Augmented Reality, we design these color markers which can be placed in the environment. In practice, users used a smartphone to find the marker, and the phone will send a feedback to the users. A route can be built by several markers and saved in the database, when a user input his destination to the phone, it will conduct matching between the markers from the environment and the markers from the database so as to guide the user to their destination.
The color markers are the modification of the binary markers which are commonly used in Augmented Reality. To get the color pattern from the image stably, we use the information from YCbCr and HSV color spaces to get marker’s color region in the image. Then, we try to find contours in the binary image. For each contour, we check if it fit the requirement for the marker. If it does, we decode it to generate the encoded message. Finally, the encoded message is translated to way finding information and feedbacks are sent to the users.
Experimental results show that our color marker can be used in indoor and outdoor environments and can guide the users successfully to their destination. It reveals the validity and feasibility of the system in way finding for visually impaired people.
|
參考文獻 |
[1] L. Ran, A. Helal and S. E. Moore, "Drishti: An Integrated Indoor/Outdoor Blind Navigation System and Service," in Proceedings of the Second IEEE Annual Conference on Pervasive Compuing and Communications, 2004.
[2] F. Cecelja, V. Garaj, Z. Hunaiti and W. Balachandran, "A Navigation System for Visually Impaired," in Instrumentation and Measurement Technology Conference, 2006.
[3] A. Virtanen and S. Koskinen, "NOPPA Navigation and Guidance System for the Blind," in Proceedings of the 11th World Congress and Exhibition on ITS, 2004.
[4] V. Kulyukin, C. Gharpure, J. Nicholson and S. Pavithran, "RFID in Robot Assisted Indoor Navigation for the Visually Impaired," in Proceedings of the International Conference on Intelligent Robots and Systems, 2004.
[5] S. Willis and S. Helal, "RFID Information Grid for Blind Navigation and Wayfinding," in Proceedings of the International Symposium on Wearable Computers, 2005.
[6] J. Coughlan, R. Manduchi and H. Shen, "Cell Phone-based Wayfinding for the Visually Impaired," in 1st International Workshop on Mobile Vision, 2006.
[7] J. Coughlanl and R. Manduchi, "Functional Assessment of a Camera Phone-Based Wayfinding System Operated by Blind Users," in Proceedings of the IEEE-BAIS Symposium on Research on Assistive Technology , 2007.
[8] R. Manduchi, J. Coughlan and V. Ivanchenko, "Search Strategies of Visually Impaired Persons using a Camera Phone Wayfinding System," in 11th International Conference on Computers Helping People with Special Needs, 2008.
[9] E. Ko, J. S. Ju and E. Y. Kim, "Situation-based Indoor Wayfinding System for the Visually Impaired," in Proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, 2011.
[10] Y. Tian, C. Yi and A. Arditi, "Improving Computer Vision-based Indoor Wayfinding for Blind Persons with Context Information," in Proceedings of the International conference on computer helping people with special needs, 2010.
[11] H. Kato, "ARToolKit," [Online]. Available: http://www.hitl.washington.edu/artoolkit/.
[12] D. Parikh and G. Jancke, "Localization and Segmentation of A 2D High Capacity Color Barcode," in IEEE workshop on applications of computer vision, 2008.
[13] W. Chuan-xu and L. Zuo-yong, "Face Detection Based on Skin Gaussian Model and KL Transform," in ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, 2008.
[14] A. Dawod, J. Abdullah and M. Alam, "A New Method for Hand Segmentation using Free-form Skin Color Model," in The 3rd International Conference on Advanced Computer Theory and Engineering, 2010.
[15] F. Chang, C. J. Chen and C. J. Lu, "A Linear-time Component Labeling Algorithm using Contour Tracing Technique," Computer Vision and Image Understanding, pp. 206-220, 2004.
[16] R. Munoz-Salinas, "ArUco: a minimal library for Augmented Reality applications based on OpenCv," [Online]. Available: http://www.uco.es/investiga/grupos/ava/node/26.
[17] G. Bradski, "The OpenCV Library," Dr. Dobb’’s Journal of Software Tools, 2000.
[18] M. Fiala, "ARTag, a Fiducial Marker System using Digital Techniques," in IEEE computer society conference on computer vision and pattern recognition, 2005.
[19] N. Otsu, "A Threshold Selection Method from Gray-Level Histograms," IEEE Transactions on Systems, Man and Cybernetics, pp. 62-66, 1 1979.
[20] Z. Zhang, "A Flexible New Technique for Camera Calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1330-1334, 11 2000.
[21] J. More, "The Levenberg-Marquardt Algorithm, Implementation, and Theory," in Numerical Analysis, 1977.
|