高速公路上之道路牌文字偵測

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：87

、訪客IP：18.222.115.217

姓名

曾韻榮(Yun-Jung Tseng) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

高速公路上之道路牌文字偵測
(Text detection of road signs on highway)

相關論文

★ 使用視位與語音生物特徵作即時線上身分辨識	★ 以影像為基礎之SMD包裝料帶對位系統
★ 手持式行動裝置內容偽變造偵測暨刪除內容資料復原的研究	★ 基於SIFT演算法進行車牌認證
★ 基於動態線性決策函數之區域圖樣特徵於人臉辨識應用	★ 基於GPU的SAR資料庫模擬器：SAR回波訊號與影像資料庫平行化架構 (PASSED)
★ 利用掌紋作個人身份之確認	★ 利用色彩統計與鏡頭運鏡方式作視訊索引
★ 利用欄位群聚特徵和四個方向相鄰樹作表格文件分類	★ 筆劃特徵用於離線中文字的辨認
★ 利用可調式區塊比對並結合多圖像資訊之影像運動向量估測	★ 彩色影像分析及其應用於色彩量化影像搜尋及人臉偵測
★ 中英文名片商標的擷取及辨識	★ 利用虛筆資訊特徵作中文簽名確認
★ 基於三角幾何學及顏色特徵作人臉偵測、人臉角度分類與人臉辨識	★ 一個以膚色為基礎之互補人臉偵測策略

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

自動地對影片中的文字做偵測，對於影片的檢索和瞭解是不可或缺的工作。而本論文主要是針對輔助駕駛系統做應用，利用自動對高速公路牌（指示牌、速限牌）上的文字做偵測，提供駕駛者在高速公路上的導航，例如：現在駕駛者所處的位置、方向、現在應該保持的速度。讓駕駛者可以專心地開車，而不會因為為了看道路上的路牌而造成駕駛不當，或者因為超速而造成車禍；且為了響應2008年北京奧運，在未來工作方面，除了對高速公路牌上的文字自動辨識之外，可以進階地將所攝影機擷取到的文字，自動地翻譯成各國語言，使各國來的人士能容易地了解各個路牌所代表的意思。
本論文提出一個對擷取道路牌上強而有效的新特徵，使用顏色的資訊來對高速公路上的道路牌做定位，並結合邊的資訊，自動偵測道路牌上的文字。主要的架構可分為三個，第一個步驟，利用顏色和不同物質具有不同傳導係數的特性，配合類神經網路的訓練，將路牌和其他的物質分開；第二個步驟，加入仿射（affine）矯正，將照相機在不適當的拍攝角度，所拍得的變形道路牌復原回來，使道路牌上的文字正對著相機，增加框選文字的正確性；第三個步驟，利用 Canny 邊緣偵測來取得邊的資訊，藉此在每一個道路牌上框出文字的候選區。
在實驗的部分，我們希望本論文提出的方法能適用在大多的情況下，所以從多段影片之中擷取出20段影片，其中包括了晴天、多雲和筆直的或彎曲的道路情況。在道路牌定位的部份，檢出率(recall)和精確率(precision)分別為 91.1%及 80.8%，在文字偵測上則是 93.6% 和 88.0%。

摘要(英)

With the advancement of scientific technologies, the cost of digital camera decreases rapidly. It is a trend to improve and uplift the living quality of people using image processing techniques. Automatic detection of text from video is one of the applications which is an essential task for understanding and indexing of video. In this thesis, a driver assistant system is designed by automatic detection of text on road sign (guid signs and limit signs) on highway to provide drivers information for navigation, such as location, direction, and speed limit. It may also alleviate the load of driver who may lose his/her attention looking at road signs while focusing on driving. For 2008 Olympic in Beijing, there will be many foreigner visiting China and not all of them understand Chinese language. Hence, the translation of text on road sign is another goal that can be accomplished.
In this thesis, a set of feature is devised to detect road signs. The proposed system consists of three modules. The first module finds the constituting colors of road signs using the color transform model and locates road sign candidates. In the second module, affine transformation is performed to restore road signs which are captured by camera in different positions to let every road sign seems to be vertical to the camera optical axis. Moreover, affine transformation can improve the accuracy in detecting texts embedded in road signs. As to the third module, it performs the task of detecting texts on road signs. The method we adopt is canny edge detector to obtain clearer edge information.
Experiments were conducted on a variety of situations. 20 video sequences (sunny*10 and cloudy*10) including light variations and straight or cursive road conditions were tested to verify the validity of the proposed method. The recall and precision rates in locating road sign are 91.1% and 80.8%, respectively. The recall and precision rates in detection text are 93.6% and 88.0%.

關鍵字(中)

★ 道路牌定位
★ 文字偵測
★ 仿射校正

關鍵字(英)

★ text detection
★ sign location
★ affine

論文目次

Abstract i
摘要 iii
附圖目錄 vii
表格目錄 ix
第一章緒論 1
1.1 研究動機 1
1.2 相關研究 2
1.3系統流程 6
1.4 論文架構 7
第二章 Karhunen-Loève 轉換 8
2.1 Karhunen-Loève 轉換 8
2.2放射狀基底函數網路 12
2.2.1 網路架構 12
2.2.2 訓練神經網路 13
第三章道路牌的定位 15
3.1 道路牌定位 18
3.2候選區域的篩選 22
第四章仿射校正 24
4.1 候選區域的分析 25
4.1.1區域填充 26
4.1.2參數的取得 28
4.2 轉換參數的估計與校正 31
第五章文字的偵測 35
5.1邊緣偵測之方法探討 36
5.2 Canny 邊緣偵測 39
第六章實驗結果與討論 43
6.1實驗資料 43
6.2 在各環境下之實驗結果 44
6.3錯誤分析及討論 49
第七章結論與未來工作 53
7.1結論 53
7.2未來工作 54
參考文獻 56

參考文獻

[1] N. Otsu,“A threshold selection method from gray level histogram,”IEEE Trans. On Systems, Man, and Cybernetics, SMC-8, pp.62-66, 1978.
[2] http://www.freeway.gov.tw/11_92_05_02.asp
[3] K. Jung, K. In Kim and A. K. Jain, “Text information extraction in images and video: a survey,” Pattern Recognition, vol.37 pp.977-997, 2004.
[4] R. Lienhart and A. Wernicke, “Localizing and segmenting text in images, videos and web pages,” IEEE Trans. Circuits Syst. Video Technol., vol.12, no. 4, pp. 256-268, Apr. 2002.
[5] M. R. Lyu, J. Song and M. Cai, “A comprehensive method for multilingual video text detection, localization, and extraction,” IEEE Trans. Circuits Syst. Video Technol., vol.15, no. 2, Feb. 2005.
[6] J. P. Peters, C. Thillou and S. Ferreira, “Embedded reading device for blind people： a User-Centered Design,” in Proceeding of Imagery Pattern Recognition Workshop , 1550-529/04, 2004.
[7] N. Ezaki, M. Bulacu and L. Schomaker, “Text detection from natural scene images：towards a system for visually impaired persons,” in Proceeding of International Conference on Pattern Recognition, 2004.
[8] C. Y. Fang, S. W. Chen and C. S. Fuh, “Road-sign detection and tracking,” IEEE Trans. Vehicular Technol., vol. 52 no.5, Sep. 2003.
[9] X. Chen, J. Yang, J. Zhang, A. Waibel, “Automatic detection and recognition of signs from natural scenes,” IEEE Trans. Image Processing, vol. 13, 2004.
[10] H. Li, D. Doermann, and O. Kia, “Automatic text detection and tracking in digital video,” IEEE Trans. Image Proceeding, vol.9, pp.147-156, 2000.
[11] Y. Zhong, K. Karu, and A. K. Jain, “Locating text in complex color images,” Pattern Recognition, vol.28, no.10, pp. 1523-1536, 1995.
[12] J. T. Tou, R. C. Gonzalez, Pattern Recognition Principles, pp.271 – 283, 1974.
[13] 蘇木春, 張孝德, 機器人學習類神經網路,模糊系統以及基因演算法則, 全華科技圖書股份有限公司,2003年12月二版六刷.
[14] Z. Sun, G. Bebis, and R. Miller, “On-road vehicle detection using optical sensors: a view,” in Proceeding of IEEE Intelligent Transportation Systems Conference, pp.585-590, Washington, D.C., USA, Oct. 3-6, 2004.
[15] Y. K. Lim, S. H. Choi, S. W. Lee, “Text extraction in MPEG compressed video for content-based indexing,” in Proceeding of 15th ICPR, vol. 4, 2000, pp.409-412.
[16] J. C. Rojas and J. D. Crisman, “Vehicle detection in color images,” in Proceeding of IEEE Conference on Intelligent Transportation System, pp.403-408, 1997.
[17] L. W. Tsai, J. W. Hsieh, and K. C. Fan, “Vehicle detection using normalized color and edge map,” IEEE International Conference On Image Processing, vol.2, pp.598-pp.601, 2005.
[18] R. C. Gonzalez, R. E. Woods, Digital Image Processing, 2nd edition, Prentice-Hall , Upper Saddle River, NJ, 2002.
[19] J. F. Canny,“A computation approach to edge detection,”IEEE Trans. On Pattern Analysis and Machine Intelligence, 1986, vol. 8, pp.679-pp.698.
[20] W. Wu, X. Chen, J. Yang,“Incremental detection of text on road signs from video with application to a driving assistantsystem,”in ACM Multimedia (MM '04), New York, USA, 2004.
[21] G. Loy, N. Barnes, “Fast shaped-based road sign detection for a Driver Assistance System,” in Proceeding of IROS 2004, 2004.
[22] J. Miura, T. Kanda, Y. Shirai, “An active vision system for real-time traffic sign recognition,” Proceedings of the IEEE Intelligent Vehicle Symposium, Dearborn, MI, pp. 52-57.
[23] M. Steck, R. Müller, “Road sign recognition - RSR200,” Computer Perception Group, School of Engineering and Information Technology - Berne University of Applied Sciences, Germany, 2003.
[24] G. Healey, “Segmenting images using normalized color,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 22, pp. 64-73, 1992.

指導教授

范國清(Kuo-Chin Fan)

審核日期

2006-7-6

推文