航空監控影像之區域切割與分類

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：13

、訪客IP：18.221.41.214

姓名

吳鼎汶(Hendrik) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

航空監控影像之區域切割與分類
(Region Segmentation and Labeling in Aerial Surveillance Images)

相關論文

★ 影片指定對象臉部置換系統	★ 以單一攝影機實現單指虛擬鍵盤之功能
★ 基於視覺的手寫軌跡注音符號組合辨識系統	★ 利用動態貝氏網路在空照影像中進行車輛偵測
★ 以視訊為基礎之手寫簽名認證	★ 使用膚色與陰影機率高斯混合模型之移動膚色區域偵測
★ 影像中賦予信任等級的群眾切割	★ 在群體人數估計應用中使用不同特徵與回歸方法之分析比較
★ 以視覺為基礎之強韌多指尖偵測與人機介面應用	★ 在夜間受雨滴汙染鏡頭所拍攝的影片下之車流量估計
★ 影像特徵點匹配應用於景點影像檢索	★ 自動感興趣區域切割及遠距交通影像中的軌跡分析
★ 基於回歸模型與利用全天空影像特徵和歷史資訊之短期日射量預測	★ Analysis of the Performance of Different Classifiers for Cloud Detection Application
★ 全天空影像之雲追蹤與太陽遮蔽預測	★ 在全天空影像中使用紋理特徵之雲分類

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

近年來空照監控影像的需求不斷增加，其應用範圍廣泛，主要用在軍事與交通運輸上。在交通運輸方面，空照監控影像不但能讓警察掌握交通狀況還能協助道路秩序之管理。為了能自動化地處理空照影像，必須先對影像中的物件與區域進行分割與標記的動作，如物件偵測、事件偵測、等。
本論文提出一套自動化空照影像之區域分割與分類系統。任何影像分割的演算法都可以套入本系統中。其中比較了兩種分割演算法，分別是分水嶺(Watershed)與均值偏移(Mean-shift)分割演算法，但由於上述演算法會導致區域被過度切割，故本系統將過小的區域進行合併。其合併方式是根據八連通的方式建構一個無向圖(undirected graph)，將影像中的每個區域視為一個頂點(vertex)，而連接兩區域的邊(edge)會給定一個權重(weight)，該權重代表兩區域的相異程度，再根據該權重對鄰近的小區域進行合併。而對於每個區域，本系統會擷取其顏色與紋理特徵，並使用支持向量機(Support Vector Machine)將每個區域進行分類的動作，最後再將同類的鄰近區域合併，獲得最終的分類結果。經實驗證實，本論文所提出的方法能有效的對各種空照影像進行分割與分類。

摘要(英)

The demand for aerial surveillance video keeps growing in recent years. It has been proved to be an effective way to collect information for a wide range of applications, such as intelligence transportation or military applications. In intelligence transportation applications, aerial surveillance not only provides traffic monitoring but also assists traffic management. Manual labeling of objects and regions in aerial videos is a tedious task. Objects and regions in aerial videos need to be segmented and labeled to enable automated video processing, such as object detection, event detection, automated aerial videos understanding, etc.
In this thesis we propose an automatic image segmentation and labeling system for aerial surveillance images. Any kind of segmentation algorithm can be applied in our system. In this work, we compare watershed and mean-shift segmentation algorithms. Because the above mentioned segmentation algorithms might lead to over-segmentation, small regions need to be merged. We then construct an undirected-graph based on 8-connected local neighborhood, where each region is a vertex and the weight of edge connecting two regions is the dissimilarity measure of this two regions. Adjacent small regions are merged according to the weights of the edges. For each region we extract low-level features and use Support Vector Machine (SVM) classifier to label the region. Based on the output of the SVM classifier adjacent regions with the same label will be further merged to obtain the final labeling result. The experimental results have shown that our proposed system can effectively segment and label various aerial images.

關鍵字(中)

★ 空照監控
★ 區域分割
★ 影像分類

關鍵字(英)

★ image labeling
★ region segmentation
★ aerial surveillance

論文目次

CONTENTS
ABSTRACT i
摘要 ii
CONTENTS iii
LIST OF FIGURES v
LIST OF TABLES vii
CHAPTER 1 INTRODUCTION 1
1.1 Motivation 2
1.2 Related Work 3
1.3 Thesis Organization 9
CHAPTER 2 REVIEW OF RELEVANT TECHINQUES 10
2.1 Gradient Magnitude 10
2.2 Watershed Segmentation 12
2.3 Mean-Shift Segmentation 15
2.4 Support Vector Machine (SVM) 19
CHAPTER 3 PROPOSED SYSTEM 22
3.1 Graph Construction 23
3.2 Feature Extraction 26
3.2.1 Color features 27
3.2.2 Texture Features 29
3.3 Classification 30
CHAPTER 4 EXPERIMENTAL RESULTS 32
4.1 System Environment and Dataset 32
4.2 Recall, Precision and F-Score 33
4.3 Experimental results by using Texture Features 33
4.4 Experimental Results by Using Color Features 35
4.5 Experimental Results by Combining Color and Texture Features 36
4.6 Discussion of experimental results 38
4.7 Performance Analysis 40
CHAPTER 5 CONCLUSIONS 44
REFERENCES 46

參考文獻

[1] Lin.Renjun, X. Cao, Y. Xu, C. Wei and H. Qiao, "Airborne moving vehicle detection for video," in Intelligent Transportation Systems, 2008.
[2] J. Choi and Y. Yang, "Vehicle detection from aerial images using local shape information," in PSIVT, 2009.
[3] E. Pakizeh and M. Palhang, "Building detection from aerial images using Hough transform and intensity information," in 18th Iranian Conference on Electrical Engineering, 2010.
[4] H. Cheng, D. Butler and C. Basu, "ViTex: Video To Tex and Its Application in Aerial Video Surveillance," in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006.
[5] O. O. Karadag and F. T. Y. Vural, "HANOLISTIC: A hierarchical automatic image annotation system using holistic approach," in Computer Vision and Pattern Recognition Workshops, 2009.
[6] P. Duygulu, K. Barnard, J. De Freitas and D. Forsyth, "Object recognition as machine translation : Learning a lexicon for a fixed image vocabulary," in Proceedings of the 7th European Conference on Computer Vision-Part IV, 2002.
[7] J. Jeon, V. Lavrenko and R. Manmatha, "Automatic image annotation and retrieval using cross-media relevance models," in Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval, 2003.
[8] L. V, R. Manmatha and J. Jeon, "A Model for learning the semantics of pictures," in Advances in Neural Information Processing Systems 16, 2004.
[9] E. Akbas and F. T. Y. Vural, "Automatic image annotation by ensemble of visual descriptors," in Computer Vision and Pattern Recognition CVPR, 2007.
[10] J. Canny, "A computational approach to edge detection," IEEE Transactions on Pattern Analysis and Machine Inteligence, vol. 8, no. 6, pp. 679-698, 1986.
[11] N. Kanopoulos, N. Vasanthavada and R. L. Baker, "Design of an image edge detection filter using the Sobel operator," IEEE Journal of Solid-State Circuits, vol. 23, no. 2, pp. 358-367, 1988.
[12] L. G. Shapiro and G. C. Stockman, Computer Vision, Prentice-Hall, 2001.
[13] N. Otsu, "A threshold selection method from gray-level histogram," IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS, vol. 9, no. 1, pp. 62-66, 1979.
[14] K. S. Tan and N. A. Mat Isa, "Color image segmentation using histogram thresholding – Fuzzy C-means hybrid approach," Pattern Recognition, vol. 44, no. 1, pp. 1-15, 2011.
[15] R. C. Gonzalez and R. E. Woods, Digital Image Processing, 2 ed., 2002.
[16] Y. Deng, B. S. Manjunath and S. Hyundoo, "Color image segmentation," in Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999.
[17] P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-based image segmentation," International Journal of Computer Vision, vol. 59, 2004.
[18] H. Cheng and D. Butler, "Segmentation of Aerial Surveillance Video Using a Mixture of Experts," in Digital Image Computing : Techniques and Applications, 2005.
[19] H. Cheng and C. A. Bouman, "Multiscale Bayesian segmentation using a trainable context model," IEEE Transactions on Image Processing, vol. 10, no. 4, pp. 511-525, 2001.
[20] D. Comaniciu and P. Meer, "Mean shift: a robust approach toward feature space analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, 2002.
[21] R. Kumar, H. S. Sawhney, J. C. Asmuth, A. Pope and S. Hsu, "Registration of video to geo-referenced imagery," in Proceedings International Conference on Pattern Recognition, 1998.
[22] H. S. Sawhney and R. Kumar, "True multi-image alignment and its application to mosaicing and lens distortion correction," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 3, pp. 235-243, 1999.
[23] T. Zhao, M. Aggarwal, R. Kumar and H. Sawhney, "Real-time wide area multi-camera stereo tracking," in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005.
[24] H. Tao, H. S. Sawhney and R. Kumar, "Object tracking with Bayesian estimation of dynamic layer representations," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 75-89, 2002.
[25] C. Cusano, R. Scettini and G. Ciocca, "Image annotation using SVM," in Proceedings of Internet Imaging IV, 2004.
[26] V. Risojevic and Z. Babic, "Aerial image classification using structural texture similarity," in IEEE International Symposium on Signal Processing and International Technology, 2011.
[27] P. Ahmadi and S. Sadri, "A two-step approach for surface type classification of aerial images," in IEEE International Conference on Communication and Software Networks, 2011.
[28] L. A. Vese and T. F. Chan, "A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model," International Journal of Computer Vision, vol. 50, no. 3, pp. 271-293, 2002.
[29] F. Meyer, "Topographic distance and watershed lines," Mathematical Morphology and its Applications to Signal Processing, vol. 38, no. 1, pp. 113-125, 1994.
[30] R. O. Duda, P. E. Hart and D. G. Stork, Pattern classification, Wiley, 2001.
[31] K. Fukunaga and L. Hostetler, "The estimation of the gradient of a density function, with applications in pattern recognition," IEEE Transactions on Information Theory, vol. 21, no. 1, pp. 32-40, 1975.
[32] Y. Cheng, "Mean shift, mode seeking, and clustering," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 790-799, 1995.
[33] C. Cortes and V. Vapnik, "Support vector networks," Machine Learning, vol. 20, no. 3, pp. 273-297, 1995.
[34] "RGB color space," [Online]. Available: http://en.wikipedia.org/wiki/RGB_color_space.
[35] "HSV Color Space," [Online]. Available: http://www.blackice.com/colorspaceHSV.htm.
[36] C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Transactions on Intelligent Systems and Technology, vol. 2, no. 3, pp. 27:1--27:27, 2011.
[37] G. Bradski, "The OpenCV Library," Dr. Dobb’’s Journal of Software Tools, 2000.
[38] MPEG (Moving Picture Experts Group), "MPEG-7 Overview," [Online]. Available: http://mpeg.chiariglione.org/standards/mpeg-7/mpeg-7.htm.
[39] M. Bastan, H. Cam, U. Gudukbay and O. Ulusoy, "Bilvideo-7: an MPEG-7- compatible video indexing and retrieval system," IEEE Multimedia, vol. 17, no. 3, pp. 62-73, 2010.
[40] M. Bastan, "MPEG-7 Feature Extraction Library," [Online]. Available: http://www.cs.bilkent.edu.tr/~bilmdg/bilvideo-7/Software.html.

指導教授

鄭旭詠(Hsu-Yung Cheng)

審核日期

2012-7-17

推文