| 姓名 |
施宣宇(Hsuan-yu Shih)
查詢紙本館藏 |
畢業系所 |
太空科學研究所 |
| 論文名稱 |
立體影像對自動特徵點提取進行三維重建
(3D reconstruction with automatic feature extraction from stereo images)
|
| 相關論文 | |
| 檔案 |
 [Endnote RIS 格式]
[Bibtex 格式]
 [相關文章]  [文章引用]  [完整記錄]  [館藏目錄]  [檢視] [下載]- 本電子論文使用權限為同意立即開放。
- 已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
- 請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。
|
| 摘要(中) |
利用立體影像對重建三維目標已被研究數十年。在這期間，針對三維目標重建結構簡單且平滑的目標物已相當的成功，但對複雜與獨特的目標物，例如大範圍的地形、房子，或者是比較複雜的人臉，在三維重建仍有相當的困難。在本研究中，利用地形影像立體對與人臉影像立體對進行實驗，我們得到立體影像對後進行自動化特徵提取且進而重建三維影像，而實驗中會利用手動特徵點來輔助與確認自動特徵點的可靠性。為了達成高穩定性與效率的匹配特徵點，我們選用了尺度不變特徵轉換演算法，其利用高斯金字塔偵測特徵點，再者提供特徵描述運算子使特徵點更獨特，提高最後利用特徵匹配的準確性，最後特徵匹配依據最小歐氏距離，且為了使特徵點對更符合立體視覺的條件，加入了角度和距離的限制提高影像匹配的成功率。得到特徵匹配點後，利用雙眼立體視覺定理的公式求得三維座標進而線性內插求得三維影像，得到初始三維影像後在利用中位數濾波器去除雜訊得到較平滑的影像。在研究地形影像時，將兩種提取特徵的方法與數值地形模型進行比較，得出自動化提取特徵點的方法比手動更好、更有效率且能提取出更多的特徵點使影像更平滑，並可以利用手動特徵點的結果驗證自動化的可靠性。在人臉影像方面，發現上下垂直拍照的結果會比左右平行拍好，因為可以避免左右臉頰特徵點的誤差。 |
| 摘要(英) |
To construct 3-D objects from stereo images has been studied for decades. It shows some success for construction of simple objects with smooth surfaces, but in complex and unique object, such as a large terrain, house, or more complicate human face, that still remain an issue for 3-D reconstruction. In this study, we acquire the terrain aerial photos and facial images for our research, to construct 3-D model with automatic feature extraction from stereo photos without any models. To achieve robustness and efficient matching of features, we adopt Scale-Invariant Feature Transform (SIFT) algorithm to detect the feature with the Gaussian pyramid and find the feature descriptors which make the features more distinctive, hence, the feature matching can be efficiently accomplished based on Euclidean distance. Moreover, those matching pairs must satisfy the Stereoscopic vision between two images, therefore, the angle and distance constraints for features are added before feature matching to improve the accuracy of matching pairs and stereo vision. Then, the 3-D model can be reconstructed by solving the binocular stereo vision theorem from feature pairs in stereo photos, the error estimated of depth can be smooth by the median filter. Finally, we compare two feature extraction methods to the Digital Terrain Model. Compare to manual extraction, the automatic feature extracted method is much better, more efficient and provides more matched features, and therefore, it shows better results for the studies of the topographic images in 3-D construction. In accuracy assessment, we compare to the results of manual extraction to verify the reliability of the automatic method. Our experimental results in the facial images show that taking stereo pictures vertically is much better than horizontally, because vertical direction can avoid errors of feature matching in the edges of cheeks. |
| 關鍵字(中) |
★ 雙眼立體視覺
★ 尺度不變特徵轉換
★ 特徵提取
★ 三維重建 |
關鍵字(英) |
★ Binocular stereo vision
★ Scale-Invariant Feature Transform (SIFT)
★ feature extraction
★ 3-D construction |
| 論文目次 |
摘要 i
Abstract ii
List of Figures iv
Chapter 1 Introduction 1
1.1 Motivation 1
1.2 Purpose of Research 2
1.3 The Process of Research 3
1.4 The Thesis Organization 5
Chapter 2 Methodology 6
2.1 Principle of Binocular Stereo Vision 6
2.2 Scale Invariant Feature Transform (SIFT) 8
2.2.1 Feature Extraction 9
2.2.2 Feature Description 13
2.2.3 Feature Matching 15
Chapter 3 Experiment in remote sensing images 16
3.1 Scene for Sanyi Township 16
3.2 Scene for Caotun Township 23
Chapter 4 Experiment in Facial images 30
4.1 3D Facial Reconstruction with Binocular Stereo Vision 30
4.2 Horizontal Photos with SIFT 32
4.3 Vertical Photos with SIFT 37
4.4 Low Contrast Vertical Photos with SIFT 40
Chapter 5 Conclusions and Future Works 44
5.1 Conclusions 44
5.2 Future Works 45
Bibliography 46
|
| 參考文獻 |
[1] Quigley, N. and Lyne, J. E. Development of a Three-Dimensional Printed, Liquid-Cooled Nozzle for a Hybrid Rocket Motor. Journal of Propulsion and Power, Vol. 30, No. 6, pp. 1726-1727, 2014.
[2] Forsyth, D. A. and Ponce, J. Computer vision: a modern approach. Upper Saddle River, N.J, London: Prentice Hall, 2003.
[3] Tseng, D.C. Virtual Reality Course Website:
http://ip.csie.ncu.edu.tw/course/VR/VR1002p.pdf.
[4] Wang, C.X. and Sun, Y.H. A new method of depth measurement with binocular vision based on SURF. 2009 Second International Workshop on Computer Science and Engineering, Vol.1, pp. 568 – 571, 2009.
[5] Lowe, D.G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60, 2, pp. 91-110, 2004.
[6] Lindeberg, T. 1994. Scale-space theory: A basic tool for analyzing structures at different scales. Journal of Applied Statistics, 21(2):224–270.
[7] Brown, M. and Lowe, D.G. Invariant features from interest point groups. In British Machine Vision Conference, Cardiff, Wales, pp. 656–665, 2002.
[8] Szeliski, R. Computer vision: algorithms and applications. London, New York: Springer, 2011.
[9] Code project website:
http://www.codeproject.com/Articles/619039/Bag-of-Features-Descriptor-on-SIFT-Features-with-O.
[10] 行政院農業委員會林務局農林航空測量所，叢刊第112號，航照立體像片對II，中華民國96年6月。
[11] MATLAB/C implementation of the SIFT detector and descriptor website:
http://www.robots.ox.ac.uk/~vedaldi/code/sift.html.
[12] Mark, N. and Alberto, A. Feature extraction and image processing. Nixon, Mark S. Amsterdam; Boston: Academic, 2008.
[13] Mikolajczyk, K. Detection of local features invariant to affine transformations,
Ph.D. thesis, Institut National Polytechnique de Grenoble, France, 2002.
|
| 指導教授 |
任玄(Hsuan Ren)
|
審核日期 |
2015-8-21 |
| 推文 |
 facebook  plurk  twitter  funp  google  live  udn  HD  myshare  reddit  netvibes  friend  youpush  delicious  baidu
|
| 網路書籤 |
 Google bookmarks  del.icio.us  hemidemi myshare
|
