基於雙眼視覺之物件位置偵測及計算

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：117

、訪客IP：18.223.241.186

姓名

徐啟勝(Chi-sheng Hsu) 查詢紙本館藏

畢業系所

電機工程學系

論文名稱

基於雙眼視覺之物件位置偵測及計算
(The position detection and calculation of the object via a binocular vision)

相關論文

★ 直接甲醇燃料電池混合供電系統之控制研究	★ 利用折射率檢測法在水耕植物之水質檢測研究
★ DSP主控之模型車自動導控系統	★ 旋轉式倒單擺動作控制之再設計
★ 高速公路上下匝道燈號之模糊控制決策	★ 模糊集合之模糊度探討
★ 雙質量彈簧連結系統運動控制性能之再改良	★ 桌上曲棍球之影像視覺系統
★ 桌上曲棍球之機器人攻防控制	★ 模型直昇機姿態控制
★ 模糊控制系統的穩定性分析及設計	★ 門禁監控即時辨識系統
★ 桌上曲棍球：人與機械手對打	★ 麻將牌辨識系統
★ 相關誤差神經網路之應用於輻射量測植被和土壤含水量	★ 三節式機器人之站立控制

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

本研究目的為設計機械手臂之雙眼視覺系統(binocular vision system)。此視覺系統主要功能為可以偵測、計算出目標物件於三維空間中的位置，並透過其所求出的資訊協助機械手臂順利到達所要求之位置，完成抓取物件的目標。本雙眼視覺系統包含裝置於機械手臂上之肩膀位置的兩顆CCD，以及一台筆記型個人電腦。本研究除了使用兩顆CCD外，並無加裝任何距離感測器(range sensor)進行目標物件深度量測。使用雙CCD擷取目標物件於環境中的影像，再利用各種影像處理(image processing)方法擷取目標物件之特徵點(feature points)，接著利用這些特徵點計算出目標物件中心點於影像平面上之像素距離，建立雙眼視覺成像模型；為了求出目標物件於真實世界中的正確位置，本研究使用座標轉換(coordinate transformation)公式推導出三維重建座標，將物件影像中的二維像素座標轉換成空間中之三維座標，以求出目標物件所在位置。換句話說，三維座標即是求出目標物件與機械手臂原點於空間中的三軸距離。所以，透過雙眼視覺系統所求得目標物件於空間中之三維座標資訊，可以使機械手臂完成以下三大任務：任務一、穩穩的抓取雞蛋並放入碗中；任務二、抓取裝有水的保溫瓶並將水倒入馬克杯中；任務三、精確按壓電梯面板上的按鈕。最後，經由實際的實驗與測試可證明本雙眼視覺系統是非常有效的。

摘要(英)

The purpose of this study is to design a binocular vision system for a robot arm. The vision system can detect the target object and calculate its position in 3D space such that the robot arm can reach the target object according to the information from the vision system. The binocular vision system includes two CCDs which are installed in the shoulder of the robot arm and a person computer. Except two CCDs, there is not any other sensor. The CDDs capture the target image and then the image goes through some image processing to catch the feature points of the target object. Based on the feature points, the central point of the target object is obtained. A binocular vision model is constructed to calculate the 3D coordinate of the object from 2D image coordinate by the coordinate transformation formulas. In other words, the distances in 3D space between the target object and the original point of the robot arm is determined. Therefore, according to the calculated 3D coordinate of the target object, the robot arm can achieve three tasks. The first is that holding an egg and put it into a bowl; the second is grasping a bottle filled with water and pour the water into a cup; and the last one is pressing the exact number of elevator buttons. Finally, there are practical experiments to demonstrate the effectiveness of the binocular vision system.

關鍵字(中)

★ 座標轉換
★ 特徵點
★ 距離感測器
★ 雙眼視覺系統
★ 影像處理

關鍵字(英)

★ binocular vision system
★ range sensor
★ coordinate transformation
★ feature points
★ image processing

論文目次

摘要 I
Abstract II
致謝 III
目錄 IV
圖目錄 VI
表目錄 IX
第一章緒論 1
1.1 研究背景與動機 1
1.2 文獻回顧 1
1.3 論文目標 3
1.4 論文架構 3
第二章系統架構與實驗環境介紹 5
2.1 系統架構介紹 5
2.1.1 筆記型電腦 7
2.1.2 CCD 8
2.1.3 使用者介面 8
2.2 實驗物件介紹 10
第三章影像處理與特徵擷取 12
3.1影像處理 12
3.1.1 影像參考白處理 12
3.1.2 色彩空間模型 13
3.1.3 二值化處理 15
3.1.4 連通物件 22
3.2 物件影像特徵點擷取 23
3.2.1 邊緣偵測 23
3.2.2 角點偵測 25
3.3 物件影像辨識 26
第四章雙眼視覺系統 31
4.1 CCD內部參數調整 32
4.2 雙眼視覺系統 34
4.2.1 CCD成像原理 34
4.2.2 座標系統轉換 37
4.2.3 三維座標量測實驗 39
4.2.4 雙眼視覺系統輔助機器手臂倒水 58
4.2.5 電梯按鈕亮燈辨識 59
第五章實驗成果 61
5.1 實驗環境限制 61
5.2 抓蛋入碗 65
5.3 倒水 67
5.4 按壓電梯按鈕 69
第六章結論與未來展望 71
6.1 結論 71
6.2 未來展望 72
參考文獻 74

參考文獻

[1] 曾宣僑(王宗一教授指導)，“具人機互動之服務型機器人”，國立成功大學工程科學研究所碩士論文，2009年。
[2] X. Zeng, G. J. Zhao, Y. P. Wang, C. R. Wang and J. H. Wang, “Research on the elevator door control system based on the image processing technology,” in Proceedings of 2010 IEEE International Conference on Electrical and Control Engineering, China, November 2010, pp. 1781-1784.
[3] J. G. Kang, S. Y. An and S. Y. Oh, “Navigation strategy for the service robot in the elevator environment,” in Proceedings of 2007 IEEE International Conference on Control, Automation and Systems, Korea, October 2007, pp. 1092-1097.
[4] 徐世昌(王宗一教授指導)，“郵件機器人之路徑規畫與實現”，國立成功大學工程科學研究所碩士論文，2007年。
[5] 王金發(王元凱教授指導)，“人臉偵測於數位相機自動對焦之應用”，輔仁大學資訊工程研究所碩士論文，2006年。
[6] K. Deb and K. H. Jo, “HSI color based vehicle license plate detection,” in Proceedings of 2008 IEEE International Conference on Control, Automation and Systems, Korea, October 2008, pp. 687-691.
[7] 陳漢忠(王文俊教授指導)，“智慧型搭乘電梯機器人”，國立中央大學電機工程研究所碩士論文，2009年6月。
[8] T. I. J. Tsay and C. J. Chang, “Pose control of mobile manipulators with an uncalibrated eye-in-hand vision system,” in Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, Japan, 2004, pp. 3033-3038.
[9] 任紹棟(施慶隆教授指導)，“具立體視覺測距之移動機器人”，國立台灣科技大學電機工程研究所碩士論文，2007年。
[10] J. H. Lim and T. Y. Kuc, “Intelligent hybrid hierarchical architecture based object recognition system for robust robot vision,” in Proceedings of 2008 IEEE International Conference on Control, Automation and Systems, Korea, October 2008, pp. 2130-2133.
[11] 莊家碩(張文中教授指導)，“應用於手眼協調之即時視覺特徵追蹤系統”，國立東華大學電機工程研究所碩士論文，2000年。
[12] W. Li, G. Bebis and N. G. Bourbakis, “3-D object recognition using 2-D views,” IEEE Transactions on Image Processing, vol. 17, no. 11, pp. 2236-2255, 2008.
[13] B. Bhanu and J. Peng, “Adaptive integrated image segmentation and object recognition,” IEEE Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews, vol. 30, no. 4, pp. 427-441, 2000.
[14] I. Kokkinos and P. Maragos, “Synergy between object recognition and image segmentation using the Expectation-Maximization algorithm,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 8, pp. 1486-1501, 2009.
[15] T. Athanasiadis, P. Mylonas, Y. Avrithis and S. Kollias, “Semantic image segmentation and object labeling,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 3, pp. 298-312, 2007.
[16] 第二屆上銀智慧機械手競賽相關網站，
http://www.youtube.com/watch?v=dmSGJiPg2hI
[17] 2009台灣大學與交通大學共同研發之智慧型機器人相關網站，
http://www.youtube.com/watch?v=WtqA42ebBgU
[18] 2010台北國際機器人展相關網站，
http://www.youtube.com/watch?v=50Ehv9kcPXc&feature=fvwrel
[19] J. Y. Baek and M. C. Lee, “A study on detecting elevator entrance door using stereo vision in multi floor environment,” in Proceedings of 2009 ICROS-SICE, Japan, August 2009, pp. 1-4.
[20] K. Okada, M. Kojima, S. Tokutsu, T. Maki, Y. Mori and M. Inaba, “Multi-cue 3D object recognition in knowledge-based vision-guided humanoid robot system,” in Proceedings of 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, USA, October 2007, pp. 3217-3222.
[21] S. Winkelbach, S. Molkenstruck and F. M. Wahl, “Low-cost laser range scanner and fast surface registration approach,” in Proceedings of 2006 DAGM Symposium on Pattern Recognition, Germany, 2006, pp. 718-728.
[22] 許貿雄(蔡清元教授指導)，“視覺導引物件抓取之自走型機器人之姿態控制”，國立成功大學機械工程研究所碩士論文，2002年。
[23] 葉忠憲(宋開泰教授指導)，“移動式機械臂之抓物控制設計”，國立交通大學電機與控制工程研究所碩士論文，2006年。
[24] A. J. Davison and D. W. Murray, “Simultaneous localization and map-building using active vision,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 865-880, 2002.
[25] M. Bertozzi and A. Broggi, “Gold: a parallel real-time stereo vision system for generic obstacle and lane detection,” IEEE Transactions on Image Processing, vol. 7, no. 1, pp. 62-81, 1998.
[26] C. Chen and Y. F. Zheng, “Passive and active stereo vision for smooth surface detection of deformed plates,” IEEE Transactions on Industrial Electronics, vol. 42, no. 3, pp. 300-306, 1995.
[27] G. Toulminet, M. Bertozzi, S. Mousset, A. Bensrhair and A. Broggi, “Vehicle detection by means of stereo vision-based obstacles features extraction and monocular pattern analysis,” IEEE Transactions on Image Processing, vol. 15, no. 8, pp. 2364-2375, 2006.
[28] E. Grosso and M. Tistarelli, “Active/Dynamic stereo vision,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 9, pp. 868-879, 1995.
[29] 蔡柏謙(王文俊教授指導)，“基於逆向運動學之機械手臂控制”，國立中央大學電機工程研究所碩士論文，2011年6月。
[30] C. C. Weng, H. Chen and C. S. Fuh, “A novel automatic white balance method for digital still cameras,” in Proceedings of 2005 IEEE International Symposium on Circuits and Systems, Taiwan, May 2005, pp. 3801-3804.
[31] C. F. Juang, C. M. Chang, J. R. Wu and D. M. Lee, “Computer vision-based human body segmentation and posture estimation,” IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 39, pp. 119-133, 2009.
[32] H. Liu, C. Yang, X. Shu and Q. Wang, “A new method of shadow detection based on edge information and HSV color information,” in Proceedings of 2009 IEEE International Conference on Power Electronics and Intelligent Transportation System, December 2009, pp. 286-289.
[33] X. Yin, D. Guo and M. Xie, “Hand image segmentation using color and RCE neural network,” Robotics and Autonomous Systems, vol. 34, pp. 235-250, 2001.
[34] X. Deng, Y. Huang, S. Feng and C. Wang, “Adaptive threshold discriminating algorithm for remote sensing image corner detection,” in Proceedings of 2010 IEEE International Conference on Image and Signal Processing, October 2010, pp. 880-883.
[35] N. Otsu, “A thresholding selection method from gray level histograms,” IEEE Transactions on Systems, Man and Cybernetics, vol. 9, pp. 62-66, 1979.
[36] 陳翔傑(王文俊教授指導)，“自動化車牌辨識系統設計”，國立中央大學電機工程研究所碩士論文，2005年。
[37] F. Zhang, S. Zhou and W. Xie, “A line labeling and region growing based algorithm for binary image connected component labeling,” in Proceedings of 2010 IEEE International Conference on Circuits, Communications and System, August 2010, pp. 487-490.
[38] S. H. Chang, L. Gong, M. Li, X. Hu and J. Yan, “Small retinal vessel extraction using modified Canny edge detection,” in Proceedings of 2008 IEEE International Conference on Audio, Language and Image Processing, July 2008, pp. 1255-1259.
[39] W. He and X. Deng, “A modified SUSAN corner detection algorithm based on adaptive gradient threshold for remote sensing image,” in Proceedings of 2010 IEEE International Conference on Optoelectronics and Image Processing, November 2010, pp. 40-43.

指導教授

王文俊(Wen-june Wang)

審核日期

2011-7-1

推文