整合深度學習與機器視覺之微小電子連結器智慧整料系統開發;Development of An Intelligent Material Handling System Integrating Deep Learning and Machine Vision for Micro Connector

NCU Institutional Repository > 工學院 > 光機電工程研究所 > 博碩士論文 > Item 987654321/96164

jsp.display-item.identifier=請使用永久網址來引用或連結此文件: http://ir.lib.ncu.edu.tw/handle/987654321/96164

题名:	整合深度學習與機器視覺之微小電子連結器智慧整料系統開發;Development of An Intelligent Material Handling System Integrating Deep Learning and Machine Vision for Micro Connector
作者:	陳振榮;Chen, Zhen-Rong
贡献者:	光機電工程研究所
关键词:	微小電子零件辨識;YOLOv8;機器視覺;六軸機械手臂;ROS(Robotic Operation System);物件偵測夾取系統;Recognition of micro connectors;YOLOv8;Machine vision;Six-axis robot arm;ROS(Robotic Operation System);Object detection grasping system
日期:	2025-02-25
上传时间:	2025-04-09 16:15:37 (UTC+8)
出版者:	國立中央大學
摘要:	隨著AI技術的進步，智慧化機器人技術已然成為趨勢，它能夠擁有如同人類般的感知能力，以便執行更加複雜的任務與目標，電子廠內，對於電子零件所導入的自動化產線已相當成熟，但對於少量多樣的電子連結器裝配任務，建置其自動化產線與振動盤相對耗費成本，故本研究旨於打造一套使用機械手臂、機器視覺及深度學習的散料夾取系統，以適應微小電子連結器的複雜特徵與環境，將其嵌入本系開發之類產線架構中，成功實現了彈性產線，解決自動化產線與振動盤的高昂成本及缺工問題。本論文使用YOLOv8物件偵測模型，並以資料擴增(Data augmentation)的方法，以當前環境亮度±25%之光源進行訓練，進而提升穩健性，物件偵測模型會自動產生許多的候選框(Boundingbox)，透過Non Maximum Suppression(NMS)方法，濾除多餘的候選框，為了提升組裝成功率，本研究設計了用於整理微小電子連結器姿態的轉接治具，根據物件框選中心與影像質心位置計算其夾取之開口方向，由於組裝插件有方向性需求，故需以開口向上、下以及正反面，四種特徵設定其放料姿態，置放於轉接治具中，接著會等待轉盤的訊號收發，將轉接治具上的電子連結器夾持至插端子治具上，為了提升組裝準確率，亦開發了一套標定演算法與標定治具，嵌入於插入微小電子連結器的治具上，以判定組裝的插槽實際位置，完成後，透過IO訊號發送任務結束訊號給轉盤，以切換下一組治具，達成自動化彈性產線。 ;With the advancement of AI technology, intelligent robotic system have become a fashion trend. These systems are capable of processing human-like perception, allowing them to perform more complex tasks and objectives. In electronic factories, the automation of production lines for electronic components has become quite mature. However, for the assembly tasks of a variety of electronic connectors in small quantities, the cost of building automated production lines and vibration feeders is quite high. Therefore, this study aims to develop a grasping system using robotic arms, machine vision, and deep learning to adapt to the complex features and environment of micro electronic connectors. This system is integrated into the production line framework developed in this study, successfully achieving a flexible production line and address the high costs of traditional automated lines and vibration feeders, as well as labor shortages. This paper uses the YOLOv8 object detection model and applies data argumentation techniques to train the model under varying lighting conditions with brightness adjustments, thereby enhancing robustness. The object detection model automatically generates multiple candidate bounding boxes. These are filtered by the Non-Maximum Suppression(NMS) method to remove redundant boxes. To improve the assembly success rate, this study designs an adapter fixture to arrange the pose of micro connectors. The gripper orientation is determined by calculating the direction of the opening based on the center of the bounding box and the image centroid. Since the assembly of the connectors requires a specific orientation, the object is placed with the opening facing up, down, or either the front or back, setting four distinct features for its pose within the adapter fixture. Then, the system waits for the signal from the rotary table to transfer the electronic connector from the adapter fixture to the insertion fixture. To enhance assembly accuracy, a calibration algorithm and calibration fixture are developed and integrated into the insertion fixture to determine the actual position of the assembly groove. Once completed, an IO signal is sent to the rotary table to confirm end the task, prompting the switch to the next fixture, thus achieving an automated, flexible production line.
显示于类别:	[光機電工程研究所 ] 博碩士論文

文件中的档案:

档案	描述	大小	格式	浏览次数
index.html		0Kb	HTML	27	检视/开启

在NCUIR中所有的数据项都受到原著作权保护.

社群 sharing

数据加载中.....