基於AI技術之麵包蔬果辨識計價電子秤

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Electrical Engineering > Electronic Thesis & Dissertation > Item 987654321/90110

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/90110

Title:	基於AI技術之麵包蔬果辨識計價電子秤
Authors:	蔡沂倢;Cai, Yi-Chieh
Contributors:	電機工程學系
Keywords:	深度學習;目標偵測;分類辨識;蔬果辨識;麵包辨識;deep learning;object detection;image classification;vegetable recognition;fruit recognition;bread recognition
Date:	2022-09-13
Issue Date:	2022-10-04 12:11:22 (UTC+8)
Publisher:	國立中央大學
Abstract:	大賣場部分商品，如蔬菜、水果和麵包，未貼結帳條碼，必須經過過磅程序取得結帳條碼才可前往結帳，有時客人太多，店員無法及時協助過磅，浪費不少時間。因此本論文旨在建立一套基於AI技術之麵包蔬果計價系統，顧客只要將購買的商品放置電子秤上，系統會自動辨識磅秤上的物品為蔬果類還是麵包類，然後依照單價重量計價，或是依照個數計價，再依照結帳網站操作，直到所有購買物品過磅完畢，並列印購物清單。如此可以大幅減少賣場人力需求，以及節省顧客等待人工過磅所花費的時間。文獻[1]可辨識40種蔬果，並且蔬果可放置於彩色塑膠袋，本論文以此為基礎進行功能擴充，新增麵包與綠色葉菜的辨識與計價。考慮到辨識種類增加，本論文將辨識種類分為三大類：蔬果類、葉菜類與麵包類。本論文目標辨識的葉菜類為綠色葉菜，因此使用HSV色彩空間搭配辨識網路模型將葉菜類初步分隔出，再使用YOLOv5m6網路架構偵測與初步分辨蔬果類與麵包類，若為蔬果類，依照論文[1]的方法處理。若為葉菜類或麵包類，使用EfficientNet-B6網路架構分別辨識10種葉菜或25種麵包。考慮到購買麵包數量較多時，餐盤上的麵包可能會緊密擺放或堆疊，本論文設計一個提昇麵包準確率的遮蔽機制，降低麵包堆疊的影響，提升麵包辨識準確率。此系統總共可辨識40種蔬果、10種葉菜與25種麵包，使用在白色光源下所蒐集之測試資料進行測試，蔬果辨識準確率達到96.9%[1]，葉菜辨識準確率達到98.6%，麵包辨識準確率達到99.5%。本論文改良結帳網站[1]，新增麵包過磅介面，並且介面有詳細說明文字引導使用者完成過磅流程。 [1]董吉峰：〈基於AI技術之蔬果辨識計價電子秤〉。碩士論文，國立中央大學，民國110年6月。 ;Sometimes there are too many customers, and manual weighing will inevitably encounter more customers. The clerk could not assist in weighing in time and waste a lot of time for the customer. Therefore, this thesis aims to establish a pricing system based on AI technology for recognizing vegetables, fruits, and breads. When the customer puts the purchased items on the electronic scale, the system will automatically recognize whether the items are vegetables, fruits, or pieces of bread. Then total price calculates according to the weight or the quantity. Customers follow the checkout website until all purchases are weight, then a shopping list is printed. This can greatly reduce the manpower requirements of the store and save the time customers waiting for one-to-one staff assistance. Literature [1] recognized 40 kinds of fruits and vegetables placed in colorful plastic bags. This thesis improves on this basis by adding bread and green leafy vegetables. Considering the increase in recognizing items, this thesis divides the items into three categories: fruits and vegetables, leafy vegetables and breads. The YOLOv5m6 network architecture is used to detect and preliminarily recognize the vegetables, fruits, and breads, and calculate the number of items at the same time. The EfficientNet-B6 network architecture was used to recognize 10 kinds of leafy vegetables and 25 kinds of bread, respectively, and weighted majority voting was used for fruit and vegetable recognition [1]. Considering that when a large number of breads are purchased, the breads on the plate may be closely placed or stacked. This thesis designs a masking mechanism to improve the accuracy of bread recognition. This mechanism can reduce the influence of bread stacking, and improve the accuracy of bread recognition. The system can recognize a total of 40 kinds of vegetables and fruits, 10 kinds of leafy vegetables and 25 kinds of bread. All the testing data are taken under the white light. The accuracy rate of vegetable and fruit recognition is 96.9% [1], the accuracy of leafy vegetables recognition is 98.6%, and the accuracy of bread recognition is 99.5%. This thesis improves the checkout website [1]. A new bread weighing interface will be added to the webpage, and the description text will be added to the interface to guide users through the weighing process.
Appears in Collections:	[Graduate Institute of Electrical Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	53	View/Open

社群 sharing

Loading...