基於深度學習之棒球好球帶辨識系統

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：57

、訪客IP：3.139.104.103

姓名

陳奕蘋(Yi-Ping Chen) 查詢紙本館藏

畢業系所

資訊工程學系

論文名稱

基於深度學習之棒球好球帶辨識系統
(A Baseball Strike and Ball Recognition System Based on Deep Learning)

相關論文

★ 以Q-學習法為基礎之群體智慧演算法及其應用	★ 發展遲緩兒童之復健系統研製
★ 從認知風格角度比較教師評量與同儕互評之差異：從英語寫作到遊戲製作	★ 基於檢驗數值的糖尿病腎病變預測模型
★ 模糊類神經網路為架構之遙測影像分類器設計	★ 複合式群聚演算法
★ 身心障礙者輔具之研製	★ 指紋分類器之研究
★ 背光影像補償及色彩減量之研究	★ 類神經網路於營利事業所得稅選案之應用
★ 一個新的線上學習系統及其於稅務選案上之應用	★ 人眼追蹤系統及其於人機介面之應用
★ 結合群體智慧與自我組織映射圖的資料視覺化研究	★ 追瞳系統之研發於身障者之人機介面應用
★ 以類免疫系統為基礎之線上學習類神經模糊系統及其應用	★ 基因演算法於語音聲紋解攪拌之應用

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

棒球被認為是台灣的國球，不管是場上的球員或是觀賽的球迷，有越來越多人開始投入這項運動。在棒球比賽中，投手扮演著非常重要的角色，一位好的投手可以主宰整場比賽的氣勢及節奏，然而裁判對於好球帶的判定是非常主觀的，往往成為影響比賽勝負的關鍵。有些職棒比賽採用電子好球帶輔助系統來提供投手好壞球資訊給觀眾球迷判定，但是在業餘比賽中會受限於場地限制或是設備較昂貴等因素而無法使用，因此本論文結合深度學習及影像處理技術做出類似但採用低成本的方式實做出一個好壞球辨識系統。
本論文之系統使用兩台低成本設備錄製投手投球影片，以YOLOv4模型進行棒球偵測，並且利用卡爾曼濾波器進行棒球軌跡預測及補影格。由於使用兩台攝影設備錄製影片，因此需要對影片做同步，本系統使用短時距傅立葉轉換擷取音訊特徵並且使用此特徵對齊影片時間。棒球比賽中的好球帶會依據本壘板位置及打者的身高做變化，本研究利用影像處理方式做本壘板偵測，並且使用OpenPose模型對打者進行骨架分析取得好球帶位置。
本研究利用實際至棒球場投球的資料集來評估本論文之系統有效性。根據實驗結果顯示，本系統在辨識好壞球時，準確率可以達到96%。

摘要(英)

Baseball is considered the national sport of Taiwan, and there are more and more people committed to this sport, whether it is the players on the field or the fans watching the game. In a baseball game, the pitcher plays a major role who can dominate the momentum and rhythm of the game, but the decision of the referee on the strike zone is very subjective and often becomes the key to winning or losing the game. Some professional baseball games use electronic strike zone assistance systems to provide pitchers with strike and ball information to the fans, but this is impossible in amateur games due to venue constraints or expensive equipment. Therefore, this paper combines deep learning and image processing techniques to make a similar but low-cost way to implement a strike and ball recognition system.
The system in this paper uses two low-cost devices to record pitcher′s pitching video, YOLOv4 model for baseball detection, and Kalman filter for baseball trajectory prediction and complementary frames. Since two cameras are used to record the video, it is necessary to synchronize the video. The system uses Short-time Fourier Transform to capture the audio features and uses this feature to align the video timing. The strike zone in a baseball game will change according to the position of the home plate and the height of the batter. This study uses image processing to detect the home plate and uses the OpenPose model to analyze the batter′s skeleton to obtain the location of the strike zone.
This study uses the dataset which is actually pitching at the baseball field to evaluate the effectiveness of the system in this paper. According to the experimental results,
the accuracy of the system in identifying strike and ball can reach 96%.

關鍵字(中)

★ 電子好球帶
★ 深度學習
★ 影像處理
★ 卡爾曼濾波器
★ 短時距傅立葉轉換

關鍵字(英)

★ Electronic Strike Zone
★ Deep Learning
★ Image Processing
★ Kalman Filter
★ Short-time Fourier Transform

論文目次

摘要 iv
Abstract v
誌謝 vii
目錄 xi
一、緒論 1
1.1 研究動機 1
1.2 研究目的 2
1.3 論文架構 2
二、背景知識以及文獻回顧3
2.1 背景知識 3
2.1.1 鷹眼系統 3
2.1.2 Karma Zone 4
2.1.3 YOLOv4 4
2.1.4 Kalman 10
2.1.5 影像處理 11
2.1.6 短時距傅立葉轉換 13
2.1.7 OpenPose 14
2.2 文獻回顧 18
三、研究方法 19
3.1 實驗設備與架設方式 19
3.2 系統介紹 20
3.3 棒球偵測及追蹤 23
3.4 影片同步 24
3.5 好球帶計算 26
3.5.1 本壘板偵測 28
3.5.2 打者骨架分析 33
四、實驗設計與結果 35
4.1 棒球偵測與追蹤 35
4.2 本壘板偵測 42
4.3 好壞球辨識實驗 43
4.4 系統實驗結果 46
4.4.1 執行時間 46
4.4.2 好壞球判定結果 47
五、總結 50
5.1 結論 50
5.2 未來展望 50
參考文獻 52

參考文獻

[1] “The Impact of the Hawk-Eye System in Tennis.” (Jan. 2012), [Online]. Available: https://trainingwithjames.wordpress.com/research-papers/the- impact-of-the-hawk-eye-system-in-tennis/.
[2] A. Bochkovskiy, C.-Y. Wang, and H.-Y. M. Liao, “YOLOv4: Optimal Speed and Accuracy of Object Detection,” arXiv, Tech. Rep. arXiv:2004.10934, Apr. 2020.
[3] J. Redmon and A. Farhadi, “YOLOv3: An Incremental Improvement,” arXiv, Tech. Rep. arXiv:1804.02767, Apr. 2018.
[4] C.-Y. Wang, H.-Y. Mark Liao, Y.-H. Wu, P.-Y. Chen, J.-W. Hsieh, and I.-H. Yeh, “CSPNet: A New Backbone that can Enhance Learning Capability of CNN,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA: IEEE, Jun. 2020, pp. 1571–1580.
[5] T.-Y. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, and S. Belongie, “Feature Pyramid Networks for Object Detection,” arXiv, Tech. Rep. arXiv:1612.03144, Apr. 2017.
[6] S. Liu, L. Qi, H. Qin, J. Shi, and J. Jia, “Path Aggregation Network for Instance Segmentation,” arXiv, Tech. Rep. arXiv:1803.01534, Sep. 2018.
[7] K. He, X. Zhang, S. Ren, and J. Sun, “Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition,” arXiv, Tech. Rep. arXiv:1406.4729, Apr. 2015.
[8] S. Yun, D. Han, S. J. Oh, S. Chun, J. Choe, and Y. Yoo, “CutMix: Regularization Strategy
to Train Strong Classifiers with Localizable Features,” arXiv, Tech. Rep. arXiv:1905.04899, Aug. 2019.
[9] D. Misra, “Mish: A Self Regularized Non-Monotonic Activation Function,” arXiv, Tech. Rep. arXiv:1908.08681, Aug. 2020.
[10] T. Basar, “A new approach to linear filtering and prediction problems,” in Control The-
ory: Twenty-Five Seminal Papers (1932-1981), IEEE, 2001, pp. 167–179.
[11] S. Suzuki and K. Abe, “Topological structural analysis of digitized binary images by border following,” Comput. Vis. Graph. Image Process., vol. 30, pp. 32–46, 1985.
[12] D. Gabor, “Theory of communication. Part 1: The analysis of information,” Journal of the Institution of Electrical Engineers - Part III: Radio and Communication Engineering, vol. 93, no. 26, p. 429, 1946.
[13] Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh, “Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields,” arXiv, Tech. Rep. arXiv:1611.08050, Apr. 2017.
[14] Z. Cao, G. Hidalgo, T. Simon, S.-E. Wei, and Y. Sheikh, “OpenPose: Realtime MultiPerson 2D Pose Estimation using Part Affinity Fields,” arXiv, Tech. Rep. arXiv:1812.08008,
May 2019.
[15] K.-C. Huang, T.-K. Chiu, C.-T. Hsieh, and M.-S. Pan, “3D 深度感測技術應用在棒壘球好球帶輔助系統之開發,” zh, 淡江體育學刊, no. 20, pp. 1–14, Nov. 2017.
[16] “棒球規則：第二章-用語之定義 - 台灣棒球維基館,” [Online]. Available: http://twbsball.dils.tku.edu.tw/wiki/index.php/%E6%A3%92%E7%90%83%E8%A6%8F%E5%89%87_%EF%BC%9A%E7%AC%AC%E4%BA%8C%E7%AB%A0%E7%94%A8%E8%AA%9E%E4%B9%8B%E5%AE%9A%E7%BE%A9.
[17] C. Gaines. “What An MLB Strike Zone Really Looks Like And Why Players Are Always So Mad About It,” [Online]. Available: https://www.businessinsider.com/mlb-strike-zone-2014-9.
[18] T.-Y. Lin, M. Maire, S. Belongie, et al., “Microsoft COCO: Common Objects in Context,” arXiv, Tech. Rep., Feb. 2015.
[19] C. Corcoran. “New rule continues to be a big problem for MLB, umpires,” [Online]. Available: https://www.si.com/mlb/2014/08/14/home- plate- collision- rule- umpireswrong.
[20] C. Muller. ““Keep Yourself at 17 Inches＂.” (Mar. 2016), [Online]. Available: https://mygoodtimestories.com/2016/03/30/keep-yourself-at-17-inches/.
[21] “Why is home plate shaped the way it is?” [Online]. Available: https://www.theoleballgame.com/why-is-home-plate-shaped-the-way-it-is.html.

指導教授

蘇木春(Mu-Chun Su)

審核日期

2022-8-25

推文