以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：136

、訪客IP：3.144.106.207

姓名	曾子欣(Zi-Xin Zeng)  查詢紙本館藏	畢業系所	資訊工程學系
論文名稱	利用串場效果偵測之實用棒球比賽精華擷取暨分類系統 (A Practical Highlight Extraction and Classification Scheme in Baseball Videos Based on Transition Effect Detection)
相關論文	★ 基於QT之跨平台無線心率分析系統實現 ★ 網路電話之額外訊息傳輸機制 ★ 針對與運動比賽精彩畫面相關串場效果之偵測 ★ 植基於向量量化之視訊/影像內容驗證技術 ★ 植基於串場效果偵測與內容分析之棒球比賽精華擷取系統 ★ 以視覺特徵擷取為基礎之影像視訊內容認證技術 ★ 使用動態背景補償以偵測與追蹤移動監控畫面之前景物 ★ 應用於H.264/AVC視訊內容認證之適應式數位浮水印 ★ 棒球比賽精華片段擷取分類系統 ★ 利用H.264/AVC特徵之多攝影機即時追蹤系統 ★ 利用隱式型態模式之高速公路前車偵測機制 ★ 基於時間域與空間域特徵擷取之影片複製偵測機制 ★ 結合數位浮水印與興趣區域位元率控制之車行視訊編碼 ★ 應用於數位智權管理之H.264/AVC視訊加解密暨數位浮水印機制 ★ 基於文字與主播偵測之新聞視訊分析系統 ★ 植基於數位浮水印之H.264/AVC視訊內容驗證機制
檔案	[Endnote RIS 格式]    [Bibtex 格式]    [相關文章]   [文章引用]   [完整記錄]   [館藏目錄]   [檢視]  [下載] 本電子論文使用權限為同意立即開放。 已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。 請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。
摘要(中)	棒球比賽轉播在目前商用電視台十分常見，一場比賽的完整視訊內容通常為九局上下，然而隨著實際比賽的變化以及球團戰術的實行，其比賽時間之長往往超乎預期，對於觀看棒球比賽者而言，並不是每個人都有充裕的時間能將整場比賽瀏覽完畢而且並非所有內容觀看者都非常感興趣，因此，若是能事先將大量的比賽資訊透過系統做分析整理並擷取出不同的精華片段提供觀看者做選擇，則可讓觀看者節 省大量的時間並得到想要的資訊。 本論文提出一個在MPEG 壓縮域底下對輸入系統的視訊內容做分析並擷取出精華片段再加以分類的系統。由於精采畫面的前後通常都會有電視台加入的串場效果以通知觀看者，因此我們首先透過鏡頭變化偵測加上視訊內容分析找出串場效果畫面的資訊，並利用數位訊號處理的方式準確的建立出串場效果模板，以此模版我們可定位出所有串場效果出現的位置。再來，我們以SVD 對所有出現在串場效果前後的投捕畫面做特徵擷取並定出一個特徵的閥值範圍，可作為投捕畫面的定位判斷，投捕畫面至串場效果即為分析精華片段的開始與結束點。最後，在找到串場效果畫面以及投捕畫面之後，我們可將此段畫面以HMM加以分析與分類，可得知此片段是否為我們所定義的某種精華片段。 由於系統是建立在MPEG視訊壓縮的資訊串流做計算，因此可節省大量複雜的運算。實驗結果顯示本系統在視訊畫面的分析上以及精華擷取的分類上具有相當高的準確度與運算效率。
摘要(英)	This research presents a system of analyzing video content in the MPEG compressed videos for classifying the highlights in baseball videos. The system makes use of the transition e ects inserted preceding and following the slow motion replays by the broadcaster, which demonstrate highlights of the game. First, we examine the characteristics of the tran- sition e ects via the camera changes and the video content analysis to construct the transition e ect template, which can help to locate all the appearances of transition e ects. Next, we search the pitching views which appear before the transition e ects and construct the pitching view model for this game. Finally, after we locate the highlight candidates, we will apply HMM (Hidden Markov Model) to analyze and classify the content to ensure that the extracted highlights match our de nitions of high-level highlight semantics. Because the system is based on MPEG compressed video data streams, it can save a large amount of computational complexity. The experimental results show the feasibility of the potential solution.
關鍵字(中)	★ 棒球 ★ 視訊 ★ 串場效果 ★ 慢動作 ★ SVD ★ MPEG ★ HMM	關鍵字(英)	★ Baseball ★ Highlight ★ transition effect ★ slow motion ★ MPEG ★ SVD ★ HMM
論文目次	1 Introduction 1 1.1 Signi cance of the Research . . . . . . . . . . . . . . . . 1 1.2 Contribution of the Research . . . . . . . . . . . . . . . . 3 1.3 Organization of the Thesis . . . . . . . . . . . . . . . . . 4 2 The Related Work 5 2.1 Visual Analysis . . . . . . . . . . . . . . . . . . . . . . . 5 2.2 Audio Analysis . . . . . . . . . . . . . . . . . . . . . . . 7 2.3 Text Analysis . . . . . . . . . . . . . . . . . . . . . . . . 8 2.4 Slow Motion Replay Analysis . . . . . . . . . . . . . . . 9 2.5 Fusion Analysis . . . . . . . . . . . . . . . . . . . . . . . 11 2.6 Machine Learning Analysis . . . . . . . . . . . . . . . . . 13 3 Highlight Extraction and Classi cation 14 3.1 System Overview . . . . . . . . . . . . . . . . . . . . . . 14 3.2 Transition E ect Detection . . . . . . . . . . . . . . . . . 19 3.2.1 Feature Extraction . . . . . . . . . . . . . . . . . 19 3.2.2 Shot Change Detection . . . . . . . . . . . . . . . 21 3.2.3 Processing Unit Generation . . . . . . . . . . . . 23 3.2.4 Transition E ect Analysis . . . . . . . . . . . . . 27 3.2.5 Template Construction . . . . . . . . . . . . . . . 29 3.2.6 Transition E ect Location . . . . . . . . . . . . . 37 3.3 Pitching View Search . . . . . . . . . . . . . . . . . . . . 40 3.3.1 Backward Shot Change Frame Gathering . . . . . 40 3.3.2 Feature Extraction . . . . . . . . . . . . . . . . . 42 3.3.3 Pitching View Modeling . . . . . . . . . . . . . . 44 3.3.4 Pitching View Location . . . . . . . . . . . . . . . 47 3.4 Highlight Classi cation . . . . . . . . . . . . . . . . . . . 49 3.4.1 De nition of Hidden Markov Model . . . . . . . . 50 3.4.2 Scene Shot Classi cation . . . . . . . . . . . . . . 51 3.4.3 Scene Shot Feature Extraction . . . . . . . . . . . 54 3.4.4 Highlight Type De nition . . . . . . . . . . . . . 56 3.4.5 Hidden Markov Model Training and Classi cation 58 4 Experimental Results 71 4.1 Shot Change Detection . . . . . . . . . . . . . . . . . . . 71 4.2 Transition E ect Detection . . . . . . . . . . . . . . . . . 73 4.3 Pitching View Detection . . . . . . . . . . . . . . . . . . 75 4.4 Scene Shot Type Classi cation . . . . . . . . . . . . . . . 77 4.5 Highlight Detection . . . . . . . . . . . . . . . . . . . . . 78 5 Conclusion and Future Work 80 References 82
參考文獻	[1] D. Tjondronegoro, Y.-P. Chen, and B. Pham. Integrating highlights for more complete sports video summarization. IEEE Multimedia,11(4), Oct.-Dec. 2004. [2] Y.-P. Chen D. Tjondronegoro and B. Pham. Sports video summarization using highlights and play-breaks. In The 5th International ACM Multimedia Information Retrieval Workshop, Berkeley, CA, Nov. 2003. [3] A. Kokaram, N. Rea, R. Dahyot, M. Tekalp, P. Bouthemy, P. Gros, and I. Sezan. Browsing sports video (trends in sports-related index-ing and retrieval work). IEEE Signal Processing Magazine, 23(2), Mar. 2006. [4] Chih-Hao Liang, Wei-Ta Chu, Jin-Hau Kuo, Ja-Ling Wu, and Wen-Huang Cheng. Baseball event detection using game-speci c feature sets and rules. In IEEE International Symposium on Circuits and Systems, May. 2005. [5] Ling-Yu Duan, Min Xu, Qi Tian, Changsheng Xu, and Jesse S. Jin. 82 A uni ed framework for semantic shot classi cation in sports video. IEEE Transactions on Multimedia, 7(6), Jun. 2005. [6] Xiang Fu and Jie xian Zeng. An e ective video shot boundary detection method based on the local color features of interest points. In Second International Symposium on Electronic Commerce and Security, pages 25-28, Nanchang, May. 2009. [7] Yichuan Hu, Bo Han, Guijin Wang, and Xinggang Lin. Enhanced shot change detection using motion features for soccer video analysis. In IEEE International Conference on Multimedia and Expo, pages 1555-1558, 2007. [8] Bo Han, Yichuan Hu, Guijin Wang, Weiguo Wu, and Takayuki Yoshigahara. Enhanced sports video shot boundary detection based on middle level features and a uni ed model. IEEE Transactions on Consumer Electronics, 53(3):1168-1176, Aug. 2007. [9] E. Clua, M. S. Fonseca, A. Conci, and A. Montenegro. Detecting shot transitions based on video content. In 15th International Conference on Systems, Signals and Image Processing, pages 339-342,Bratislava, June. 2008. [10] Lu Yin, Hiroyoshi Morita, IGB Baskara Nugraha, and Lin Zhang. Real-time e cient detection of shot changes in mpeg soccer video using macro-block type information. In IEEE International Conference on Network Infrastructure and Digital Content, pages 707-711,Beijing, Nov. 2009. [11] Hee Lin Wang and Loong-Fah Cheong. Taxonomy of directing semantics for lm shot classi cation. IEEE Transactions on Circuits and Systems for Video Technology, 19(10):1529-1542, Oct. 2009. [12] Congyan Lang, De Xu, and Yiwei Jiang. Shot type classi cation in sports video based on visual attention. In International Conference on Computational Intelligence and Natural Computing, pages 336-339, Wuhan, Jun. 2009. [13] Bashar Tahayna, Mohammed Belkhatir, and Saadat Alhashmi. Motion information for video retrieval. In IEEE International Conference on Multimedia and Expo, pages 870-873, New York, July. 2009. [14] Lin Liu. A new method for camera motion estimation in video. In The 9th International Conference for Young Computer Scientists, pages 886-890, Hunan, Nov. 2009. [15] Ahmet Ekin, A. Murat Tekalp, and Rajiv Mehrotra. Automatic soccer video analysis and summarization. IEEE Transactions on Image Processing, 12(7), Jul. 2003. [16] Reede Ren and Joemon M. Jose. Temporal salient graph for sports event detection. In 16th IEEE International Conference on Image Processing, pages 4313-4316, Cairo, Nov. 2009. [17] M. Bertini, A. Del Bimbo, C. Torniai, C. Grana, R. Vezzani, and R. Cucchiara. Sports video annotation using enhanced hsv histograms in multimedia ontologies. In 14th International Conference on Image Analysis and Processing Workshops, pages 160-170, Modena, Sept. 2007. [18] P. Chang, M. Han, and Y. Gong. Extract highlights from baseball game video with hidden markov models. In IEEE International Conference on Image Processing, 2002. [19] Huang-Chia Shih and Chung-Lin Huang. MSN: Statistical understanding of broadcasted baseball video using multi-level semantic network. IEEE Transactions on Broadcasting, 51(4), Dec. 2005. [20] Lie Lu, Hao Jiang, and HongJiang Zhang. A robust audio classi cation and segmentation method. In ACM Multimedia, pages 203-211, Ottawa, Canada, 2001. [21] Y. Rui, A. Gupta, and A. Acero. Automatically extracting highlights for tv baseball programs. In The 8th ACM International Conference on Multimedia, 2000. [22] Z. Xiong, R. Radhakrishnan, A. Divakaran, and T. S. Huang. Audio events detection based highlights extraction from baseball, golf and soccer games in a uni ed framework. In IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 5, Apr. 2003. [23] Dongqing Zhang and Dan Ellis. Detecting sound events in basketball video archive. In Technical Report, Electrical Engineering Department of Columbia University, 2001. [24] Liu Jiqing, Dong Yuan, Huang Jun, Zhao Xianyu, and Wang Haila. Sports audio classi cation based on mfcc and gmm. In 2nd IEEE International Conference on Broadband Network and Multimedia Technology, Beijing, Oct. 2009. [25] Y. Zhong, H. Zhang, and A. K. Jain. Automatic caption localization in compressed video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(4), Apr. 2000. [26] D. Zhang, R. K. Rajendran, and S.-F. Chang. General and domainspeci c techniques for detecting and recognizing superimposed text in video. In IEEE International Conference on Image Processing, Rochester, NY, USA, Sep. 2002. [27] D. Zhang and S.-F. Chang. Event detection in baseball video using superimposed caption recognition. In Proceeding ACM Multimedia, Juan Les Pins, France, Dec. 2002. [28] Gwang-Gook Lee, Hyeong ki Kim, and Whoi-Yul Kim. Highlight generation for basketball video using probabilistic excitement. In IEEE International Conference on Multimedia and Expo, pages 318-321, New York, Jul. 2009. [29] Cheolkon Jung and Joongkyu Kim. Player information extraction for semantic annotation in golf videos. IEEE Transactions on Broadcasting, 55(1):79-83, Mar. 2009. [30] Yih-Ming Su, Chi-Fa Chen, and Chia-Yen Chen. Extracting the highlight events of baseball videos using a model-indexing decision approach. In International Conference on Audio, Language and Image Processing, pages 509-513, Shanghai, July. 2008. [31] Yih-Ming Su and Shu-Jiun Liang. A novel highlight event decision approach for baseball videos. In IEEE International Symposium on Consumer Electronics, pages 1-2, Vilamoura, Apr. 2008. [32] Xi-Feng Ding, Yin-Jun Miao, Fan Bu, Li-Feng Sun, and Shi-Qiang Yang. Highlight detection in soccer video using web-casting text. In IEEE 10th Workshop on Multimedia Signal Processing, pages 604-609, Cairns, Qld, Oct. 2008. [33] J. C. Boulton. Two mechanisms for the detection of slow motion. Journal of the Optical Society of America: Optics, Image Science, and Vision, Oct. 1987. [34] L. Wang, X. Liu, S. Lin, G.-Y. Xu, and H.-Y. Shum. Generic slow-motion replay detection in sports video. In IEEE International Conference on Image Processing, Oct. 2004. [35] H. Pan, P. V. Beek, and M. I. Sezan. Detection of slow-motion replay segments in sports video for highlights generation. In IEEE International Conference on Acoustics, Speech and Signal Processing, 2001. [36] Hao Pan, Baoxin Li, and M. I. Sezan. Automatic detection of replay segments in broadcast sports programs by detection of logos in scene transitions. In IEEE International Conference on Acoustics, Speech, and Signal Processing, 2002. [37] Daniel Dementhon Vikrant Kobla and David Doermann. Detection of slow-motion replay sequences for identifying sports videos. In IEEE Workshop on Multimedia Signal Processing, 1999. [38] Miroslav HAGARA and Adam HLAVATOVIC. Video segmentation based on pratts gure of merit. In 19th International Conference Radioelektronika, Bratislava, Apr. 2009. [39] Jinjun Wang, Engsiong Chng, and Changsheng Xu. Soccer replay detection using scene transition structure analysis. In IEEE International Conference on Acoustics, Speech, and Signal Processing, March 2005. [40] E. J. Farn, L. H. Chen, and J. H. Liou. A new slow-motion replay extractor for soccer game videos. International Journal of Pattern Recognition and Arti cial Intelligence, 17, 2003. [41] R. Lienhart and A. Zaccarin. A system for reliable dissolve detection in videos. In IEEE International Conference on Image Processing, Thessaloniki, Greece, Oct. 2001. [42] Daniele D. Giusto, Maurizio Murroni, and Giulio Soro. Zoom and slow motion replay of color video sequences using fractals. In IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, Las Vegas, Mar. 2008. [43] Daniele D. Giusto, Maurizio Murroni, and Giulio Soro. A new approach to slow motion e ect for digital tv broadcasting services. IEEE Transactions On Broadcasting, 53(3), Sept. 2007. [44] Yu Song and Wenhong Wang. Uni ed sports video highlight detection based on multi-feature fusion. In Third International Conference on Multimedia and Ubiquitous Engineering, Qingdao, Jun. 2009. [45] Wei Li, Shengjian Chen, and Haibo Wang. A rule-based sports video event detection method. In International Conference on Computational Intelligence and Software Engineering, Wuhan, Dec. 2009. [46] Xuejun Wang, Shengbin Xie, and Hexin Chen. An algorithm of soccer goal extraction by using shot features. In International Conference on Computational Intelligence and Software Engineering, Wuhan, Dec. 2009. [47] Xiaozhe Ruan, Shijin Li, Yan Dong, and Jun Feng. Study on highlights detection in soccer video based on the location of slow motion replay and goal net recognition. In Chinese Conference on Pattern Recognition, Beijing, Oct. 2008. [48] Hyoung-Gook Kim, Jinguk Jeong, Jang-Heon Kim, and Jin Young Kim. Real-time highlight detection in baseball video for tvs with time-shift function. IEEE Transactions on Consumer Electronics, 54(2):831-838, May. 2008. [49] Li-Chuan Chan, Yen-Sung Chen, Rung-Wen Liou, Chih-Hung Kuo, Chia-Hung Yeh, and Bin-Da Liu. A real time and low cost hardware architecture for video abstraction system. In IEEE International Symposium on Circuits and Systems, LA, May. 2007. [50] Marco Bertini, Rita Cucchiara, Alberto Del Bimbo, and Andrea Prati. Semantic adaptation of sport videos with user-centred performance analysis. IEEE Transactions on Multimedia, 8(3):433-443, Jun. 2006. [51] Jinchang Ren, Juan Chen, Jianmin Jiang, and Stanley S. Ipson. Knowledge-based segmentation and semantic contents extraction from mpeg videos. In 5th International Conference on Visual Information Engineering, 2008. [52] Liu Hua-Yong, He Tingting, and Zhang Hui. Event detection in sports video based on multiple feature fusion. In Fourth International Conference on Fuzzy Systems and Knowledge Discovery, Haikou, Aug. 2007. [53] Ying Yang, Shouxun Lin, Yongdong Zhang, and Sheng Tang1. Highlights extraction in soccer videos based on goal-mouth detection. In 9th International Symposium on Signal Processing and Its Applications, Sharjah, Feb. 2007. [54] Huang-Chia Shih, Jenq-Neng Hwang, and Chung-Lin Huang. Content-based attention ranking using visual and contextual attention model for baseball videos. IEEE Transactions on Multimedia, 11(2):244-255, Feb. 2009. [55] Guangyu Zhu, Changsheng Xu, Qingming Huang, Yong Rui, Shuqiang Jiang, Wen Gao, and Hongxun Yao. Event tactic analysis based on broadcast sports video. IEEE Transactions on Multimedia, 11(1):49-67, Jan. 2009. [56] Yoshiaki Itoh, Shigenobu Sakaki, Kazunori Kojima, and Masaaki Ishigame. Highlight scene extraction of sports broadcasts using sports news programs. In IEEE 10th Workshop on Multimedia Signal Processing, Cairns, Oct. 2008. [57] Haojie Li, Jinhui Tang, Si Wu, Yongdong Zhang, and Shouxun Lin. Automatic detection and analysis of player action in moving background sports video sequences. IEEE Transactions on Circuits and Systems for Video Technology, 20(3):351-364, Mar. 2010. [58] M. H. Kolekar and K. Palaniappan. Semantic event detection and classi cation in cricket video sequence. In Sixth Indian Conference on Computer Vision, Graphics and Image Processing, 2008. [59] M. H. Kolekar and K. Palaniappan. A hierarchical framework for semantic scene classi cation in soccer sports video. In IEEE Region 10 Conference TENCON, Nov. 2008. [60] Lin Lin, Guy Ravitz, Mei-Ling Shyu, and Shu-Ching Chen. Video semantic concept discovery using multimodal-based association classifi cation. In IEEE International Conference on Multimedia and Expo, 2007. [61] Wei-Ta Chu and Ja-LingWu. Exploring broadcasting baseball videos based on multimodal and multidisciplinary study. In IEEE International Conference on Multimedia and Expo, 2007. [62] Guangyu Zhu, Qingming Huang, Changsheng Xu, Liyuan Xing,Wen Gao, and Hongxun Yao. Human behavior analysis for highlight ranking in broadcast racket sports video. IEEE Transactions on Multimedia, 9(6):1167-1182, Oct. 2007. [63] L. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. In Proceedings of the IEEE, number 2, 1989. [64] C. Cheng and C. Hsu. Fusion of audio and motion information on hmm-based highlight extraction for baseball games. IEEE Transactions on Multimedia, 8(3):585-599, Jun. 2006. [65] Georgios Th. Papadopoulos, Alexia Briassouli, Vasileios Mezaris, Ioannis Kompatsiaris, and Michael G. Strintzis. Statistical motion information extraction and representation for semantic video analysis. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 19(10):1513-1528, Oct. 2009. [66] E. Kijak, L. Oisel, and Gros P. Hierarchical structure analysis of sport videos using hmms. In 2003 International Conference on Image Processing, volume 2, 2003. [67] Kamesh Namuduri. Automatic extraction of highlights from a cricket video using mpeg-7 descriptors. In First International Communication Systems and Networks and Workshops, Jan. 2009. [68] Nguyen Huu Bach, Koichi Shinoda, and Sadaoki Furui. Robust highlight extraction using multi-stream hidden markovmodels for baseball video. In 2005 International Conference on Image Processing, Sept. 2005. [69] Jinjun Wang, Changsheng Xu, Engsiong Chng, and Qi Tian. Sports highlight detection from keyword sequences using hmm. In 2004 IEEE International Conference on Multimedia and Expo, volume 1, Taipei, Jun. 2004. [70] M. Delakis, G. Gravier, and P. Gros. Score oriented viterbi search in sport video structuring using hmm and segment models. In 2006 IEEE 8th Workshop on Multimedia Signal Processing, Oct. 2006. [71] Rajae EI Ouazzani and Rachid Oulad Haj Thami. Highlights' recognition and learning in soccer video by using hidden markov models and the bayesian theorem. In International Conference on Multimedia Computing and Systems, Apr. 2009. [72] Peng Chang, Mei Han, and Yihong Gong. Extract highlights from baseball game video with hidden markov models. In 2002 International Conference on Image Processing, volume 1, 2002. [73] Yi Ding and Guoliang Fan. Sports video mining via multichannel segmental hidden markov models. IEEE TRANSACTIONS ON MULTIMEDIA, 11(7):1301-1309, Nov. 2009. [74] Po-Chyi Su, Chun-Chieh Chen, and Hong-Min Chang. Towards effective content authentication for digital videos by employing feature extraction and quantization. IEEE Transactions on Circuits and Systems for Video Technology, 19(5):668-677, May. 2009. [75] H. Pan, P. Beek, and M.I. Sezan. Detection of slowmotion replay segments in sports video for highlights generation. In ICASSP, 2001. [76] Juang B. H. Rabiner, L. R. A tutorial on hidden markov models. In IEEE ASSP Magazine, 1986.
指導教授	蘇柏齊(Po-Chyi Su)	審核日期	2010-7-28
推文	facebook   plurk   twitter   funp   google   live   udn   HD   myshare   reddit   netvibes   friend   youpush   delicious   baidu
網路書籤	Google bookmarks   del.icio.us   hemidemi   myshare