數位音訊編碼以內涵式搜尋及多種標準解碼應用於系統設計

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：54

、訪客IP：18.118.193.28

姓名

張惟欽(Wei-Chin Chang) 查詢紙本館藏

畢業系所

電機工程學系

論文名稱

數位音訊編碼以內涵式搜尋及多種標準解碼應用於系統設計
(System Level Design for Digital Audio Coding with Content-based Retrieval and Multi-standard Decoding Applications)

相關論文

★ 即時的SIFT特徵點擷取之低記憶體硬體設計	★ 即時的人臉偵測與人臉辨識之門禁系統
★ 具即時自動跟隨功能之自走車	★ 應用於多導程心電訊號之無損壓縮演算法與實現
★ 離線自定義語音語者喚醒詞系統與嵌入式開發實現	★ 晶圓圖缺陷分類與嵌入式系統實現
★ 語音密集連接卷積網路應用於小尺寸關鍵詞偵測	★ G2LGAN: 對不平衡資料集進行資料擴增應用於晶圓圖缺陷分類
★ 補償無乘法數位濾波器有限精準度之演算法設計技巧	★ 可規劃式維特比解碼器之設計與實現
★ 以擴展基本角度CORDIC為基礎之低成本向量旋轉器矽智產設計	★ JPEG2000靜態影像編碼系統之分析與架構設計
★ 適用於通訊系統之低功率渦輪碼解碼器	★ 應用於多媒體通訊之平台式設計
★ 適用MPEG 編碼器之數位浮水印系統設計與實現	★ 適用於視訊錯誤隱藏之演算法開發及其資料重複使用考量

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

數位音訊編碼已經非常流行而且被廣泛的應用在各種不同的領域中，在本論文中會針對音訊編碼的應用提出兩個主題。在第一個主題中，近年來，多媒體資料的搜尋與索引技術受到愈來愈多的注意，尤其是在內涵式搜尋領域中。在音訊這個範圍裡，許多的研究皆專注在MIDI或WAV這些未壓縮的音樂格式上，很少會針對壓縮過的音樂格式這個領域來探討。然而，MP3在目前已是一個重要且受歡迎的音樂格式，許多網路或是個人電腦中所流通的都是以MP3為主。在本篇論文中，我們提出了一個利用以歌找歌方式並且以MP3為主的內涵式音樂搜尋系統。我們將MP3中的次頻帶值取出來當成特徵值，並且利用量化樹索引方法及旋律線擷取方法將所取出的特徵值建成我們要的索引資料，最後再利用這些索引資料作為輸入歌曲片段與資料庫歌曲之相似度比對的依據。此外我們將整個內涵式音樂搜尋系統移植到以ARM為主的嵌入式系統平台上來做實現，整個系統的評估實驗分別進行在PC及嵌入式系統平台上，大約有95%的機率可以在前三首歌中找到。
第二個主題部分則是針對軟硬體共同設計做介紹，因為在一個SoC 的平台上可以同時提供通用處理器所具備的高彈性優點以及客製化硬體的高效能、低功率消耗特性，所以我們特別提出軟硬體共同設計的方式來實現多種標準數位音訊解碼器。分別有MP3、AC-3、AAC這三種標準。首先，我們採用開放源碼中的32 位元處理器 — OpenRISC 1200 (OR1200) 為基底，安裝完整的工具鏈(ToolChain)及建立軟硬體的模擬環境，最後，符合匯流排規格並成功在Xilinx FPGA板和Cell-Base驗證其功能。

摘要(英)

Digital audio coding is popular and has been applied in many areas. In this thesis is focus on audio coding and brings two contributions. First, the searching and indexing techniques for multimedia data are getting more attention in the area of multimedia databases. As many research works were done on the content-based retrieval of MIDI or waveform format music, less attention was received on the compressed domain audio data. As the explosive growth of internet, MP3 audio has become one of the most important and popular media. Most of the audio accessed from database of Internet are all compressed on MP3 domain, not raw data or even low quality MIDI audio. The content-based retrieval of audio example on MP3-based (MPEG 1 layer III) digital music archive is considered. In the proposed approach, the sub-band coefficients (SBC) in a MP3 frame are used. These values are extracted from the MP3 decoder to compute the MP3 features for indexing the MP3 objects. A quantization-tree indexing (QTI) and the melody-line pitch tracking (MLPT) method are also proposed for indexing MP3 objects. These indexes are used to measure the similarity between MP3 objects. Evaluations on a content-based MP3 retrieval system are performed on the pc version and platform-based embedded system version which indicate the proposed approach can achieve a good performance.
Second, an SoC-Based hardware/software co-design method for a multi-standard audio decoder. It is developed to support the audio standards of AAC LC profile, Dolby AC3 and MPEG-1 Layer 3. We present the approach not only for the characteristics of the algorithm, but also provide the numerical decision for evaluation of the various approaches. The overall system is first analyzed and profiled with ARM profiler. Then the decoder system is partitioned into software part and hardware part respectively based on the property of analysis. The software part is developed for the implementation of intensive decision making operations needed for audio bitstreams. The hardware part is a dedicated hardware for the regular and computation-intensive operations in multi-standard audio decoding. Here is focused on the implementation of OpenRISC 1200 (OR1200) CPU and the profiler of ARM is only for analyzing and profiling

關鍵字(中)

★ 處理器
★ 軟硬體共同設計
★ 內涵式搜尋
★ 音訊編碼

關鍵字(英)

★ SoC
★ content-based
★ retrieval
★ audio coding
★ OpenRISC 1200
★ OR1200
★ AC3
★ AAC
★ co-design
★ MP3

論文目次

ABSTRACT..................................................I
CONTENTS..................................................X
LIST OF FIGURES.........................................XII
LIST OF TABLES..........................................XIV
1. INTRODUCTION...........................................1
1.1 CONTENT-BASED RETRIEVAL..........................1
1.1.1 Motivation.......................................2
1.2 HW/SW CO-DESIGN OF AUDIO DECODER SYSTEM..........4
1.2.1 Motivation.......................................6
1.3 THESIS ORGANIZATION..............................7
2. RELATED WORKS..........................................8
2.1 RELATED WORK OF MUSICAL INFORMATION RETRIEVAL....9
2.2 A GENERAL CONTENT-BASED RETRIEVAL SYSTEM........11
2.3 PLATFORM BASED SOC HARDWARE/SOFTWARE CO-DESIGN METHODOLOGY..............................................13
2.3.1 Hardware/Software Partitioning..................15
2.3.2 Software Optimization...........................16
2.3.3 Cross-Platform Development Environment..........18
3. PROPOSED APPROACH FOR CONTENT-BASED RETRIEVAL OF ONE-SINGER QUERY-BY-EXAMPLE..................................21
3.1 ALGORITHM DEVELOPMENT...........................21
2.3.4 Feature Extraction..............................23
2.3.5 Histogram Modeling Classification...............25
2.3.6 Melody Slot Processing..........................25
2.3.7 Quantization Tree Indexing......................27
2.3.8 Melody-Line Pitch Tracking......................29
2.3.9 Similarity Measurement..........................31
a) Euclidean Distance Matching.....................31
b) Contour Comparison..............................32
3.2 PLATFORM-BASED DESIGN...........................32
3.2.1 Implementation with ARM Embedded System.........33
3.2.2 System Integration..............................36
3.3 RESULTS OF IMPLEMENTATION.......................37
3.3.1 Presentation of Practical System................37
c) PC Version......................................37
d) Platform Version................................39
3.4 EXPERIMENT RESULTS..............................41
4. AN SOC-BASED HW/SW CO-DESIGN FOR A MULTI-STANDARD AUDIO DECODER..................................................43
4.1 DESIGN EXPLORATION ON MULTI-STANDARD AUDIO DECODER..................................................44
4.1.1 Design approaches on audio decoder..............44
4.1.2 System complexity analysis......................44
4.1.3 System architecture.............................45
4.2 SOFTWARE/HARDWARE DEVELOPMENT...................46
4.2.1 Software Development............................46
4.2.2 Overview of Common Filterbank...................47
4.2.3 OpenRISC 1200 Microprocessor....................52
4.2.4 WishBone On-Chip Bus............................53
4.3 CONSTRUCTION ON THE DELIVERABLE IP..............55
4.3.1 Design stage....................................55
4.3.2 Verification strategy...........................57
4.4 PLATFORM-BASED DESIGN...........................58
4.4.1 System Level Co-Simulation......................58
4.4.2 System Integration..............................59
4.5 EXPERIMENTAL RESULTS............................62
CONCLUSIONS..............................................66
REFERENCES...............................................67

參考文獻

[1] Chih-Chin Liu, Po-Jun Tsai, “Content-based Retrieval of MP3 Music Objects,” Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA, pp.506-511.
[2] Wen-Nung Lie; Chen-Kang Su, "Content-based retrieval of MP3 songs based on query by singing," Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on , vol.5, no., pp. V-929-32 vol.5, 17-21 May 2004.
[3] Zhu Liu; Qian Huang, ”Content-based indexing and retrieval-by-example in audio”, IEEE International Conference on Multimedia and Expo, 2000. ICME 2000. Volume: 2,July-2 Aug. 2000, Pages: 877 -880.
[4] Tomonari Sonoda, Masataka Goto, Yoichi Muraoka,”A WWW-based Melody Retrieval System”, ICME’98 Proc.98, Pages: 349- 352.
[5] Adjeroh, D. A. and K. C. Nwosu, “Multimedia Database Management: Requirements and Issues,” IEEE Multimedia Magazine, Vol. 4, No. 3, 1997, pages 21~23.
[6] Nwosu, K. C., B. Thuraisingham, and P. B. Berra, “Multimedia Database Systems: A New Frontier,” IEEE Multimedia Magazine, Vol. 4, No. 3, pages 21~23, 1997.
[7] Ozsu, M. T. and S. Christodoulakis, “Introduction to the Special Issue on Multimedia Databases, “ The VLDB Journal, Vol. 7, No. 4, page 205, 1998.
[8] Yoshitaka, A., and T. Ichikawa, “A Survey on Content-Based Retrieval for Multimedia Databases,” IEEE Transactions on Knowledge and Data Engineering, Vol. 11, No. 1, pages 81~93, 1999.
[9] Ghias, A., H. Logan, D. Chamberlin, and B. C. Smith, “Query by Humming: Musical Information Retrieval in an Audio Database,” in Proceedings of Third ACM International Conference on Multimedia, 1995, pages 231~236.
[10] Liu, C. C., J. L. Hsu, and A. L. P. Chen, “An Approximate String Matching Algorithm for Content-Based Music Data Retrieval,” in Proceedings of International Conference on Multimedia Computing and Systems (ICMCS’99), 1999.
[11] Chou, T. C., A. L. P. Chen, and C. C. Liu, “Music Databases: Indexing Techniques and Implementation,” in Proceedings of IEEE Intl. Workshop on Multimedia Data Base Management System, 1996.
[12] Chen, J. C. C. and A. L. P. Chen, “Query by Rhythm: An Approach for Song Retrieval in Music Databases,” in Proceedings of 8th Intl. Workshop on Research Issues in Data Engineering, pages 139~146, 1998.
[13] Foote, J., “An Overview of Audio Information Retrieval,” Multimedia Systems, Vol. 7, No. 1, pages 2~10, ACM Press & Springer-Verlag, 1999.
[14] Lohr, M. and T. C. Rakow, “Audio Support for an Object-Oriented Database-Management System,” ACM Multimedia Systems Journal, pp. 286~297, 1995.
[15] Pfeiffer, S., S. Fischer, and W. Effelsberg, “Automatic Audio Content Analysis,” in Proceedings of the Fourth ACM International Multimedia Conference, 1996, pages 21~30.
[16] Wold, E., T. Blum, D. Keislar, and J. Wheaton, “Content-based Classification, Search, and Retrieval of Audio,” IEEE Multimedia Magazine, Vol. 3, No. 3, Fall 1996, pages 27~36.
[17] Selfridge-Field, E., “Conceptual and Representational Issues in Melodic Comparison,” in Hewlett, W. B. and E. Selfridge-Field (eds.), Melodic Similarity: Concepts, Procedures, and Applications (Computing in Musicology: 11), The MIT Press, 1998.
[18] Ghias, A., H. Logan, D. Chamberlin, and B. C. Smith, “Query by Humming: Musical Information Retrieval in an Audio Database,” in Proceedings of Third ACM International Conference on Multimedia, 1995, pages 231~236.
[19] Prather, R. E., “Harmonic Analysis from the Computer Representation of a Musical Score,” Communication of the ACM, Vol. 39, No. 12, Dec. 1996, pages 119, (pages 239~255 of Virtual Extension Edition of CACM).
[20] M. Hel´en and T. Lahti, “Query by Example Methods for Audio Signals,” in Proc. 7th IEEE Nordic Signal Processing Symposium, Reykjavik, Iceland, June 2006, pp. 302–305.
[21] Parker, C.; “A tree-based method for fast melodic retrieval”, Conference on Digital Libraries, 2004. Proceedings of the 2004 Joint ACM/IEEE, 7-11 June 2004, Pages: 254 – 255.
[22] Cheng Yang, “Efficient acoustic index for music retrieval with various degrees of similarity”, Proceedings of the tenth ACM international conference on Multimedia, December 2002, Pages: 584 – 591.
[23] T. Zhang and C.-C. J. Kuo, “Content-based Audio Classification and Retrieval for Audiovisual Data Parsing,” Kluwer Academic Publishers, 2001.
[24] Hyoung-Gook Kim, Nicolas Moreau, Thomas Sikora., “MPEG-7 audio and beyond : audio content indexing and retrieval,” Chichester, West Sussex, England ; Hoboken, NJ, USA : J. Wiley, c2005.
[25] Foote, Jonathan, “Content-Based Retrieval of Music and Audio” in Proc. SPIE, Multimedia Storage and Archiving systems II, Vol.3229, pp 138-147.
[26] TreeQ, http://treeq.sourceforge.net/
[27] Wei-Qiang Zhang, Jia Liu, “Two-Stage Method for Specific Audio Retrieval,” Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on Volume 4, Issue , 15-20 April 2007 Page(s):IV-85 - IV-88.
[28] Mohammad Khairul Islam, Hyung-Jin Lee, Anjan Kumar Paul, and Joong-Hwan Baek, “Content-based Music Retrieval Using Beat Information”, Fourth International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2007,
[29] Dan Zhao, Xiangdong Wang, Yueliang Qian, Qun Liu, Shouxum Lin, “Fast Commercial Detection based on Audio Retrieval”, ICME 2008, 8/26, pp 1185-1188.
[30] Pye, “Content-based methods for the management of digital music”, Proceedings of ICASSP 2000, Vol IV pp 24-27, 2000.
[31] Ki-Man Kim, Se-Young Kim, Jae-Kuk Jeon, and Kyu-Sik Park: “Quick audio retrieval using multiple feature vectors”, IEEE Transactions on Consumer Electronics, 2006, 5/2 pp 200-205.
[32] Karydis, I.; Nanopoulos, A.; Papadopoulos, A.N.; Manolopoulos, Y.; “Audio Indexing for Efficient Music Information Retrieval”, Multimedia Modelling Conference, 2005. MMM 2005. Proceedings of the 11th International, 12-14 Jan. 2005, Pages: 22 – 29.
[33] Cheng Yang, “Peer-to-peer architecture for content-based music retrieval on acoustic data”, Proceedings of the 12th international conference on World Wide Web, Budapest, Hungary, Pages: 376 – 383.
[34] Advanced Television Systems Committee (ATSC) Standard Doc. A/52A, “Digital Audio Compression Standard (AC-3),” Aug. 2001.
[35] ISO/IEC 11172-3, “Information technology-Coding of moving pictures and associated audio for digital storage media at up to 1.5 Mbits/s. Part3: Audio,” Nov. 1991.
[36] ISO/IEC JTC1/SC29/WG11 No.1650 “ISO 13818-7 (MPEG-2 Advanced Audio Coding, AAC)”, Apr. 1997.
[37] Tsung-Han Tsai and Chuh-Chu Yen, “A high quality re-quantization/quantization method for MP3 and MPEG-4 AAC audio coding,” in Proc. Int. Symp. Circuits and Systems, vol. 3, May 2002, pp.851-854.
[38] M. A. Watson and P. Buettner, “Design and implementation of AAC decoders,” IEEE Trans. Consumer Electronics, vol. 46, issue 3, pp.819-824, Aug. 2000.
[39] J. Chen and H. M. Tai, “MPEG-2 AAC decoder on a fixed-point DSP,” IEEE Trans. Consumer Electronics, vol. 45, issue 4, pp.1200-1205, Nov. 1999.
[40] T. H. Tsai, C. N. Liu and Y. W. Wang, “A pure-ASIC design approach for MPEG-2 AAC audio decoder,” in Proc. 4th IEEE Int. Conf. Information, Communications & Signal Processing and 4th Pacific-Rim Conf. Multimedia (ICICS-PCM), vol. 3, pp.1633-1636, Dec. 2003.
[41] P. Coussy, A. Baganne, and E. Martin. “Virtual component IP re-use in telecommunication systems design: a case study of MPEG-2/JPEG2000 encoder,” IEEE Proc .ICECS2002. vol. 2, pp.733-736, Sept. 2002
[42] Silicore Ltd. “Specification for the: WISHBONE System-On-Chip (SoC) Interconnection Architecture for Portable IP Cores Revision B.1,“ January 2001
[43] Y.T. Lin, and I.J. Huang, “Enhanced 32-bit Microprocessor-based SoC for Energy Efficient MP3 Decoding in Portable Devices,” IEEE Proc .ICCE2007. vol. 1-2, pp.90-93, Jan. 2007
[44] C.N. Liu, and T.H. Tsai, “SoC platform based design of MPEG-2/4 AAC audio decoder,” IEEE Proc .ISCAS2005. vol. 3, pp.2581-2584, May. 2005
[45] T.-H. Tsai and C.-N. Liu, “A Hardware/Software Co-Design Case Study on MPEG AAC Audio Decoder,” International Journal of Embedded Systems, Vol. 1, pp.125-133, 2005.
[46] T.-H. Tsai and C.-N. Liu, “Multi-standard Audio Decoder with Platform Based SOC HW/SW Co-Design Approach,” International Journal of Electrical Engineering, Vol. 14, No. 3, pp.247-254, June 2007.
[47] T.-H. Tsai and C.-N. Liu, “A Configurable Common Filterbank Processor for Multi-Standard Audio Decoder,” IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol. E90-A, No.9, pp.1913-1923, Sep. 2007.
[48] IP Qualification Alliance, “IP Qualification Guidelines”, Industrial Technology Research Institute, 2003
[49] OpenCores, http://www.opencores.org/
[50] Duhamel, P.; Mahieux, Y. and Petit, J.P.,”A fast algorithm for the implementation of filter banks based on `time domain aliasing cancellation'”, International Conference on Acoustics, Speech, and Signal Processing, Vol.3, Apr. 1991, pp.2209-2212.
[51] K. H. Bang, N. H. Jeong, J. S. Kim, “Design and VLSI Implementation of a Digital Audio-Specific DSP Core for MP3/AAC”, IEEE Transactions on Consumer Electronics, Aug. 2002; 48(3): 790~795.
[52] D. Zhou, P. Liu, J. Kong, Y. Zhang, B. He and N. Deng, “An SoC based HW/SW co-design architecture for multi-standard audio decoding,” in Proc. IEEE Asian Solid-State Circuits Conference (ASSCC), pp.200-203, Nov. 2007.
[53] Damjan Lampret, OpenRISC1000 Architecture Manual, January 28, 2003
[54] Damjan Lampret, OpenRISC1200 IP Core Specification Rev. 0.7, September 6, 2001
[55] M. Bolado, “Platform based on Open-Source Cores for Industrial Applications”, IEEE Computer Society, 2004
[56] S.-J. He and M. Zhang, “A Novel Component-based Hardware-Software Co-simulation System Based on OR1200”, Proc. of the 2007 IEEE International Conference on Mechatronics and Automation (ICMA), August 5 - 8, 2007, pp.3440-3445.
[57] Y. Bin, K. Kang, H. Kim, H. Jung and K. Ryoo, “The Development of SoC Platform for Embedded System Applications”, Proc. of the 2007 International Conference on Convergence Information Technology (ICCIT), IEEE Computer Society Washington, DC, USA, 2007, pp.2286-2291.
[58] N. Izeboudjen, K. Kaci, S. Titri, L. Sahli, D. Lazib, F. Louiz, M. Bengherabi, *N. Idirene, “System on Chip Platform Based on OpenCores for Telecommunication Applications”, International Conference on Volume, Design & Technology of Integrated Systems (DTIS) in Nanoscale Era, 2007. Issue, 2-5 Sept. 2007 Page(s):245 – 248.
[59] Z. Lin, “System-on-Chip design with Open Cores”, Master Thesis.
[60] ARM Integrator/AP User Guide.
[61] ARM Integrator/CM946E-S Core Module User Guide.
[62] ARM Integrator/LM-XCV600E+ Logic Module User Guide.
[63] Dynalith Systems, http://www.dynalith.com/doku.php
[64] AC ’97 Component Specification, Revision 2.3 Rev 1.0, Intel, 2002.
[65] LM4550 AC ’97 Rev 2.1 Multi-Channel Audio Codec with Stereo Headphone Amplifier, Sample Rate Conversion and National 3D Sound, National Semiconductor.
[66] Rudolf Usselmann, AC97 Controller IP Core, Rev. 1.2, Sept. 19, 2002, http://www.opencores.org/
[67] Rudolf Usselmann, Wishbone DMA/Bridge IP Core, Rev. 1.5, Jan. 2002, http://www.opencores.org/

指導教授

蔡宗漢(Tsung-Han Tsai)

審核日期

2009-7-20

推文