非監督式廣義學習NEM分類演算法

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：22

、訪客IP：3.138.119.142

姓名

馬繻嬪(Ru-Pin Ma) 查詢紙本館藏

畢業系所

統計研究所

論文名稱

非監督式廣義學習NEM分類演算法
(Unsupervised Generalized Learning-based NEM Algorithm for Clustering)

相關論文

★ A Compression-Based Partitioning Estimate Classifier	★ Data adaptive median filters for image denoising based on a prediction criterion
★ Fixed effect estimation and spatial prediction via universal kriging	★ Two-stage model selection under a misspecified spatial covariance function
★ 時空過程的配適研究	★ 空間變異係數模型
★ Spline-based Approach for Image Restoration	★ 固定秩克里金法的圖像重建

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 (2026-7-1以後開放)

摘要(中)

聚類分析是用來預先瀏覽數據結構常見的方法，應用的領域像是在機器學習、圖像識別和生態學研究都是常見的。大多數無監督學習的聚類方法，像是EM演算法和NEM演算法，都是基於近似混合概似比以及需要預先給定聚類數而發展。此外，NEM演算法的準確性對初始值的指定十分敏感，而且在矩陣計算中容易出現反矩陣不存在的問題，尤其是對於在可視化中的三維數據集。本篇論文，提出了一種基於廣義學習的NEM(GLB- NEM)非監督式演算法，它不僅解決了初始值的敏感性和矩陣計算不存在的問題，而且所提出的演算法能夠自動收斂到正確的分類群數。關於所提出的GLB-NEM聚類演算法的統計推論在理論和模擬研究中都具有合理性。最後，本文透過兩筆實際資料分析說明方法的實用性。

摘要(英)

Cluster analysis is a common method to preview the underlying structure of the data in machine learning, image analysis, and ecological researches. Most of unsupervised learning clustering methods such as the EM algorithm and the NEM algorithm were developed based on the mixture likelihood ratio and the number of clusters needs to be specified in advance. In addition, the accuracy of the NEM method is sensitive to the specification of the initial value and it also suffers the singular issues in the computation of the matrix especially for the three-dimensional data sets. In this thesis, a generalized learning-based NEM (GLB- NEM) algorithm is proposed which not only solves the sensitivity of the initial value and the singular issues of the matrix, but also the proposed algorithm can automatically converge to the correct number of clusters. Statistical inferences about the proposed GLB-NEM cluster algorithm are justified both in theories and simulation studies. Also, two real data examples are analyzed for illustration.

關鍵字(中)

★ 聚類分析
★ 高斯混合模型
★ 機器學習
★ NEM演算法
★ 無監督學習

關鍵字(英)

★ Cluster analysis
★ Gaussian mixture model
★ Machine learning
★ NEM algorithm
★ Unsupervised learning

論文目次

1 Introduction 1
2 The EM and NEM Clustering Algorithms 3
2.1 Overview of EM algorithm . . . . . . . . .3
2.2 Overview of NEM algorithm . . . . . . . .5
2.3 Algorithms..................6
3 Learning-based NEM Algorithm 9
3.1 Overview of LB-NEM algorithm . . . . . .9
3.2 Algorithm..................................... 11
4 Generalized Learning-based NEM Algorithm 13
4.1 GLB-NEM algorithm............................... 13
4.2 Adjusted parameters and clustering criterion . . . . . . . . . . . . . . . . . . 15
4.3 Algorithm..................................... 19
5 Simulation Examples 21
5.1 Simulationfor1-Dexamples........................... 22
5.2 Simulationfor2-Dexamples........................... 24
5.3 Simulationfor3-Dexamples........................... 29
5.4 Comparisons.................................... 35
6 Real Data Examples 38
7 Conclusion and Discussion 40
Appendix 41
Reference 45

參考文獻

Ambroise, C., Dang, M., and Govaert, G. (1996). Clustering of Spatial Data by the EM Algorithm. Proceeding of geoENV96 conference, Lisbon, Portugal, 9, 493-504.
Ambroise, C. and Govaert, G. (1998). Convergence of an EM-type algorithm for spatial clustering. Pattern Recognition Letters, 19, 919-927.
Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from in- complete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society B, 39, 1-38.
Geva, A. B. (1999). Hierarchical unsupervised fuzzy clustering. IEEE Transactions on Fuzzy Systems, 7, 723-733.
Hubert, L. and Arabie, P. (1985). Comparing partitions. Journal of Classification, 2, 193-218.
Hu, T. and Sung, S. Y. (2006). A hybrid EM apprach to spatial clustering. Computational Statistics and Data Analysis, 50, 1188-1205.
Hung, W. L. and Chang-Chien, S. J. (2017). Learning-based EM algorithm for normal- inverse Gaussian mixture model with application to extrasolar planets. Journal of Applied Statistics, 44, 978-999.
Hung, W. L. (2018). Flexible EM-Type Algorithms for Spatial Clustering. Advances in Computer Communication and Computational Sciences, Advances in Intelligent Sys- tems and Computing 760, Springer, Singapore.
MacQueen, J. (1967). Some methods for classification and analysis of multivariate obser- vations. Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Prob- ability, 1, 281-297.
Patil, G. P. and Taillie, C. (1982). Diversity as a concept and its measurement. Journal of the Ammerican Statistical Association, 77, 548-561.
Pollard, D. (1982). Quantization and the method of k-means, IEEE Transactions on In- formation Theory, 28, 199-205.
Shannon, C. E. and Weaver, W. (1949). The Mathematical Theory of Communication. The University of Illinois Press, 1-117.
Yang, M. S., Lai, C. Y., and Lin, C. Y. (2012). A robust EM clustering algorithm for Gaussian mixture models. Pattern Recognition, 45, 3950-3961.

指導教授

陳春樹(Chun-Shu Chen)

審核日期

2023-7-4

推文