博碩士論文 107826014 詳細資訊




以作者查詢圖書館館藏 以作者查詢臺灣博碩士 以作者查詢全國書目 勘誤回報 、線上人數:4 、訪客IP:3.138.200.66
姓名 歐奕(OU-YI)  查詢紙本館藏   畢業系所 系統生物與生物資訊研究所
論文名稱 比較線性模型、多層感知器和卷積神經網絡在回歸分析應用中的性能
(Comparing the performance of linear model, multilayer perceptron, and convolutional neural network in regression analysis application)
相關論文
★ 發展酵素非限制性全基因體調控因子解析方法★ 利用健保資料庫探討常見複雜疾病之中草藥處方研究
★ 主觀影響療癒的案例與主觀在醫療重要性的探討★ 精神分裂症病患與正常人之DNA甲基化網絡的差異
★ 躁鬱症病患的精子之DNA 甲基化的網路分析★ Cloud-R:以R軟體與雲端技術為基礎的生物統計應用網站
★ 中草藥藥性與中草藥遺傳演化樹之關係★ 利用階層式叢集及不同分類方法分析人類正常組織特異性基因
★ 由ENCODE計畫分析脫氧核醣核酸酶I與組蛋白修飾★ 皮膚痣圖片毛髮辨識去除
★ 中醫癌症處方多由癰瘍、和解之劑與寒方組成,並隨氣溫下降而更改組成★ 主成分分析與叢集分析於DNA微陣列數據前處理的應用與實作
★ 確認與中醫處方有關的環境和社會經濟變數★ 與中醫處方有關的社會經濟變量關係網絡的確認與分析
★ 開發CNN模型預測學生是否退學— 練習如何建立AI模型以從NGS短序列片段數據中偵測SNP★ 深度 Q 網絡學習用於加護病房敗血症治療
檔案 [Endnote RIS 格式]    [Bibtex 格式]    [相關文章]   [文章引用]   [完整記錄]   [館藏目錄]   至系統瀏覽論文 (2028-2-2以後開放)
摘要(中) 近年來人工智慧越加蓬勃發展,加上網路的進步,5G也正在被廣泛的使用而元宇宙正步入我們的生活中,其基礎離不開深度學習,而TensorFlow是重要的深度學習框架,用於語言理解任務的機器學習,TensorFlow為電腦科學家重新簡化重建DistBelief的代碼庫,使其變成更快更好的代碼庫,使用者可以簡單的使用裡面的代碼庫裡的深度學習運算法來建構模型。現今我們廣泛使用深度學習來分析大數據,其中Convolutional Neural Network(CNN)在影像辨識方面有良好的表現,本文將介紹如何使用Keras建構CNN模型來分析學校的學生成績資料,我們將建立一個模型,當我們有此學生的學期成績資料,就能使用此模型來預測此學生下一學期的成績。
當我們取得學生成績資料後,裡面有每位學生的成績與多項欄位,這些欄位代表著不同的意義,其中我們找出每位學生每個學期的各科成績,用來加以分析學生成績。我們使用R語言來處理資料,選取大學部學生的資料並將學生的每一學期成績資料轉換成圖片,用學生的前幾個學期成績做線性回歸來預測下一學期的成績。
本文用Keras在R語言中建立CNN模型,我們發現模型的參數設定並沒有一定的規律,其中epoch不是越多越好,learning rate也不是越慢越好,需透過不斷的訓練模型與調整模型參數,才能找出最適合處理學生成績資料的模型。
早期預測數值普遍使用線性回歸,如今人工智慧越發純熟,本文將探討使用深度學習建立的MLP與CNN模型是否能比傳統的線性回歸模型有更好的效果,並且對機器的運算不會付出太大的代價。
摘要(英) In recent years, artificial intelligence has been rapidly developing, and with the progress of the internet, 5G is also widely used, and the metaverse is entering our lives. The foundation of this cannot be separated from deep learning, and TensorFlow is an important deep learning framework for language understanding tasks of machine learning. TensorFlow simplifies and improves the code library of DistBelief for computer scientists, making it faster and better, so that users can easily use the deep learning algorithms inside the code library to construct models. Nowadays, we widely use deep learning to analyze big data, among which, the Convolutional Neural Network (CNN) has good performance in image recognition. This article will introduce how to use Keras to construct a CNN model to analyze school student performance data. We will establish a model, when we have this student′s semester performance data, we can use this model to predict the student′s performance in the next semester.

After we acquire student performance data, it contains the grades and multiple fields of each student, these fields represent different meanings. Among them, we find out each student′s grades for each subject in each semester to analyze student performance. We use R language to process data, select college students′ data, and convert students′ performance data in each semester into images. We use students′ previous few semester grades to do linear regression to predict the grade for the next semester.

This article uses Keras to create a CNN model in R language, we find that the model′s parameter settings do not have a certain rule, the number of epochs is not the more the better and the learning rate is not the slower the better. We need to continuously train the model and adjust the model parameters to find the best model for processing student performance data.

In the early days, linear regression was commonly used for predicting values. Now that artificial intelligence is becoming more and more proficient, this article will explore whether the MLP and CNN models established using deep learning can have better results than traditional linear regression models, and the calculation of the machine will not pay too much the price.
關鍵字(中) ★ 深度學習
★ 卷積神經網路
★ 線性回歸
★ 預測成績
關鍵字(英) ★ Deep learning
★ Convolutional Neural Network
★ Linear regression
★ Predict Value
論文目次 摘要………………………………………………………………………………………….…i
英文摘要………………………………………………………………………………………ii
誌謝……………………………………………………………………………………………iv
目錄……………………………………………………………………………………………v
圖目錄………………………………………………………………………………………..vii
表目錄………………………………………………………………………………………...ix
一、 緒論………………………………………………………………………………………1
1-1人工智慧(Artificial Intelligence) ………………………………………………...1
1-2 深度學習(Deep Learning) ………………………………………………….……3
1-2-1 深度類神經網路(Deep Neural Network)……………………………..….3
1-2-2人工神經網路(ANN,Artificial Neural Network)多層感知器(MLP,
Multilayer Perceptron) ………………………………………………………5
1-2-3 損失函數(Loss Function) …………………………………………......…5
1-2-4 優化器(Optimizer) ………………………………………………………6
1-3 卷積神經網路(Convolutional Neural Network)…………………………….…..8
1-3-1 卷積層、池化層、全連接層……………………………………………9
1-4 學生成績資料分析………………………………………………………..……13
1-5研究動機……………………………………………………………….….….…14
二、 研究內容與方法……………………………………………………………….………14
2-1使用方法……………………………………………………………..….………14
2-2資料前處理……………………………………………………………….……..14
2-3 Keras…………………………………………………………………….………16
2-3-1 安裝 Keras………………………………………………………………16
2-3-2 為何選擇 Keras…………………………………………………………17
2-4 MLR、MLP、CNN 模型…………………………………………………..…18
2-4-1 建立模型………………………………………………………….….….18
2-4-2 編譯模型(Compile) ………………………………………………….…18
2-4-3 評估模型……………………………………………………………...…19
三、 研究結果……………………………………………………………………….…..…20
3-1 尋找模型最佳解………………………………………………………..…..……20
3-1-1 Epochs………………………………………………………………..…..…20
3-1-2 Learning Rate…………………………………………………………….…21
3-1-3Filter…………………………………………………………………………26
3-1-4Filter Size…………………………………………………………….………26
3-2 比較 CNN 、MLP 、MLR ……………………………………………………30
四、 結論與討論……………………………………………………………………………34
文獻參考……………………………………………………………………………………38
附錄一………………………………………………………………………………………40
附錄二………………………………………………………………………………………42
附錄三………………………………………………………………………………………46
參考文獻 1.Intel. How to Get Started as a Developer in AI.October 2016; Available from: https://software.intel.com/en-us/articles/how-to-get-started-as-a-developer-in-ai.
2.Gill, J.K. Automatic Log Analysis using Deep Learning and AI. 2018 [cited 2020 July 1]; Available from: https://www.xenonstack.com/blog/log-analytics-deep-machine-learning/.
3.McCulloch, W. S., & Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. The bulletin of mathematical biophysics, 5(4), 115-133..
4.Sebastian Ruder (2016). An overview of gradient descent optimization algorithms.
5.LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278-2324.
6.斎藤康毅, Deep Learning|用 Python 進行深度學習的基礎理論實作.2017
7.Keras.Why choose Keras,July 17,2020;From:https://keras.io/why_keras/
8.https://keras.rstudio.com/reference/optimizer_adam.html
9.林大貴,TensorFlow+Keras深度學習人工智慧實務應用,2017:碩博文化
10.Yann LeCun, Yoshua Bengio & Geoffrey Hinton, Deep learning, Nature, Vol. 521, pp. 436–444 , 2015.
11.Y. Lecun, L. Bottou, Y. Bengio and P. Haffner, "Gradient-based learning applied to document recognition," in Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998, doi: 10.1109/5.726791.
12.Kingma, D. P., & Ba, J. L. (2015). Adam: a Method for Stochastic Optimization. International Conference on Learning Representations
13.David A. Freedman (2009). Statistical Models: Theory and Practice. Cambridge University Press. p. 26. A simple regression equation has on the right hand side an intercept and an explanatory variable with a slope coefficient. A multiple regression e right hand side, each with its own slope coefficient
14.Hardesty, Larry (14 April 2017). "Explained: Neural networks". MIT News Office. Retrieved 2 June 2022.
15.Teh, Y.W. and Hinton, G. E. Rate-coded restricted boltzmann machines for face recognition. In Advances in Neural Information Processing Systems, volume 13, 2001.
16.Agarap, Abien Fred (2018). Deep Learning using Rectified Linear Units (ReLU)
17.Valueva, M.V.; Nagornov, N.N.; Lyakhov, P.A.; Valuev, G.V.; Chervyakov, N.I. (2020). "Application of the residue number system to reduce hardware costs of the convolutional neural network implementation". Mathematics and Computers in Simulation. Elsevier BV. 177: 232–243. doi:10.1016/j.matcom.2020.04.031. ISSN 0378-4754. S2CID 218955622. Convolutional neural networks are a promising tool for solving the problem of pattern recognition.
18.Zhang, Wei (1988). "Shift-invariant pattern recognition neural network and its optical architecture". Proceedings of Annual Conference of the Japan Society of Applied Physics.
指導教授 王孫崇(Sun-Chong Wang) 審核日期 2023-2-2
推文 facebook   plurk   twitter   funp   google   live   udn   HD   myshare   reddit   netvibes   friend   youpush   delicious   baidu   
網路書籤 Google bookmarks   del.icio.us   hemidemi   myshare   

若有論文相關問題,請聯絡國立中央大學圖書館推廣服務組 TEL:(03)422-7151轉57407,或E-mail聯絡  - 隱私權政策聲明