A DQN-Based Reinforcement Learning Model for Neural Network Architecture Search

NCUIR > School of Management at National Central University > Graduate Institute of Information Management > Electronic Thesis & Dissertation > Item 987654321/81350

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/81350

Title:	A DQN-Based Reinforcement Learning Model for Neural Network Architecture Search
Authors:	蔡子涵;Tsai, Tzu-Han
Contributors:	資訊管理學系
Keywords:	機器學習;神經網路;強化學習;神經網路架構;Machine learning;Neural network;Reinforcement learning;Neural network architecture
Date:	2019-08-21
Issue Date:	2019-09-03 15:46:15 (UTC+8)
Publisher:	國立中央大學
Abstract:	機器學習算法是一類從數據中自動分析獲得規律，並利用規律對未知數據進行預測的算法。機器學習已廣泛應用於數據挖掘、計算機視覺、自然語言處理、生物特徵識別、搜尋引擎、醫學診斷、檢測信用卡欺詐、證券市場分析等等，網路時代來臨時帶動了數據量的的成長，但當在設計神經網路時針對某一項資料集設計一個神經網絡架構需要專業的知識、時間以及電算資源。每一個神經網路都是通過專家許多專業知識還有一次又一次的仔細的實驗或是從少數現有的優秀神經網絡更改其架構而來。為了加速建構神經網路的建構，我們建構了一套系統HILL-CLIMBING MODEL；這是一種基於強化學習的建模算法，可以給定強化學習中學習任務自動生成表現優異的神經網路架構。使用強化學習的訓練並搭配使用Epsilon貪婪的探索策略和經驗回放的DQN讓強化學習經由這些經驗與策略生成表現優異的神經網路。強化學習搭配貪婪式的探索加強了架構的可能性，並經由迭代地發現具有改進的學習任務的設計。即使在圖像分類基準測試中，強化學習的網絡也可以像設計的現有網絡那樣做得一樣好，而且效率更高。;Designing neural network (NN) architectures requires both human expertise and labor. New architectures are handcrafted by careful experimentation or modified from a handful of existing networks. We introduce HCM, a meta-modeling algorithm based on reinforcement learning to automatically generate high-performing NN architectures for a given learning task. The learning agent is trained to sequentially choose NN layers using DQN with an ɛ-greedy exploration strategy and experience replay. The agent explores a large but finite space of possible architectures and iteratively discovers designs with improved performance on the learning task. Even on image classification benchmarks, the agent-designed networks can do good as existing networks designed but more efficient. We also outperform existing meta-modeling approaches for network design on image classification or regression tasks.
Appears in Collections:	[Graduate Institute of Information Management] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	249	View/Open

社群 sharing

Loading...