| DC 欄位 |
值 |
語言 |
| DC.contributor | 軟體工程研究所 | zh_TW |
| DC.creator | 王承凱 | zh_TW |
| DC.creator | Cheng-Kai Wang | en_US |
| dc.date.accessioned | 2022-7-19T07:39:07Z | |
| dc.date.available | 2022-7-19T07:39:07Z | |
| dc.date.issued | 2022 | |
| dc.identifier.uri | http://ir.lib.ncu.edu.tw:88/thesis/view_etd.asp?URN=109525003 | |
| dc.contributor.department | 軟體工程研究所 | zh_TW |
| DC.description | 國立中央大學 | zh_TW |
| DC.description | National Central University | en_US |
| dc.description.abstract | 倒傳遞 (Backpropagation, BP) 是當今深度神經網路更新權重演算法
的基石，但反向傳播因反向鎖定 (backward locking) 的問題而效率不佳。
本研究試圖解決反向鎖定問題，並將提出的新方法命名為 Supervised
Contrastive Parallel Learning (SCPL)，SCPL 利用監督對比損失函數作為每個卷積層的區域目標函數，因為每一層的區域目標函數間互相隔離，
SCPL 可以平行地學習不同卷基層的權重。
本論文亦和過去在神經網路平行化的研究進行比較，探討現存方法
各自的優勢與限制，並討論此議題未來的研究方向。 | zh_TW |
| dc.description.abstract | Backpropagation (BP) is the cornerstone of today’s deep learning algorithms to update the weights in deep neural networks, but it is inefficient partially because of the backward locking problem. This thesis proposes Supervised Contrastive Parallel Learning (SCPL) to address the issue of backward locking. SCPL uses the supervised contrastive loss as the local objective function for each layer. Because the local objective functions in different layers are isolated, SCPL can learn the weights of different layers in parallel. We compare SCPL with recent works on neural network parallelization. We discuss the advantages and limitations of the existing methods. Finally, we suggest future research directions on neural network parallelization. | en_US |
| DC.subject | 倒傳遞 | zh_TW |
| DC.subject | 反向鎖定 | zh_TW |
| DC.subject | 監督對比損失函數 | zh_TW |
| DC.subject | 平行化訓練 | zh_TW |
| DC.subject | 監督式 對比平行學習 | zh_TW |
| DC.subject | Backpropagation | en_US |
| DC.subject | backward locking | en_US |
| DC.subject | supervised contrastive loss | en_US |
| DC.subject | parallel learning | en_US |
| DC.subject | supervised contrastive parallel learning | en_US |
| DC.title | 利用 SCPL 分解端到端倒傳遞演算法 | zh_TW |
| dc.language.iso | zh-TW | zh-TW |
| DC.title | Decomposing End-to-End Backpropagation Based on SCPL | en_US |
| DC.type | 博碩士論文 | zh_TW |
| DC.type | thesis | en_US |
| DC.publisher | National Central University | en_US |