基於新聞趨勢萃取之時間序列預測模型;NTEformer: News-Trend Extractor Transformers for Time Series Forecastin

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Computer Science and Information Engineering > Electronic Thesis & Dissertation > Item 987654321/92621

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/92621

Title:	基於新聞趨勢萃取之時間序列預測模型;NTEformer: News-Trend Extractor Transformers for Time Series Forecastin
Authors:	黃宥程;Huang, Yu-Cheng
Contributors:	資訊工程學系
Keywords:	時間序列預測;碳價格預測;聊天生成預訓練轉換器;深度學習;Time Series Forecasting;Carbon Price Prediction;ChatGPT;Deep Learning
Date:	2023-07-26
Issue Date:	2023-10-04 16:06:44 (UTC+8)
Publisher:	國立中央大學
Abstract:	由於全球暖化所帶來的問題，許多國家已開始實施碳排放限制，這導致碳交易市場的出現，並對精確的碳價預測需求日益增加。在時間序列預測領域中，存在著多種方法來提高預測準確性。由於多種影響因素，預測碳價具有一定的困難性。這些因素包括政治和經濟條件、技術進步、演變中的氣候政策、波動的化石燃料成本、可再生能源替代品的可用性以及氣候政策在減少碳排放方面的有效性。此外，由於碳價機制如配額交易系統和碳稅在許多國家仍屬相對新的政策，因此缺乏準確預測所需的歷史數據。我們的方法著重於有效地整合新聞資訊，通過引入政府政策、市場供需、經濟狀況、能源價格、氣候變化事件和投資者情緒等多個影響因素的有意義的新聞資訊，以增強基於Transformer的時間序列模型的預測能力。為了實現這一目標，我們使用ChatGPT將新聞數據轉化為基於不同觀點的多個強度指標，這些指標有助於預測價格上升。這為模型提供了更多具有資訊量的新聞輸入。此外，我們提出了NTEformer，這是一種新的方式，相較於最廣泛使用的早期連接方法，將文本數據與時間序列模型相結合，並引入了News-Trend Extractor，旨在更好地利用新聞資訊。我們在模型的解碼器中增加了一個News-Trend Extractor，專門用於從新聞數據中學習。通過一系列的實驗，我們將NTEformer與其他結合時間序列數據和文本的方法進行了比較，證明了其優異的性能。通過有效整合新聞資訊並充分利用新聞趨勢提取器的專業知識，NTEformer模型在預測碳交易價格方面提供了增強的能力，相比不使用新聞資訊的方法，將整體誤差減少了顯著的28％。全面的分析和實驗驗證了我們方法的有效性，展示了其優於其他融合策略的能力。;Due to the problems caused by global warming, many countries have initiated carbon emission restrictions, leading to the emergence of carbon trading markets and a growing demand for accurate carbon price predictions. In the realm of time series forecasting, various methods exist to improve prediction accuracy. Predicting carbon pricing is difficult due to several influential factors. These factors encompass political and economic conditions, technological advancements, evolving climate policies, fluctuating fossil fuel costs, the availability of renewable energy alternatives, and the effectiveness of climate policies in reducing carbon emissions. Furthermore, limited historical data exists for accurate predictions, as carbon pricing mechanisms like cap-and-trade systems and carbon taxes are relatively new policies in many countries. Our approach focuses on effectively incorporating news information to enhance the predictive capabilities of the Transformer-based time series model by introducing meaningful news information based on several influential factors, including government policies, market supply and demand, economic conditions, energy prices, climate change events, and investor sentiment. To achieve this, we employ ChatGPT to transform news data into multiple strength indicators based on different perspectives that contribute to price increases. This provides us with more informative news inputs for the model. Furthermore, we propose NTEformer, a novel way, compared to the most widely used early concatenation method, to combine text data into time series model with News-Trend Extractor, designed to better leverage news information. We augment the decoder of the model with a News-Trend Extractor, specifically designed to learn from news data. Through a series of experiments, we compare NTEformer with other methods that combine time series data and text, demonstrating its superior performance. By effectively integrating news information and leveraging the expertise of the News-Trend Extractor, the NTEformer model offers enhanced capabilities in predicting carbon trading prices, reducing the overall error by a remarkable 28% compared to the method without using news information. The comprehensive analysis and experiments validate the effectiveness of our approach, showcasing its ability to outperform other fusion strategy.
Appears in Collections:	[Graduate Institute of Computer Science and Information Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	52	View/Open

社群 sharing

Loading...