隨著社交網路與電子商務網站的普及，使用者從被動的接收訊息轉變為主動傳播訊息，評論以及網路訊息所呈現的價值也越來越重要，過去幾年的分析研究，試圖去分析了解有關具體的輿論產品、主題、評論與推文的趨勢，在各個方面發揮著重要作用。本研究利用不同的向量化處理，對多模態分析模型進行驗證比對，確認模型可有效提升準確度。本研究提出一種由兩種模型組成之結合特徵，並將此特徵結合深度學習神經網路建構建立多模態分析模型。模型一是基於Glove向量、注意力機制與GRU神經網路架構之深度學習模型，模型二是基於Word2Vec向量、注意力機制與CNN神經網路架構之深度學習模型，多模態分析模型經由K折交叉驗證、F1測量方法進行模型驗證。實驗結果證明本研究提出之多模態分析模型，準確率高於相關研究，利用高層級多模態結合法，將多個模型的特徵取出並加以結合形成結合特徵，並將此特徵進行神經網路訓練，可使特徵集有互相輔助之效果，透過兩種向量與最佳神經網路架構並搭配多模態方法可以得到91.56%的準確率，並在模型驗證得到了93%的驗證值，證明本研究提出之多模態分析模型用於評論文本領域，可有效提升模型預測準確率，使其準確率有顯著的提升。;With the popularity of social networks and e-commerce sites, users have switched from passively receiving messages to actively disseminating messages. The value of comments and online messages is also becoming more and more important. Analysis and research over the past few years. Trying to analyze trends about specific product products, topics, reviews, and tweets. Play an important role in all aspects. This study uses different vectorization processes to verify the multimodal analysis model and confirm that the model can effectively improve the accuracy. This study proposes a combination of two models. This feature is combined with deep learning neural network construction to build a multimodal analysis model. Model 1 is a deep learning model based on Glove vector, attention mechanism and GRU neural network architecture. Model 2 is a deep learning model based on Word2Vec vector, attention mechanism and CNN neural network architecture. Multimodal analysis model is validated by K-fold cross validation and F1 measurement method. The experimental results prove that the multimodal analysis model proposed in this study has higher accuracy than related research. Using the high-level multi-modal combination method, the features of multiple models are extracted and combined to form a combined feature, and this feature is trained in neural network. The feature set can be mutually assisted, and the accuracy can be 91.56% through the two vectors and the optimal neural network architecture combined with the multi-modal method. And the model verification shows 93% verification value, which proves that the multimodal analysis model proposed in this study is used in the field of comment texts, which can effectively improve the accuracy of model prediction and improve its accuracy.
