Interactive Attention-Based Convolutional GRU for Aspect Level Sentiment Analysis
基于交叉注意力的卷积门控循环单元的方面级别情感分析
作者: Lisha Chen, Tianrui Li, Huaishao Luo, Chengfeng Yin
Abstract

Aspect level sentiment analysis aims at identifying sentiment polarity towards specific aspect terms in a given sentence. Most methods based on deep learning integrate Recurrent Neural Network (RNN) and its variants with the attention mechanism to model the influence of different context words on sentiment polarity. In recent research, Convolutional Neural Network (CNN) and gating mechanism are introduced to obtain complex semantic representation. However, existing methods have not realized the importance of sufficiently combining the sequence modeling ability of RNN with the high-dimensional feature extraction ability of CNN. Targeting this problem, we propose a novel solution named Interactive Attention-based Convolutional Bidirectional Gated Recurrent Unit (IAC-GRU). IAC-GRU not only incorporates the sequence feature extracted by Bi-GRU into CNN to accurately predict the sentiment polarity, but also models the target and the context words separately and learns mutual influence between them. Additionally, we also incorporate the position information and Part-of-Speech (POS) information as prior knowledge into the embedding layer. The experimental results on SemEval2014 datasets show the effectiveness of our proposed model.


Keywords:Sentiment classification; convolutional neural network; gated recurrent units; attention mechanism


摘要

方面级情感分析旨在识别给定语句中特定方面术语的情感极性。大部分基于深度学习的方法将循环神经网络(RNN)及其变体与注意力机制相融合,以建模上下文词汇对情感极性的影响。在近期的研究方法中,卷积神经网络(CNN)和门控机制也被引入以获得复杂的语义特征。然而,现有的方法并未意识到充分结合RNN的序列建模能力和CNN的高维度特征提取能力的重要性。针对这一问题,本文提出了一种全新的解决方案,即,基于交互式注意力机制的卷积双向门控循环单元(IAC-GRU)。IAC-GRU不仅将Bi-GRU提取到的序列特征融合到了CNN中以准确预测情感极性,还分别建模了上下文词汇和方面术语并学习两者之间的相互影响。此外,本文还将位置信息和词性标注信息作为先验知识融合到了嵌入层中。在SemEval2014数据集上进行的实验结果表明了本文模型的有效性。


 关键词: 情感分析、卷积神经网络、门控循环单元、注意力机制


第四篇文章.png



 


 


论文信息 PAPER INFORMATION
所属期刊
Human-Centric Intelligent Systems
ISSN(Online)
2667-1336
学科领域
计算机科学
发表时间
2021-07-20