Skip to main content

ACR-SA: attention-based deep model through two-channel CNN and Bi-RNN for sentiment analysis.

Kamyab, M., Liu, G., Rasool, A. and Adjeisah, M., 2022. ACR-SA: attention-based deep model through two-channel CNN and Bi-RNN for sentiment analysis. PeerJ Computer Science, 8, e877.

Full text available as:

[img]
Preview
PDF (OPEN ACCESS ARTICLE)
peerj-cs-877.pdf - Published Version
Available under License Creative Commons Attribution.

9MB

DOI: 10.7717/peerj-cs.877

Abstract

Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN) have been successfully applied to Natural Language Processing (NLP), especially in sentiment analysis. NLP can execute numerous functions to achieve significant results through RNN and CNN. Likewise, previous research shows that RNN achieved meaningful results than CNN due to extracting long-term dependencies. Meanwhile, CNN has its advantage; it can extract high-level features using its local fixed-size context at the input level. However, integrating these advantages into one network is challenging because of overfitting in training. Another problem with such models is the consideration of all the features equally. To this end, we propose an attention-based sentiment analysis using CNN and two independent bidirectional RNN networks to address the problems mentioned above and improve sentiment knowledge. Firstly, we apply a preprocessor to enhance the data quality by correcting spelling mistakes and removing noisy content. Secondly, our model utilizes CNN with max-pooling to extract contextual features and reduce feature dimensionality. Thirdly, two independent bidirectional RNN, i.e., Long Short-Term Memory and Gated Recurrent Unit are used to capture long-term dependencies. We also applied the attention mechanism to the RNN layer output to emphasize each word’s attention level. Furthermore, Gaussian Noise and Dropout as regularization are applied to avoid the overfitting problem. Finally, we verify the model’s robustness on four standard datasets. Compared with existing improvements on the most recent neural network models, the experiment results show that our model significantly outperformed the state-of-the-art models.

Item Type:Article
ISSN:2376-5992
Uncontrolled Keywords:Deep learning; Convolutional neural network; Bi-direction recurrent neural network; Attention mechanism; Social media
Group:Faculty of Media & Communication
ID Code:39967
Deposited By: Symplectic RT2
Deposited On:12 Jun 2024 13:22
Last Modified:12 Jun 2024 13:22

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -