Sentiment Analysis of Product Reviews Using Transformer Enhanced 1D-CNN and BiLSTM

Abstract

Abstract The rapid growth of Internet-enabled applications, such as social media platforms, e-commerce sites, and blogs, has led to a surge in user-generated content. This vast amount of data has made sentiment analysis increasingly valuable. Modern Aspect-Based Sentiment Analysis (ABSA) offers a more detailed approach by identifying sentiment trends related to specific aspects within the text. However, the challenge lies in analyzing reviews that are often short, unstructured, and filled with slang and emotive language, making it difficult to gauge customer opinions accurately. To address these issues, we proposed an effective hybrid approach “RoBERTa-1D-CNN-BiLSTM” for ABSA. Initially, the pre-trained Robustly Optimized BERT approach (RoBERTa) and One Dimensional Convolutional Neural Network (1D-CNN) models are used to extract features at the aspect level from the context of the review, following which classification is performed using Bidirectional Long Short-Term Memory (BiLSTM). The approach is evaluated on three cross-domain standards datasets, yielding an accuracy of 92.33%. The results of the experiments show that it surpasses the current leading methods in sentiment analysis and product recommendation.