Aspect-Based Sentiment Analysis (ABSA) has become a trending research domain due to its ability to transform lives as well as the technical challenges involved in it. In this paper, a unique set of rules has been formulated to extract aspect-opinion phrases. It helps to reduce the average sentence length by 84% and the complexity of the text by 50%. A modified rank-based version of Term-Frequency - Inverse-Document-Frequency (TF-IDF) has been proposed to identify significant aspects. An innovative word representation technique has been applied for aspect categorization which identifies both local as well as global context of a word. For sentiment classification, pre-trained Bidirectional Encoder Representations from Transformers (BERT) has been applied as it helps to capture long-term dependencies and reduce the overhead of training the model from scratch. However, BERT has drawbacks like quadratic drop in efficiency with an increase in sequence length which is limited to 512 tokens. The proposed methodology mitigates these drawbacks of a typical BERT classifier accompanied by a rise in efficiency along with an improvement of 8% in its accuracy. Furthermore, it yields enhanced performance and efficiency compared to other state-of-the-art methods. The assertions have been established through extensive analysis upon movie reviews and Sentihood data-sets.
NasukawaT. and YiJ., Sentiment analysis: Capturing favorability using natural language processing, In Proceedings of the 2nd international conference on Knowledge capture, (2003), 70–77. ACM,
2.
DaveK., LawrenceS. and PennockD.M., Mining the peanut gallery: Opinion extraction and semantic classification of product reviews, In Proceedings of the 12th international conference on World Wide Web (2003), 519–528. ACM,
3.
PangB., LeeL. and VaithyanathanS., Thumbs up?: sentiment classification using machine learning techniques, In Proceedings of the ACL-02 conference on Empirical methods in natural language processing-Volume 10, pp. 79–86. Association for Computational Linguistics, (2002).
4.
WilsonT., WiebeJ. and HoffmannP., Recognizing contextual polarity in phrase-level sentiment analysis, In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing. (2005).
5.
HuM. and LiuB., Mining and summarizing customer reviews, In Proceedings of the tenth ACMSIGKDD international conference on Knowledge discovery and data mining, 168–177. ACM, (2004).
6.
NakagawaT., InuiK. and KurohashiS., Dependency tree-based sentiment classification using CRFs with hidden variables, In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Association for Computational Linguistics, (2010), 786–794.
7.
IrsoyO. and CardieC., Opinion mining with deep recurrent neural networks, In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), (2014), 720–728.
8.
LiuP., JotyS. and MengH., Fine-grained opinion mining with recurrent neural networks and word embeddings, In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (2015), 1433–1443.
9.
PoriaS., CambriaE., KuL.-W., GuiC. and GelbukhA., A rule-based approach to aspect extraction from product reviews, In Proceedings of the second workshop on natural language processing for social media (SocialNLP), (2014), 28–37.
10.
RayP. and ChakrabartiA., A Mixed approach of Deep Learning method and Rule-Based method to improve Aspect Level Sentiment Analysis, Applied Computing and Informatics (2019).
11.
GersF.A. and SchmidhuberJ., Recurrent nets that time and count, In Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium3 (2000), 189–194. IEEE,
12.
PoriaS., CambriaE. and GelbukhA., Aspect extraction for opinion mining with a deep convolutional neural network, Knowledge-Based Systems108 (2016), 42–49.
13.
Da’uA. and SalimN., Aspect extraction on user textual reviews using multi-channel convolutional neural network, Peer J Computer Science5 (2019), e191.
14.
LuoH., LiT., LiuB., WangB. and UngerH., Improving aspect term extraction with bidirectional dependency tree representation, IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)27(7) (2019), 1201–1212.
15.
MaY., PengH. and CambriaE., Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM, In Thirty-Second AAAI Conference on Artificial Intelligence. (2018).
16.
LiuQ., GaoZ., LiuB. and ZhangY., Automated rule selection for aspect extraction in opinion mining, In Twenty-Fourth International Joint Conference on Artificial Intelligence. (2015).
DevlinJ., ChangM.-W., LeeK. and ToutanovaK., Bert: Pre-training of deep bidirectional transformers for language understanding, arXiv preprint arXiv:1810.04805 (2018).
19.
VaswaniA., ShazeerN., ParmarN., UszkoreitJ., JonesL., GomezA.N., KaiserŁ. and PolosukhinI., Attention is all you need, In Advances in neural information processing systems, (2017), 5998–6008.
20.
LiuB., Sentiment analysis: Mining opinions, sentiments, and emotions, Cambridge University Press, (2015).
21.
MedhatW., HassanA. and KorashyH., Sentiment analysis algorithms and applications: A survey, Ain Shams Engineering Journal5(4) (2014), 1093–1113.
22.
AlenaN., HelmutP. and MitsuruI., Recognition of Affect, Judgment, and Appreciation in Text. In: Proceedings of the 23rd international conference on computational linguistics (Coling 2010), Beijing; (2010), 806–814.
23.
AlexandraB., Hermida JesuM. and AndreM., Detecting implicit expressions of emotion in text: a comparative analysis, Decis Support Syst53 (2012), 742–753.
24.
JurekA., MulvennaM.D. and BiY., Improved lexicon-based sentiment analysis for social media analytics, Security Informatics4(1) (2015), 9.
25.
AggarwalC.C. and ZhaiC.X., eds. Mining text data, Springer Science & Business Media, (2012).
26.
LoR.T.-W., HeB. and OunisI., Automatically building a stopword list for an information retrieval system, In, Journal on Digital Information Management: Special Issue on the 5th Dutch-Belgian Information Retrieval Workshop (DIR)5 (2005), 17–24.
MikolovT., ChenK., CorradoG. and DeanJ., Efficient estimation of word representations in vector space, arXiv preprint arXiv:1301.3781 (2013).
29.
MikolovT., SutskeverI., ChenK., CorradoG.S. and DeanJ., Distributed representations of words and phrases and their compositionality, In Advances in neural information processing systems, (2013), 3111–3119.
30.
PenningtonJ., SocherR. and ManningC., Glove: Global vectors for word representation, In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), (2014), 1532–1543.
31.
SunC., HuangL. and QiuX., Utilizing bert for aspect-based sentiment analysis via constructing auxiliary sentence, arXivpreprint arXiv:1903.09588 (2019).
32.
PetersM.E., NeumannM., IyyerM., GardnerM., ClarkC., LeeK. and ZettlemoyerL., Deep contextualized word representations, arXiv preprint arXiv:1802.05365 (2018).
33.
HowardJ. and RuderS., Universal language model fine-tuning for text classification, arXiv preprint arXiv:1801.06146 (2018).
34.
TranT.K. and PhanT.T., A hybrid approach for building a Vietnamese sentiment dictionary, Journal of Intelligent & Fuzzy Systems35(1) (2018), 967–978.
35.
NguyenT.-L., KavuriS. and LeeM., A fuzzy convolutional neural network for text sentiment analysis, Journal of Intelligent & Fuzzy Systems35(6) (2018), 6025–6034.
36.
ZengD., DaiY., LiF., WangJ. and SangaiahA.K., Aspect based sentiment analysis by a linguistically regularized CNN with gated mechanism, Journal of Intelligent & Fuzzy Systems36(5) (2019), 3971–3980.
37.
GuptaV., SinghV.K., MukhijaP. and GhoseU., Aspect-based sentiment analysis of mobile reviews, Journal of Intelligent & Fuzzy Systems36(5) (2019), 4721–4730.
38.
ZhangX. and GaoT., Multi-head attention model for aspect level sentiment analysis, Journal of Intelligent & Fuzzy Systems38(1) (2020), 89–96.
39.
SaeidiM., BouchardG., LiakataM. and RiedelS., Sentihood: Targeted aspect based sentiment analysis dataset for urban neighbourhoods, arXiv preprint arXiv:1610.03771 (2016).
40.
HonnibalM., spaCy: Industrial-strength Natural Language Processing (NLP) with Python and Cython. URL https://spacy.io/. (2015).
41.
Du BayW.H., The Principles of Readability, (2004).
42.
BalbiS., MisuracaM. and SpanoM., A cosine-based validation measure for Document Clustering, In JADT, (2016), 13ème. 2016.
43.
AlqaryoutiO., SiyamN., MonemA.A. and ShaalanK., Aspect-based sentiment analysis using smart government review data, Applied Computing and Informatics (2019).
44.
CambriaE., PoriaS., BajpaiR. and SchullerB., SenticNet 4: A semantic resource for sentiment analysis based on conceptual primitives, In Proceedings of COLING 2016, the 26th international conference on computational linguistics: Technical papers, (2016), 2666–2677.
45.
LiuF., CohnT. and BaldwinT., Recurrent entity networks with delayed memory update for targeted aspect-based sentiment analysis, arXiv preprint arXiv:1804.11019 (2018).
46.
HenaffM., WestonJ., SzlamA., BordesA. and LeCunY., Tracking the world state with recurrent entity networks, arXiv preprint arXiv:1612.03969 (2016).
