The sentiment classification aims to learn sentiment features from the annotated corpus and automatically predict the sentiment polarity of new sentiment text. However, people have different ways of expressing feelings in different domains. Thus, there are important differences in the characteristics of sentimental distribution across different domains. At the same time, in certain specific domains, due to the high cost of corpus collection, there is no annotated corpus available for the classification of sentiment. Therefore, it is necessary to leverage or reuse existing annotated corpus for training. In this article, we proposed a new algorithm for extracting central sentiment sentences in product reviews, and improved the pre-trained language model Bidirectional Encoder Representations from Transformers (BERT) to achieve the domain transfer for cross-domain sentiment classification. We used various pre-training language models to prove the effectiveness of the newly proposed joint algorithm for text-ranking and emotional words extraction, and utilised Amazon product reviews data set to demonstrate the effectiveness of our proposed domain-transfer framework. The experimental results of 12 different cross-domain pairs showed that the new cross-domain classification method was significantly better than several popular cross-domain sentiment classification methods.
TurneyPD. Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th annual meeting on Association for Computational Linguistics, Philadelphia, PA, July 2002, pp. 417–424. Stroudsburg, PA: Association for Computational Linguistics.
2.
TurneyPD. Mining the web for synonyms: PMI-IR versus LSA on TOEFL. In: Proceedings of the 12th European Conference on machine learning, Freiburg, 5–7 September 2001, pp. 491–502. Berlin: Springer.
3.
PangBLeeLVaithyanathanS.Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the conference on empirical methods in natural language processing, Philadelphia, PA, July 2002, pp. 79–86. Stroudsburg, PA: Association for Computational Linguistics.
4.
DasguptaSNgV. Mine the easy, classify the hard: a semi-supervised approach to automatic sentiment classification. In: Proceedings of the joint conference of the 47th annual meeting of the ACL and the 4th international joint conference on natural language processing of the AFNLP, Singapore, August 2009, pp. 701–709. Stroudsburg, PA: Association for Computational Linguistics.
5.
OnanAKorukoğluSBulutH.Ensemble of keyword extraction methods and classifiers in text classification. Expert Syst Appl2016; 57: 232–247.
6.
OnanAKorukoğluS.A feature selection model based on genetic rank aggregation for text sentiment classification. J Inf Sci2017; 43(1): 25–38.
7.
LiSWangZZhouGet al. Semi-supervised learning for imbalanced sentiment classification. In: Proceedings of the 21nd international joint conference on artificial intelligence, Barcelona, 16–22 July 2011, pp. 1826–1831. Menlo Park CA: AAAI Press.
8.
OnanAKorukoğluSBulutH.A hybrid ensemble pruning approach based on consensus clustering and multi-objective evolutionary algorithm for sentiment classification. Inform Process Manag2017; 53(4): 814–833.
9.
LiFHuangMZhuX.Sentiment analysis with global topics and local dependency. In: Proceedings of the 24th AAAI conference on artificial intelligence, Atlanta, GA, 11–15 July 2010, pp. 1371–1376. Menlo Park CA: AAAI Press.
10.
OnanA.Biomedical text categorization based on ensemble pruning and optimized topic modelling. Comput Math Method M2018; 2018: 2497471.
11.
OnanA.Two-stage topic extraction model for bibliometric data analysis based on word embeddings and clustering. IEEE Access2019; 7: 145614–145633.
12.
KhatuaAKhatuaACambriaE.Predicting political sentiments of voters from Twitter in multi-party contexts. Appl Soft Comput2020; 97: 106743.
13.
LiWShaoWJiSet al. BiERU: bidirectional emotional recurrent unit for conversational sentiment analysis. arXiv preprint, 2020, https://arxiv.org/pdf/2006.00492.pdf
14.
OnanA.Sentiment analysis on product reviews based on weighted word embeddings and deep neural networks. Concurr Comp: Pract E. Epub ahead of print 29June2020. DOI: 10.1002/cpe.5909.
15.
OnanAToçoğluMA.A term weighted neural language model and stacked bidirectional LSTM based framework for sarcasm identification. IEEE Access2021; 9: 7701–7722.
16.
BasiriMEAbdarMCifciMAet al. A novel method for sentiment classification of drug reviews using fusion of deep and machine learning techniques. Knowl-Based Syst2020; 198: 105949.
17.
AkhtarMSEkbalACambriaE.How intense are you? Predicting intensities of emotions and sentiments using stacked ensemble. IEEE Comput Intell M2020; 15(1): 64–75.
18.
BasiriMENematiSAbdarMet al. ABCDM: an attention-based bidirectional CNN-RNN deep model for sentiment analysis. Future Gener Comp Sy2020; 115: 279–294.
19.
Al-GhadirAIAzmiAMHussainA.A novel approach to stance detection in social media tweets by fusing ranked lists and sentiments. Inform Fusion2021; 67: 29–40.
20.
OnanA.Mining opinions from instructor evaluation reviews: a deep learning approach. Comput Appl Eng Educ2020; 28(1): 117–138.
21.
OnanA.Sentiment analysis on massive open online course evaluations: a text mining and deep learning approach. Comput Appl Eng Educ. Epub ahead of print 4May2020. DOI: 10.1002/cae.22253.
22.
DevlinJChangM-WLeeKet al. BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint, 2018, https://arxiv.org/pdf/1810.04805.pdf
23.
BlitzerJDredzeMPereiraF. Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: Proceedings of the 45th annual meeting of the Association of Computational Linguistics, Prague, 25–27 June 2007, pp. 440–447. Stroudsburg, PA: Association for Computational Linguistics.
24.
BlitzerJMcdonaldRPereiraF.Domain adaptation with structural correspondence learning. In: Proceedings of the conference on empirical methods in natural language processing, Sydney, NSW, Australia, July 2006, pp. 120–128. Stroudsburg, PA: Association for Computational Linguistics.
25.
Ben-DavidSBlitzerJCrammerKet al. Analysis of representations for domain adaptation. Adv Neural Inf Process Syst2007; 19: 137–144.
26.
PanSJNiXSunJ-Tet al. Cross-domain sentiment classification via spectral feature alignment. In: Proceedings of the 19th international conference on World Wide Web, Raleigh, NC, April 2010, pp. 751–760. New York: Association for Computing Machinery.
27.
ChoiYCardieC. Adapting a polarity lexicon using integer linear programming for domain-specific sentiment classification. In: Proceedings of the conference on empirical methods in natural language processing, Singapore, August 2009, pp. 590–598. Stroudsburg, PA: Association for Computational Linguistics.
28.
BollegalaDWeirDJCarrollJA. Using multiple sources to construct a sentiment sensitive thesaurus for cross-domain sentiment classification. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics, Portland, OR, June 2011, pp. 132–141. Stroudsburg, PA: Association for Computational Linguistics.
29.
ZiserYReichartR. Neural structural correspondence learning for domain adaptation. In: Proceedings of the 21st conference on computational natural language learning (CoNLL 2017), Vancouver, BC, Canada, August 2016.
30.
ZhangBXuXYangMet al. Cross-domain sentiment classification by capsule network with semantic rules. IEEE Access2018; 6: 58284–58294.
31.
MihalceaRTarauP.TextRank: bringing order into texts. In: Proceedings of the conference on empirical methods in natural language processing, Barcelona, July 2004.
32.
KleinbergJM.Authoritative sources in a hyperlinked environment. J ACM1999; 46(5): 604–632.
33.
BrinSPageL.The anatomy of a large-scale hypertextual Web search engine. Comput Networks ISDN1998; 30(1–7): 107–117.
RadfordAWuJChildRet al. Language models are unsupervised multitask learners. OpenAI Blog2019; 1(8): 9.
38.
YangZDaiZYangYet al. XLNnet: generalized autoregressive pretraining for language understanding. Adv Neural Inf Process Syst2019; 32: 5753–5763.
39.
TanSWuGTangHet al. A novel scheme for domain-transfer problem in the context of sentiment analysis. In: CIKM ‘07: proceedings of the sixteenth ACM conference on conference on information and knowledge management, Lisbon, November 2007.
40.
HanEKarypisG.Centroid-based document classification analysis & experimental result. In: ZighedDAKomorowskiJŻytkowJ (eds) Principles of data mining and knowledge discovery. PKDD 2000. Berlin: Springer, 2000, pp. 424–431.
YftahZRoiR. Pivot Based Language Modeling for improved neural domain adaptation. In: Proceedings of the 2018 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, New Orleans, LA, June 2018, pp. 1241–1251. Stroudsburg, PA: Association for Computational Linguistics
44.
LiuHLongMWangJet al. Transferable Adversarial Training: a general approach to adapting deep classifiers. In: Proceedings of the 36th international conference on machine learning, PMLR 97, Long Beach, CA, 9–15 June 2019, pp. 4013–4022, http://proceedings.mlr.press/v97/liu19b/liu19b.pdf
45.
DuCSunHWangJet al. Adversarial and domain-aware BERT for cross-domain sentiment analysis. In: Proceedings of the 58th annual meeting of the Association for Computational Linguistics, 5–10 July 2020, https://www.aclweb.org/anthology/2020.acl-main.370/
