Sentiment analysis became a very motivating area in both academic and industrial fields due to the exponential increase of the online published reviews and recommendations. To solve the problem of analysing and classifying those reviews and recommendations, several techniques have been proposed. Lately, deep neural networks showed promising outcomes in sentiment analysis. The growing number of Arab users on the Internet along with the increasing amount of published Arabic reviews and comments encouraged researchers to apply deep learning to analyse them. This article is a comprehensive overview of research works that utilised the deep learning approach for Arabic sentiment analysis.
PangBLeeL. Opinion mining and sentiment analysis. Found Trend Inform Retrieval2008; 2(1–2): 1–135.
2.
NasukawaTYiJ.Sentiment analysis: capturing favorability using natural language processing. In: Proceedings of the 2nd international conference on knowledge capture, Sanibel Island, FL, 23–25 October 2003, pp. 70–77. New York: ACM.
3.
El-MasriMAltrabshehNMansourH. Successes and challenges of Arabic sentiment analysis research: a literature review. Soc Netw Anal Min2017; 7(1): 54.
4.
AydoǧanEAkcayolMA. A comprehensive survey for sentiment analysis tasks using machine learning techniques. In: Proceedings of the 2016 international symposium on innovations in intelligent systems and applications (INISTA), Sinaia, 2–5 August 2016, pp. 1–7. New York: IEEE.
5.
SinghJSinghGSinghR. A review of sentiment analysis techniques for opinionated web text. CSI Trans ICT2016; 4(2–4): 241–247.
6.
MullenTCollierN.Sentiment analysis using support vector machines with diverse information sources. In: Proceedings of the 2004 conference on empirical methods in natural language processing, 2004, https://www.aclweb.org/anthology/W04-3253
7.
JiaLYuCMengW. The effect of negation on sentiment analysis and retrieval effectiveness. In: Proceedings of the 18th ACM conference on information and knowledge management, Hong Kong, China, 2–6 November 2009, pp. 1827–1830. New York: ACM.
ShoukryARafeaA.Sentence-level Arabic sentiment analysis. In: Proceedings of the 2012 international conference on collaboration technologies and systems (CTS), Denver, CO, 21–25 May 2012, pp. 546–550. New York: IEEE.
10.
LiGLiuF. Application of a clustering method on sentiment analysis. J Inform Sci2012; 38(2): 127–139.
11.
KimSMHovyE. Determining the sentiment of opinions. In: Proceedings of the 20th international conference on computational linguistics, Geneva, 23–27 August 2004, p. 1367. Stroudsburg, PA: Association for Computational Linguistics.
12.
HuMLiuB.Mining and summarizing customer reviews. In: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining, Seattle, WA, 22–25 August 2004, pp. 168–177. New York: ACM.
13.
MaksIVossenP. A lexicon model for deep sentiment analysis and opinion mining applications. Decis Support Syst2012; 53(4): 680–688.
AppelOChiclanaFCarterJet al. A hybrid approach to sentiment analysis. New York: IEEE, 2016.
16.
MalandrakisNKazemzadehAPotamianosAet al. SAIL: a hybrid approach to sentiment analysis. In: Proceedings of the second joint conference on lexical and computational semantics (*SEM), volume 2: seventh international workshop on semantic evaluation (SemEval 2003), Atlanta, GA, 14–15 June 2013, pp. 438–442. Stroudsburg, PA: Association for Computational Linguistics.
CollobertRWestonJBottouLet al. Natural language processing (almost) from scratch. J Mach Learn Res2011; 12: 2493–2537.
20.
Shirani-MehrH. Applications of deep learning to sentiment analysis of movie reviews. Technical report, Stanford University, Stanford, CA, 2014.
21.
SchmidhuberJ. Deep learning in neural networks: an overview. Neur Netw2015; 61: 85–117.
22.
Rojas-BarahonaLM. Deep learning for sentiment analysis. Lang Linguist Compass2016; 10(12): 701–719.
23.
HuangEHSocherRManningCDet al. Improving word representations via global context and multiple word prototypes. In: Proceedings of the 50th annual meeting of the association for computational linguistics (long papers), vol. 1, 2012, pp. 873–882. Stroudsburg, PA: Association for Computational Linguistics, https://nlp.stanford.edu/pubs/HuangACL12.pdf
24.
PenningtonJSocherRManningC. GloVe: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar, 25–29 October 2014, pp. 1532–1543. Stroudsburg, PA: Association for Computational Linguistics.
Rushdi-SalehMMartín-ValdiviaMTUreña-LópezLAet al. OCA: Opinion Corpus for Arabic. J Am Soc Inform Sci Technol2011; 62(10): 2045–2054.
28.
AlyMAtiyaA.LABR: a large scale Arabic book reviews dataset. In: Proceedings of the 51st annual meeting of the association for computational linguistics (short papers), vol. 2, Sofia, 4–9 August 2013, pp. 494–498. Stroudsburg, PA: Association for Computational Linguistics.
NabilMAlyMAtiyaA.ASTD: Arabic Sentiment Tweets Dataset. In: Proceedings of the 2015 conference on empirical methods in natural language processing, Lisbon, 17–21 September 2015, pp. 2515–2519. Stroudsburg, PA: Association for Computational Linguistics.
32.
AbdullaNAAhmedNAShehabMAet al. Arabic sentiment analysis: lexicon-based and corpus-based. In: Proceedings of the 2013 IEEE Jordan conference on applied electrical engineering and computing technologies (AEECT), Amman, Jordan, 3–5 December 2013, pp. 1–6. New York: IEEE.
33.
Al-SmadiMQawasmehOTalafhaBet al. Human Annotated Arabic Dataset of book reviews for aspect based sentiment analysis. In: Proceedings of the 2015 3rd international conference on future internet of things and cloud, Rome, 24–26 August 2015, pp. 726–730. New York: IEEE.
34.
LiuB. Sentiment analysis and opinion mining. Synthesis Lect Hum Language Technol2012; 5(1): 1–167.
35.
PangBLeeLVaithyanathanS.Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 conference on empirical methods in natural language processing, vol. 10, 2002, pp. 79–86. Stroudsburg, PA: Association for Computational Linguistics, http://www.cs.cornell.edu/home/llee/papers/sentiment.pdf
TangDQinBLiuT. Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing, Lisbon, 17–21 September 2015, pp. 1422–1432. Stroudsburg, PA: Association for Computational Linguistics.
39.
DouZY. Capturing user and product Information for document level sentiment analysis with deep memory network. In: Proceedings of the 2017 conference on empirical methods in natural language processing, Copenhagen, 7–11 September 2017, pp. 521–526. Stroudsburg, PA: Association for Computational Linguistics.
ZhangLWangSLiuB. Deep learning for sentiment analysis: a survey. Wiley Interdiscip Rev Data Min Knowl Discov2018; 8: e1253.
43.
Al-SallabAHajjHBadaroGet al. Deep learning models for sentiment analysis in Arabic. In: Proceedings of the second workshop on Arabic natural language processing, 2015, pp. 9–17, https://www.aclweb.org/anthology/W15-3202
44.
BadaroGBalyRHajjHet al. A large scale Arabic sentiment lexicon for Arabic opinion mining. In: Proceedings of the EMNLP 2014 workshop on Arabic natural language processing (ANLP), Doha, Qatar, 25 October 2014, pp. 165–173. Stroudsburg, PA: Association for Computational Linguistics.
45.
Al-SallabABalyRHajjHet al. AROMA: a recursive deep learning model for opinion mining in Arabic as a low resource language. ACM Trans Asian Low Resour Language Inform Process2017; 16(4): 25.
46.
BalyRBadaroGHamdiAet al. OMAM at SemEval-2017 task 4: evaluation of English state-of-the-art sentiment analysis models for Arabic and a new topic-based model. In: Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), Vancouver, BC, Canada, 3–4 August 2017, pp. 603–610. Stroudsburg, PA: Association for Computational Linguistics.
47.
BalyRHajjHHabashNet al. A sentiment treebank and morphologically enriched recursive deep models for effective sentiment analysis in Arabic. ACM Trans Asian Low Resour Language Inform Process2017; 16(4): 23.
48.
SocherRPerelyginAWuJet al. Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 conference on empirical methods in natural language processing, 2013, pp. 1631–1642, https://nlp.stanford.edu/~socherr/EMNLP2013_RNTN.pdf
49.
BalyRBadaroGEl-KhouryGet al. A characterization study of Arabic Twitter data with a benchmarking for state-of-the-art opinion mining models. In: Proceedings of the third Arabic natural language processing workshop, Valencia, 3 April 2017, pp. 110–118. Stroudsburg, PA: Association for Computational Linguistics.
AbdelhadeNSolimanTHAIbrahimHM. Detecting Twitter users opinions of Arabic comments during various time episodes via deep neural network. In: HassanienAShaalanKGaberT, et al. (eds) Advances in intelligent systems and computing: proceedings of the international conference on advanced intelligent systems and informatics. Cham: Springer, 2017, pp. 232–246.
53.
DahouAXiongSZhouJet al. Word embeddings and convolutional neural network for Arabic sentiment classification. In: Proceedings of the COLING 2016: the 26th international conference on computational linguistics: technical papers, Osaka, Japan, 11–17 December 2016, pp. 2418–2427. Stroudsburg, PA: Association for Computational Linguistics.
54.
LiuJShangJWangCet al. Mining quality phrases from massive text corpora. In: Proceedings of the 2015 ACM SIGMOD international conference on management of data, Melbourne, VIC, Australia, 31 May–4 June 2015, pp. 1729–1744. New York: ACM.
55.
Al-AzaniSEl-AlfyESM. Hybrid deep learning for sentiment polarity determination of Arabic microblogs. In: LiuDXieSLiY, et al. (eds) Neural information processing: proceedings of the international conference on neural information processing. Cham: Springer, 2017, pp. 491–500.
56.
GonzálezJAPlaFHurtadoLF. ELiRF-UPV at SemEval-2017 task 4: sentiment analysis using deep learning. In: Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), Vancouver, BC, Canada, 3–4 August 2017, pp. 723–727. Stroudsburg, PA: Association for Computational Linguistics.
57.
AlaybaAMPaladeVEnglandMet al. A combined CNN and LSTM model for Arabic sentiment analysis. In: HolzingerAKiesebergPTjoaA, et al. (eds) Machine learning and knowledge extraction: international cross-domain conference. Cham: Springer, 2018, pp. 179–191.
58.
HeikalMTorkiMEl-MakkyN. Sentiment analysis of Arabic tweets using deep learning. Proced Comput Sci2018; 142: 114–122.
59.
AbdullahMShaikhS. TeamUNCC at SemEval-2018 task 1: emotion detection in English and Arabic tweets using deep learning. In: Proceedings of the 12th international workshop on semantic evaluation, New Orleans, LA, 5–6 June 2018, pp. 350–357. Stroudsburg, PA: Association for Computational Linguistics.
60.
MohammadSBravo-MarquezF.Emotion intensities in tweets. In: Proceedings of the 6th joint conference on lexical and computational semantics, *SEM @ACM 2017, Vancouver, BC, Canada, 3–4 August 2017, pp. 65–77. Stroudsburg, PA: Association for Computational Linguistics.
FelboBMisloveASøgaardAet al. Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm, https://arxiv.org/pdf/1708.00524.pdf
63.
ElshakankeryKAhmedMF. HILATSA: a hybrid incremental learning approach for Arabic tweets sentiment analysis. Egypt Inform J. Epub ahead of print 4April2019. DOI: 10.1016/j.eij.2019.03.002.
64.
LuluLElnagarA. Automatic Arabic dialect classification using deep learning models. Proced Comput Sci2018; 142: 262–269.
65.
ZaidanOFCallison-BurchC. The Arabic Online Commentary dataset: an annotated dataset of informal Arabic with high dialectal content. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies: short papers, vol. 2, 2011, pp. 37–41. Stroudsburg, PA: Association for Computational Linguistics, https://www.cs.jhu.edu/~ccb/publications/arabic-dialect-corpus.pdf
66.
AlwehaibiARoyK. Comparison of pre-trained word vectors for Arabic text classification using deep learning approach. In: Proceedings of the 2018 17th IEEE international conference on machine learning and applications (ICMLA), Orlando, FL, 17–20 December 2018, pp. 1471–1474. New York: IEEE.
RuderSGhaffariPBreslinJG. INSIGHT-1 at SemEval-2016 task 5: deep learning for multilingual aspect-based sentiment analysis, https://www.aclweb.org/anthology/S16-1053
72.
Al-SmadiMQawasmehOAl-AyyoubMet al. Deep recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. J Comput Sci2018; 27: 386–393.
73.
MohammadASQwasmehOTalafhaBet al. An enhanced framework for aspect-based sentiment analysis of hotels’ reviews: Arabic reviews case study. In: Proceedings of the 11th international conference for internet technology and secured transactions (ICITST), Barcelona, 5–7 December 2016, pp. 98–103. New York: IEEE.
PashaAAl-BadrashinyMDiabMTet al. MADAMIRA: a fast, comprehensive tool for morphological analysis and disambiguation of Arabic. In: Proceedings of the language resources and evaluation conference, LREC2014, vol. 14, 2014, pp. 1094–1101, http://www.lrec-conf.org/proceedings/lrec2014/pdf/593_Paper.pdf
76.
DL4j. Deeplearning4j: open-source distributed deep learning for the JVM. Wakefield, MA: The Apache Software Foundation, 2016, p. 2.
Al-SmadiMTalafhaBAl-AyyoubMet al. Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews. Int J Mach Learn Cybernetics2019; 10: 2163–2175.
79.
PontikiMGalanisDPapageorgiouHet al. SemEval-2016 task 5: aspect based sentiment analysis. In: Proceedings of the 10th international workshop on semantic evaluation (SemEval-2016), 2016, pp. 19–30, http://alt.qcri.org/semeval2016/task5/
80.
MohammadSBravo-MarquezFSalamehMet al. SemEval-2018 task 1: affect in tweets. In: Proceedings of the 12th international workshop on semantic evaluation, 2018, pp. 1–17, http://saifmohammad.com/WebDocs/semeval2018-task1.pdf
KiritchenkoSMohammadSSalamehM. SemEval-2016 task 7: determining sentiment intensity of English and Arabic phrases. In: Proceedings of the 10th international workshop on semantic evaluation (SEMEVAL-2016), 2016, pp. 42–51, https://www.saifmohammad.com/WebDocs/semeval2016-task7.pdf
83.
CollobertRWestonJ. A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th international conference on machine learning, 2008, pp. 160–167. New York: ACM, https://ronan.collobert.com/pub/matos/2008_nlp_icml.pdf
MohitBRozovskayaAHabashNet al. The first QALB shared task on automatic text correction for Arabic. In: Proceedings of the EMNLP 2014 workshop on Arabic natural language processing (ANLP), Doha, Qatar, 25 October 2014, pp. 39–47. Stroudsburg, PA: Association for Computational Linguistics.
86.
Al-TwaireshNAl-KhalifaHAl-SalmanA.AraSenTi: large-scale Twitter-specific Arabic sentiment lexicons. In: Proceedings of the 54th annual meeting of the association for computational linguistics: long papers, vol. 1, Berlin, 7–12 August 2016, pp. 697–705. Stroudsburg, PA: Association for Computational Linguistics.
87.
RosenthalSFarraNNakovP.SemEval-2017 task 4: sentiment analysis in Twitter. In: Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), 2017, pp. 502–518, http://alt.qcri.org/semeval2017/task4/
