Sentiment analysis deals with classifying the opinions in text. Twitter is the most popular microblogging platform in social media, with hundreds of millions of tweets posted every day. A considerable number of tweets contain opinions. The goal of this paper is to classify the polarity of the tweets into positive and negative classes using dynamic sentiment lexicons based on frequencies of words in positive and negative classes. We extract five meta-level features incorporating the generated sentiment lexicons and classify the text based on them. We also incorporate some previously known lexicon-based and corpus-based features. The proposed method is assessed on six datasets, and outperforms previous papers on accuracy on four datasets, and on f-measure on three datasets. This method generates sentiment lexicons dynamically. The changes of meanings of words can be captured by the generated lexicons. Our research produces very promising results in sentiment analysis in terms of accuracy and f-measure. The accuracy of our method on four datasets and the f-measure of our method on three datasets are higher than 85%.
LiuB., Sentiment analysis and opinion mining, Morgan & Claypool Publishers, 2012.
2.
PakA. and ParoubekP., Twitter as a corpus for sentiment analysis and opinion mining, LREc10 (2010), 1320–1326.
3.
AgarwalA., XieB., VovshaI., RambowO. and PassonneauR., Sentiment analysis of twitter data, in Proceedings of the Workshop on Languages in Social Media, LSM’11, Association for Computational Linguistics, Stroudsburg, PA, USA, 2011, pp. 30–38.
4.
WangX., WeiF., LiuX., ZhouM. and ZhangM., Topic sentiment analysis in twitter: A graph-based hashtag sentiment classification approach, In Proceedings of the 20th ACM International Conference on Information and Knowledge Management, ACM, 2011, pp. 1031–1040.
5.
MaynardD., BontchevaK. and RoutD., Challenges in developing opinion mining tools for social media, Proceedings of the@ NLP Can u Tag# Usergeneratedcontent, 2012, pp. 15–22.
6.
MomeniE., CardieC. and DiakopoulosN., A survey on assessment and ranking methodologies for user-generated content on the web, ACM Computing Surveys (CSUR)48(3) (2015), 41.
7.
KouloumpisE., WilsonT. and MooreJ., Twitter sentiment analysis: The good the bad and the omg!, Icwsm11 (2011), 538–541.
8.
TurneyP.D., Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL 02, Association for Computational Linguistics, Stroudsburg, PA, USA, 2002, pp. 417–424.
9.
PangB., LeeL. and VaithyanathanS., Thumbs up? Sentiment classification using machine learning techniques, Proceedings of EMNLP, 2002, pp. 79–86.
10.
HeB., MacdonaldC., HeJ. and OunisI., An effective statistical approach to blog post opinion retrieval, Proceedings of the 17th ACM Conference on Information and Knowledge Management, CIKM’08, 2008, pp. 1063–1072.
11.
MelvilleP., GrycW. and LawrenceR.D., Sentiment analysis of blogs by combining lexical knowledge with text classification, Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD’09, ACM, New York, NY, USA, 2009, pp. 1275–1284.
12.
BalahurA., SteinbergerR., KabadjovM., ZavarellaV., van der GootE.,
HalkiaM.,
PouliquenB. and BelyaevaJ., Sentiment analysis in the news, in Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), 2010.
13.
da SilvaN.F.F.,
HruschkaE.R. and HruschkaE.R., Tweet sentiment analysis with classifier ensembles, Decision Support Systems66 (2014), 170–179.
14.
JiangL., YuM., ZhouM., LiuX. and ZhaoT., Target-dependent twitter sentiment classification, In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, 2011, pp. 151–160.
15.
BarbosaL. and FengJ., Robust sentiment detection on twitter from biased and noisy data, In Proceedings of the 23rd International Conference on Computational Linguistics: Posters, 2010, pp. 36–44.
16.
ZhaoJ., LiuK. and WangG., Adding redundant features for CRFs-based sentence sentiment classification, In Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2008, pp. 117–126.
17.
ShenY., LiS., ZhengL., RenX. and ChengX., Emotion mining research on micro-blog, In Web Society, 2009, 1st IEEE Symposium on SWS’09, 2009, pp. 71–75.
18.
CambriaE. and WhiteB., Jumping NLP curves: A review of natural language processing research, IEEE Comput Intell Mag9(2) (2014), 48–57.
19.
ChaffarS. and InkpenD., Using a heterogeneous dataset for emotion analysis in text, Advances in Artificial Intelligence (2011), 62–67.
20.
GodboleN., SrinivasaiahM. and SkienaS., Large-scale sentiment analysis for news and blogs, ICWSM7(21) (2007), 219–222.
21.
NielsenF., A new anew: Evaluation of a word list for sentiment analysis in microblogs, in Proceedings of the ESWC2011 Workshop on ‘Making Sense of Microposts’: Big Things Come in Small Packages, 2011.
22.
ZimbraD., GhiassiM. and LeeS., Brand-Related Twitter Sentiment Analysis Using Feature Engineering and the Dynamic Architecture for Artificial Neural Networks, In 2016 49th Hawaii International Conference on System Sciences (HICSS), 2016, pp. 1930–1938.
23.
SaifH., HeY., FernandezM. and AlaniH., Contextual semantics for sentiment analysis of Twitter, Information Processing & Management52(1) (2016), 5–19.
24.
LuY., CastellanosM., DayalU. and ZhaiC., Automatic construction of a context-aware sentiment lexicon: An optimization approach, In Proceedings of the 20th International Conference on World Wide Web, 2011, pp. 347–356.
25.
PlattJ.C., 12 fast training of support vector machines using sequential minimal optimization, Advances in Kernel Methods (1999), 185–208.
26.
Bravo-MarquezF., MendozaM. and PobleteB., Meta-level sentiment models for big social data analysis, Knowledge-Based Systems69 (2014), 86–99.
27.
CarvalhoP., SarmentoL., SilvaM.J. and deE., Oliveira, Clues for detecting irony in user-generated contents: Oh...!! it’s so easy;-), in Proceeding of the 1st International CIKM Workshop on Topic-sentiment Analysis for Mass Opinion, 2009.
28.
GoA., BhayaniR. and HuangL., Twitter sentiment classification using distant supervision, Technical report Stanford University, 2010.
29.
LiuK., LiW. and GuoM., Emoticon smoothed language models for Twitter sentiment analysis, in Proceedings of the 26th AAAI Conference on Artificial Intelligence, 2012.
30.
GonçalvesP., AraújoM.,
BenevenutoF. and ChaM., Comparing and combining sentiment analysis methods, in Proceedings of the First ACM Conference on Online Social Networks, COSN ’13, ACM, New York, NY, USA, 2013, pp. 27–38.
31.
ZhangL., GhoshR., DekhilM., HsuM. and LiuB., Combining lexicon-based and learning based methods for twitter sentiment analysis, HP Laboratories, Technical Report HPL-2011, 89, 2011.
32.
MohammadS., KiritchenkoS. and ZhuX., Nrc-Canada: Building the state-of-the-art in sentiment analysis of tweets, in Proceedings of the Seventh International Workshop on Semantic Evaluation Exercises (SemEval-2013), Atlanta, Georgia, USA, 2013.
33.
HuX., TangL., TangJ. and LiuH., Exploiting social relations for sentiment analysis in microblogging, in Proceedings of the Sixth ACM International Conference on Web Search and Data Mining, 2013, pp. 537–546.
34.
SaifH., HeY. and AlaniH., Semantic sentiment analysis of twitter, in Proceedings of the 11th International Conference on The Semantic Web—Volume Part I, ISWC’12, Springer-Verlag, Berlin, Heidelberg, 2012, pp. 508–524.
35.
Bravo-MarquezF., MendozaM. and PobleteB., Combining strengths, emotions and polarities for boosting twitter sentiment analysis, in Proceedings of the Second International Workshop on Issues of Sentiment Discovery and Opinion Mining, ACM, 2013.
36.
KaewpitakkunY., ShiraiK. and MohdM., Sentiment Lexicon Interpolation and Polarity Estimation of Objective and Out-Of-Vocabulary Words to Improve Sentiment Classification on Microblogging, in Proceedings of 28th Pacific Asia Conference on Language, Information and Computation, 2014, pp. 204–213.
37.
SaifH., HeY., FernandezM. and AlaniH., Adapting Sentiment Lexicons Using Contextual Semantics for Sentiment Analysis of Twitter, The Semantic Web: ESWC 2014 Satellite Events, Springer International Publishing, 2014, pp. 54–63.
38.
ColettaL.F.S., da SilvaN.F.F.,
HruschkaE.R. and HruschkaE.R.Jr, Combining Classification and Clustering for Tweet Sentiment Analysis, in Proceedings of 2014 Brazilian Conference on Intelligent Systems (BRACIS), 2014.
39.
SperiosuM., SudanN., UpadhyayS. and BaldridgeJ., Twitter polarity classification with label propagation over lexical links and the follower graph, Proceedings of the First Workshop on Unsupervised Learning in NLP, EMNLP’11, Association for Computational Linguistics, 2011, pp. 53–63.
40.
CarvalhoJ., PradoA. and PlastinoA., A Statistical and Evolutionary Approach to Sentiment Analysis, Web Intelligence (WI) and Intelligent Agent Technologies (IAT), 2014 IEEE/WIC/ACM International Joint Conferences on, Vol. 2, IEEE, 2014.
41.
LuT.J., Semi-supervised microblog sentiment analysis using social relation and text similarity, Big Data and Smart Computing (BigComp), 2015 International Conference on, 2015.
42.
SaifH., HeY., FernandezM. and AlaniH., Semantic patterns for sentiment analysis of Twitter, In The Semantic Web–ISWC, Springer International Publishing, 2014, pp. 324–340.
43.
BaecchiC., UricchioT., BertiniM. and Del BimboA., A multimodal feature learning approach for sentiment analysis of social network multimedia, Multimedia Tools and Applications (2015), 1–19.
44.
HuX., TangJ., GaoH. and LiuH., Unsupervised sentiment analysis with emotional signals, In Proceedings of the 22nd international conference on World Wide Web, 2013, pp. 607–618.
45.
SaifH., FernandezM., HeY. and Alani.H., Senticircles for contextual and conceptual semantic sentiment analysis of twitter, In The Semantic Web: Trends and Challenges, 2014, pp. 83–98.
46.
KeshavarzH. and AbadehM.S., ALGA: Adaptive lexicon learning using genetic algorithm for sentiment analysis of microblogs, Knowledge-Based Systems122 (2017), 1–16.
47.
PandeyA.C., RajpootD.S. and SaraswatM., Twitter sentiment analysis using hybrid cuckoo search method, Information Processing & Management53(4) (2017), 764–779.
48.
RoutJ.K., ChooK.R., DashA.K., BakshiS., JenaS.K. and WilliamsK.L., A model for sentiment and emotion analysis of unstructured social media text, Electronic Commerce Research (2017), 1–19.
49.
Segura-BedmarI., QuirósA. and MartinezP., Exploring Convolutional Neural Networks for Sentiment Analysis of Spanish tweets.
50.
KosalaR. and BlockeelH., Web mining research: A survey, ACM Sigkdd Explorations Newsletter2(1) (2000), 1–15.
51.
MobasherB., DaiH., LuoT., SunY. and ZhuJ., Integrating web usage and content mining for more effective personalization, In International Conference on Electronic Commerce and Web Technologies, SpringerBerlin Heidelberg, pp. 165–176.
52.
KaoH.Y., LinS.H., HoJ.M. and ChenM.S., Mining web informative structures and contents based on entropy analysis, IEEE Transactions on Knowledge and Data Engineering16(1) (2004), 41–55.
53.
LiR., BaoS., YuY., FeiB. and SuZ., Towards effective browsing of large scale social annotations, In Proceedings of the 16th International Conference on World Wide Web, ACM, 2007, pp. 943–952.
54.
SilvaM.J., MartinsB., ChavesM., AfonsoA.P. and CardosoN., Adding geographic scopes to web resources, Computers, Environment and Urban Systems30(4) (2006), 378–399.
55.
DragoniM., TettamanziA.G. and da Costa PereiraC., A fuzzy system for concept-level sentiment analysis, In Semantic Web Evaluation Challenge (2014), 21–27.
56.
LauR.Y.K., LiC. and LiaoS.S.Y., Social analytics: Learning fuzzy product ontologies for aspect-oriented sentiment analysis, Decision Support Systems65 (2014), 80–94.
57.
IndhujaK. and ReghuR.P.C., Fuzzy logic based sentiment analysis of product review documents, Computational Systems and Communications (ICCSC), 2014 First International Conference on IEEE, 2014.
58.
JusohS. and AlfawarehH.M., Applying fuzzy sets for opinion mining, Computer Applications Technology (ICCAT), 2013 International Conference on IEEE, 2013.
59.
RustamovS., MustafayevE. and ClementsM.A., Sentiment analysis using Neuro-Fuzzy and Hidden Markov models of text, Southeastcon, 2013 Proceedings of IEEE, IEEE, 2013.
60.
AndreevskaiaA. and BerglerS., Mining WordNet for a fuzzy sentiment: Sentiment tag extraction from WordNet glosses, EACL6 (2006).
61.
TrungD.N. and JungJ.J., Sentiment analysis based on fuzzy propagation in online social networks: A case study on TweetScope, Computer Science and Information Systems11(1) (2014), 215–228.
62.
FuG. and WangX., Chinese sentence-level sentiment classification based on fuzzy sets, Proceedings of the 23rd International Conference on Computational Linguistics, 2010.
63.
LiuL., NieX. and WangH., Toward a fuzzy domain sentiment ontology tree for sentiment analysis, Image and Signal Processing (CISP), 2012 5th International Congress on IEEE, 2012.
64.
O’ConnorB., BalasubramanyanR., RoutledgeB.R. and SmithN.A., From tweets to polls: Linking text sentiment to public opinion time series, Proceedings of the International AAAI Conference on Weblogs and Social Media, 2010.
65.
BradleyM.M. and LangP.J., Affective Norms for English Words (ANEW) Instruction Manual and Affective Ratings, Technical Report C-1, The Center for Research in Psychophysiology University of Florida, 2009.
66.
MohammadS.M. and TurneyP.D., Crowdsourcing a word–emotion association lexicon, Computational Intelligence29(3) (2013), 436–465.
67.
WilsonT., WiebeJ. and HoffmannP., Recognizing contextual polarity in phraselevel sentiment analysis, in Proceedings of Human Language Technologies Conference/Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP 2005), Vancouver, British Columbia, Canada, 2005, pp. 347–354.
68.
EsuliA. and SebastianiF., Sentiwordnet: A publicly available lexical resource for opinion mining, in Proceedings of the 5th Conference on Language Resources and Evaluation, 2006, pp. 417–422.
69.
BaccianellaS., EsuliA. and SebastianiF., Sentiwordnet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining, in Proceedings of the Seventh International Conference on Language Resources and Evaluation, Valletta, Malta, 2010, pp. 2200–2204.
70.
TaboadaM., BrookeJ., TofiloskiM., VollK. and StedeM., Lexicon-based methods for sentiment analysis, Computational linguistics37(2) (2011), 267–307.
71.
SaifH., FernandezM., HeY. and AlaniH., Evaluation datasets for twitter sentiment analysis: A survey and a new dataset, the STS-Gold, ESSEM@AI*IA, Vol 1096 of CEUR Workshop Proceedings, CEUR-WS.org, 2013, pp. 9–21.
72.
ShammaD.A.,
KennedyL. and ChurchillE.F., Tweet the debates: Understanding community annotation of uncollected sources, In WSM?09: Proceedings of the International Workshop on Workshop on Social,
2009.
73.
RawassizadehR., MomeniE., DobbinsC., GharibshahJ. and PazzaniM., Scalable daily human behavioral pattern mining from multivariate temporal data, IEEE Transactions on Knowledge and Data Engineering28(11) (2016), 3098–3112.
74.
RawassizadehR., MomeniE., DobbinsC., Mirza-BabaeiP. and RahnamounR., Lesson learned from collecting quantified self information via mobile and wearable devices, Journal of Sensor and Actuator Networks4(4) (2015), 315–335.
75.
RawassizadehR., TomitschM., NourizadehM., MomeniE., PeeryA., UlanovaL. and PazzaniM., Energy-efficient integration of continuous context sensing and prediction into smartwatches, Sensors15(9) (2015), 22616–22645.
76.
MomeniE., KalchgruberP., RamsauerD. and RawassizadehR., Leveraging Social Affect for Identifying Individual Mood, Proceedings of SEMANTiCS, Vienna, Austrian, 2015.
77.
SaifH., FernandezM., HeY. and AlaniH., On stopwords, filtering and data sparsity for sentiment analysis of Twitter, In Proceedings of the 9th Language Resources and Evaluation Conference (LREC), 2014, pp. 810–817.
78.
De MaioC.,
FenzaG.,
LoiaV. and ParenteM., Time aware knowledge extraction for microblog summarization on twitter, Information Fusion28 (2016), 60–74.
79.
CuzzocreaA., De MaioC.,
FenzaG.,
LoiaV. and ParenteM., Towards OLAP analysis of multidimensional tweet streams, In Proceedings of the ACM Eighteenth International Workshop on Data Warehousing and OLAP, ACM, 2015, pp. 69–73.
80.
StiloG. and VelardiP., Time makes sense: Event discovery in twitter using temporal similarity, Web Intelligence (WI) and Intelligent Agent Technologies (IAT), 2014 IEEE/WIC/ACM International Joint Conferences on, Vol. 2, IEEE, 2014.
