In this paper we propose a fully unsupervised approach for product aspect discovery in on-line consumer reviews. We apply a two-step hierarchical clustering process in which we first cluster words representing aspects based on the semantic similarity of their contexts and then on the similarity of the hypernyms of the cluster members. Our approach also includes a method for assigning class labels to each of the clusters. We evaluated our methods on large datasets of restaurant and camera reviews and found that the two-step clustering process performed better than a single-step clustering process at identifying aspects and words refering to aspects. Finally, we compare our method to a state-of-the-art topic modelling approach by Titov and McDonald, and demonstrate better results on both datasets.
TitovIMcDonaldR. Modeling online reviews with multi-grain topic models. In: Proceedings of the 17th international conference on the World Wide Web. New York: ACM, 2008, pp. 111–120.
2.
SnyderBBarzilayR. Multiple aspect ranking using the good grief algorithm. In: Proceedings of the human language technology conference of the North American Chapter of the Association of Computational Linguistic, 2007, pp. 300–307.
3.
LinD. Automatic retrieval and clustering of similar words. In: Proceedings of the 36th annual meeting of the Association for Computational Linguistics and 17th international conference on Computational Linguistics, Vol. 2. Stroudsburg, PA: Association for Computational Linguistics, 1998, pp. 768–774.
4.
PantelPLinD. Discovering word senses from text. In: Proceedings of the eighth ACM SIGKDD international conference on knowledge discovery and data mining. New York: ACM, 2002, pp. 613–619.
5.
JinWHoHH. A novel lexicalized HMM-based learning framework for web opinion mining. In: Proceedings of the 26th annual international conference on machine learning. New York: ACM, 2009, pp. 465–472
6.
LiFHanCHuangMZhuXXiaY-JZhangSYuH. Structure-aware review mining and summarization. In: Proceedings of the 23rd international conference on computational linguistics. Stroudsburg, PA: Association for Computational Linguistics, 2010, pp. 653–661.
7.
BorthwickAE. A maximum entropy approach to named entity recognition. PhD thesis, New York, 1999, AAI9945252.
8.
Blair-GoldensohnSNeylonTHannanKReisGAMcDonaldRReynarJ. Building a sentiment summarizer for local service reviews. In: Proceedings of WWW-2008 workshop on NLP in the information explosion era, 2008.
9.
YuJZhaZ-JWangMChuaT-S. Aspect ranking: Identifying important product aspects from online consumer reviews. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: Human language technologies, Vol. 1. Stroudsburg, PA: Association for Computational Linguistics, 2011, pp. 1496–1505.
10.
HuMLiuB. Mining and summarizing customer reviews. In: Proceedings of the 10th ACM SIGKDD international conference on knowledge discovery and data mining. New York: ACM, 2004, pp. 168–177.
11.
PopescuA-MEtzioniO. Extracting product features and opinions from reviews. In: Proceedings of the conference on human language technology and empirical methods in natural language processing. Stroudsburg, PA: Association for Computational Linguistics, 2005, pp. 339–346.
12.
RajuSPingaliPVarmaV. An unsupervised approach to product attribute extraction. In: Proceedings of the 31th European conference on IR research on advances in information retrieval. Berlin: Springer, 2009, pp.796–800.
13.
BrodySElhadadN. An unsupervised aspect-sentiment model for online reviews. In: Human language technologies: The 2010 annual conference of the North American Chapter of the Association for Computational Linguistic. Stroudsburg, PA: Association for Computational Linguistics, 2010, pp.804–812.
14.
LinDPantelP. Induction of semantic classes from natural language text. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining. New York: ACM, 2001, pp. 317–322.
15.
CaraballoSA. Automatic construction of a hypernym-labeled noun hierarchy from text. In: Proceedings of the 37th annual meeting of the Association for Computational Linguistics on computational linguistics. Stroudsburg, PA: Association for Computational Linguistics, 1999, pp.120–126.
16.
CimianoPStaabS. Learning concept hierarchies from text with a guided agglomerative clustering algorithm. In: Proceedings of the workshop on learning and extending lexical ontologies with machine learning methods. 2005, pp. 6–15.
HearstMA. Automatic acquisition of hyponyms from large text corpora. In: Proceedings of the 14th conference on computational linguistics, Vol. 2. Stroudsburg, PA: Association for Computational Linguistics, 1992, pp.539–545.
19.
MillerGABeckwithRFellbaumCGrossDMillerK. Wordnet: An on-line lexical database. International Journal of Lexicography1990; 3: 235–244.
20.
De MarneffeMCMacCartneyBManningCD. Generating typed dependency parses from phrase structure trees. In: International conference on language resources and evaluation, 5th edn, 2006.
21.
NivreJ. Dependency grammar and dependency parsing. Technical Report MSI 05133, VäxjöUniversity, School of Mathematics and Systems Engineering, 2005.
22.
WuYZhangQHuangXWuL. Phrase dependency parsing for opinion mining. In: Proceedings of the 2009 conference on empirical methods in natural language processing, Vol. 3. Stroudsburg, PA: Association for Computational Linguistics, 2009, pp. 1533–1541.
23.
VechtomovaORobertsonSE. A domain-independent approach to finding related entities. Information Processing and Management2012; 48(4): 654–670.
24.
PunyakanokYRothD. The use of classifiers in sequential inference. In: Neural information processing systems. Cambridge, MA: MIT Press, 2001, pp. 995–1001.
25.
VechtomovaO. A method for automatic extraction of multiword units representing business aspects from user reviews. Journal of the American Society for Information Science and Technology2014; 65(7): 1463–1477.
26.
AhmadiMH. A semi supervised approach to the construction of semantic lexicons. MMath thesis, University of Waterloo, 2012.
27.
WiebeJWilsonTCardieC. Annotating expressions of opinions and emotions in language. Language Resources and Evaluation2005; 39(2–3): 165–210.
28.
JindalNLiuB. Review spam detection. In: Proceedings of the 16th international conference on the World Wide Web, 2007, pp. 1189–1190.
29.
YuJZhaZJWangMChuaTS. Aspect ranking: Identifying important product aspects from online consumer reviews. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: Human language technologies, Portland, OR, Vol. 1. Stroudsburg, PA: Association for Computational Linguistics, 2011, pp. 1496–1505.
30.
SteinbachMKarypisGKumarV. A comparison of document clustering techniques. In Proceedings of the sixth ACM SIGKDD international conference on knowledge discovery and data mining Workshop on Text Mining. New York: ACM, 2000.
