This paper proposes a novel question representation framework to assist automated question answering through reusing accumulated question–answer data. The framework, named QSem, defines three types of question words – question-target words, user-oriented words and irrelevant words, along with semantic patterns, for representing a question. The question word types are semantically labelled by a pre-defined ontology to enrich the semantic representation of questions. The semantic patterns through equivalent pattern linking enhance normal structure matching aiming at improving question matching performance. We trained QSem on 400 randomly selected questions with semantic patterns and obtained optimized parameters. After that, 5000 questions from our system were tested and the precision of question matching was between 0.71 and 0.93 with respect to various generators, indicating the stability of the approach. We further compared our approach with Cosine similarity, WordNet-based semantic similarity and IBM translation model on a standard TREC dataset containing 5536 questions. The results presented that our approach achieved best performance with mean reciprocal rank increased by 7.2% and accuracy increased by 7.5% on average, demonstrating the effectiveness of the approach.
LiuWYHaoTYChenWFengM. A web-based platform for user-interactive question-answering, World Wide Web2009; 12(2): 107–124.
2.
HaoTYXuFFLeiJSLiuWYLiQ. Toward automatic answers in user-interactive question answering systems. International Journal of Software Science and Computational Intelligence2011; 3(4): 52–66.
3.
LiuYBianJAgichteinE. Predicting information seeker satisfaction in community question answering. In: Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval, 2008, pp. 483–490.
4.
SeoJWCroft WBSmithDA. Online community search using conversational structures. Information Retrieval2011; 14(6): 547–571.
5.
AgichteinE. Finding high-quality content in social media. In: Proceedings of the 2008 international conference on web search and data mining, 2008.
6.
HaoTYAgichteinE. Finding similar questions in collaborative question answering archives: Toward bootstrapping-based equivalent pattern learning. Information Retrieval2012; 15(3–4): 332–353.
7.
VoorheesE. The TREC-8 question answering track report. In: The eighth text retrieval conference TREC 8. National Institute of Standards and Technology, Special Publication, 1999, pp. 743–751.
8.
WuCHYehJFChenMJ. Domain-specific FAQ retrieval using independent aspects. ACM Transactions on Asian Language Information Processing2005; 4(1): 1–17.
9.
HammondKBrukeRMartinCLytinenS. FAQ-Finder: A case based approach to knowledge navigation. In: Working notes of the AAAI spring symposium on information gathering from heterogeneous distributed environments. Palo Alto, CA: AAAI, 1995.
10.
BurkeRDHammondKKulyukinVLytinenS LTomuroNSchoenbergS. Question answering from frequently-asked-question files: experiences with the FAQ finder system, Technique Report TR-97-05, University of Chicago, Chicago, IL, 1997.
11.
WhiteheadSD. Auto-FAQ: An experiment in cyberspace leveraging. Journal of Computer Networks and ISDN Systems1995; 28: 137–146.
12.
TomuroN. Question terminology and representation for question type classification. In: Proceedings of the 2nd international workshop on computational terminology (COMPUTERM02), Taipei, 2002.
13.
LenzMHbnerAKunzeM. Question answering with textual CBR. In: Proceedings of the international conference on flexible query answering systems, Denmark, 1998, pp. 236–247.
14.
SneidersE. Automated question answering using question templates that cover the conceptual model of the database, natural language processing and information systems. In: Proceedings of the NLDB’2002, Sweden, 2002.
15.
BergerACaruanaRCohnDFreitagDMittalV. Bridging the lexical chasm: Statistical approaches to answer-finding. In: Proceedings of ACM SIGIR conference. New York: ACM, 2000, pp. 192–199.
16.
JeonJCroftWBLeeJH. Finding similar questions in large question and answer archives. In: Proceedings of the 14th ACM international conference on information and knowledge management, 2005, pp. 84–90.
17.
XueXJeonJCroftWB. Retrieval models for question and answer archives. In: Proceedings of SIGIR, 2008, pp. 475–482.
18.
WangKMingZChuaT-S. A syntactic tree matching approach to finding similar questions in community-based qa services. In: Proceedings of SIGIR, 2009, pp. 187–194
19.
CaoXCongGCuiBJensenCS. A generalized framework of exploring category information for question retrieval in community question answer archives. In: Proceedings of the 19th international conference on World Wide Web, 2010, pp. 201–210.
20.
ZhangKWuWWuHLiZZhouM. Question retrieval with high quality answers in community question answering. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, 2014, pp. 371–380.
21.
ZhangWNLiuTYangYCaoLZhangYJiR. A topic clustering approach to finding similar questions from large question and answer archives. PloS One2014; 9(3): e71511.
22.
CuiHSunRLiKKanMYChuaTS. Question answering passage retrieval using dependency relations. In: Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval, 2005, pp. 400–407.
23.
GaoYWangMZhaZJShenJLiXWuX. Visual-textual joint relevance learning for tag-based social image search. IEEE Transactions on Image Processing2013; 22(1): 363–376.
24.
LiHXuJ. Semantic matching in search. Foundations and Trends in Information Retrieval2014; 7(5): 343–469.
25.
TobaHMingZYAdrianiMChuaTS. Discovering high quality answers in community question answering archives using a hierarchy of classifiers. Information Sciences2014; 261: 101–115.
26.
WuYZHoriCKashiokaHKawaiH. Leveraging social Q&A collections for improving complex question answering. Computer Speech and Language2015; 29(1): 1–19.
27.
HaoTYHuDWLiuWYZengQT. Semantic patterns for user-interactive question answering. Concurrency and Computation-practice and Experience2008; 20(7): 783–799.
RavichandranDHovyE. Learning surface text patterns for a question answering system. In: Proceedings of the 40th annual meeting of the Association for Computational Linguistics (ACL), 2002, pp. 41–47.
30.
MusleaI. Extraction patterns for information extraction tasks: A survey. In: The AAAI-99 workshop on machine learning for information extraction, Vol. 2, no. 2, 1999.
31.
Saiz-NoedaMSuárezAArezASPalomarM. Semantic pattern learning through maximum entropy-based WSD technique. In: Proceedings of 5th workshop on computational language learning, Toulouse, 2001, pp. 23–29.
32.
HaoTYSongWPLiuWY. Automatic generation of semantic patterns for user-interactive question answering. In: Proceedings of Asia information retrieval symposium, Harbin. Lecture Notes in Computer Science, Vol. 4993. Berlin: Springer, 2008, pp. 632–637.
33.
LiXRothD. Learning question classifiers. In: Proceedings of the 19th international conference on computational linguistics, 2002, Vol. 1, pp. 1–7.
34.
HaoTYNiXLQuanXJLiuWY. Automatic construction of semantic dictionary for question categorization. Journal of Systemics, Cybernetics and Informatics2009; 7(6): 86–90.
35.
Protégé: A free, open-source ontology editor and framework for building intelligent systems, http://protege.stanford.edu/ (accessed 2014).
36.
LiXRothD. Learning question classifiers: the role of semantic information. Natural Language Engineering2006; 12(3): 229–249.
37.
KimSKimY. A fast multiple string pattern matching algorithm. In: Proceedings of 17th AoM/IAoM conference on computer science, 1999, pp. 44–49.
38.
SalmelaLTarhioJKytöjokiJ. Multipattern string matching with q-grams. Journal of Experimental Algorithmics2007; 11: 1–1.
39.
ManningCDRaghavanPSchützeH. Introduction to information retrieval. Cambridge: Cambridge University Press, 2008.
40.
SinghalA. Modern information retrieval: A brief overview. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering2001; 24 (4): 35–43.
