SMS spam detection is an important task where spam SMS messages are identified and filtered. As greater numbers of SMS messages are communicated every day, it is very difficult for a user to remember and correlate the newer SMS messages received in context to previously received SMS. SMS threads provide a solution to this problem. In this work the problem of SMS spam detection and thread identification is discussed and a state of the art clustering-based algorithm is presented. The work is planned in two stages. In the first stage the binary classification technique is applied to categorize SMS messages into two categories namely, spam and non-spam SMS; then, in the second stage, SMS clusters are created for non-spam SMS messages using non-negative matrix factorization and K-means clustering techniques. A threading-based similarity feature, that is, time between consecutive communications, is described for the identification of SMS threads, and the impact of the time threshold in thread identification is also analysed experimentally. Performance parameters like accuracy, precision, recall and F-measure are also evaluated. The SMS threads identified in this proposed work can be used in applications like SMS thread summarization, SMS folder classification and other SMS management-related tasks.
RanjbarianBGharibpoorMLariA.Attitude toward SMS advertising and derived behavioral intension, an empirical study using TPB (SEM method). Journal of American Science2012; 8(7): 297–307.
2.
SharaffANagwaniNK.Email thread identification using latent Dirichlet allocation and non-negative matrix factorization based clustering techniques. Journal of Information Science. Epub ahead of print 3 July 2015. DOI: 10.1177/0165551515587854.
3.
NarayanA. The curse of 140 characters: Evaluating the efficacy of SMS spam detection on Android. In: Proceedings of the Third ACM workshop on security and privacy in smart phones and mobile devices, Berlin, 2013, pp. 33–42.
4.
AlmeidaTAHidalgoJMGYamakamiA. Contributions to the study of SMS spam filtering: New collection and results. In: Proceedings of ACM symposium on document engineering (DocEng’11), Mountain View, CA, 2011, pp. 1–4.
5.
AlmeidaTAHidalgoJMGSilvaTP.Towards SMS spam filtering: Results under a new dataset. International Journal of Information Security Science2013; 2(1): 1–18.
6.
YoonJWKimHHuhJH.Hybrid spam filtering for mobile communication. Computers and Security2009; 29(4): 446–459.
7.
UysalAKGunalSErginS. The impact of feature extraction and selection on SMS spam filtering. Electronics and Electrical Engineering2013; 19(5): 67–72.
8.
LiuWWangT.Index-based online text classification for SMS spam filtering. Journal of Computers2010; 5(6): 844–851.
9.
WangQHanXWangX. Studying of classifying junk messages based on the data mining. In: Proceedings of IEEE International Conference on Management and Service Science (MASS’09), Beijing, 2009, pp. 1–4.
10.
NuruzzamanMTLeeCChoiD.Independent and personal SMS spam filtering. In: Proceedings of IEEE 11th international conference on computer and information technology, 2011, pp. 429–435.
11.
UysalAKGunalSErginS. Detection of SMS spam messages on mobile phones. In: Proceedings of 20th IEEE signal processing and communications applications conference (SIU), Mugla, Turkey, 2012, pp. 1–4.
12.
UysalAKGunalSErginS. A novel framework for SMS spam filtering. In: Proceedings of IEEE international symposium on innovations in intelligent systems and applications (INISTA), Trabzon, Turkey, 2012, pp. 1–4.
13.
LiuGYangF. The application of data mining in the classification of spam messages. In: Proceedings of the IEEE International Conference on Computer Science and Information Processing (CSIP 2012), Xian, Shaanxi, China, 2012, pp. 1315–1317.
14.
AndroulidakisIVlachosVPapanikolaouA.Spam goes mobile: Filtering unsolicited SMS traffic. In: Proceedings of IEEE 20th telecommunications forum TELFOR2012, Belgrade, 2012, pp. 1452–1455.
CormackGVHidalgoJMGSánzEP. Spam filtering for short messages, methodology. In: Proceedings of the sixteenth ACM conference on information and knowledge management, Lisbon, 2007, pp. 313–320.
17.
CormackGV.Email spam filtering: A systematic review. Information Retrieval2008; 1(4): 335–455.
18.
DelanySJBuckleyMGreeneD. SMS spam filtering: Methods and data. Expert Systems with Applications2012; 39(10): 9899–9908.
19.
AbdullaSRamadassSAltyebAA. Employing machine learning algorithms to detect unknown scanning and email worms. The International Arab Journal of Information Technology2014; 11(2): 140–148.
20.
YadavKKumaraguruPGoyalA. SMSAssassin: Crowdsourcing driven mobile-based system for SMS spam filtering system. In: Proceedings of the 12th workshop on mobile computing systems and applications, Phoenix, AZ, 2011, pp. 1–6.
21.
JunaidMBFarooqM.Using evolutionary learning classifiers to do MobileSpam (SMS) filtering. In:Proceedings of Genetic and Evolutionary Computing Conference (GECCO), Dublin, 2011, pp. 1795–1802.
22.
HidalgoJMGAlmeidaTAYamakamiA. On the validity of a new SMS spam collection. In: Proceedings of 2012 11th IEEE international conference on machine learning and applications (ICMLA), Boca Raton, FL, 2012, pp. 240–245.
23.
ParimalaRNallaswamyR.A study on analysis of SMS classification using document frequency threshold. International Journal of Information Engineering and Electronic Business2012; 1: 44–50.
24.
TanHGoharianNSherrM. $100,000 Prize jackpot. Call now! Identifying the pertinent features of SMS spam categories and subject descriptors. In: Proceedings of the 35th international ACM SIGIR conference on research and development in information retrieval, Portland, OR, 2012, pp. 1175–1176.
25.
ModupeAOlugbaraOOOjoSO. Investigating topic models for mobile short messaging service communication filtering. In: Proceedings of the world congress on engineering 2013 (WCE 2013), London, 2013, pp. 3–5.
26.
ShenDYangQSunJT. Thread detection in dynamic text message streams. In: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval, Seattle, WSA, 2006, pp. 35–42.
27.
WangLJiaYChenY.Conversation extraction in dynamic text message stream. Journal of Computers2008; 3(10): 86–93.
28.
BalaliAFailiHAsadpourM. A supervised approach for reconstructing thread structure in comments on blogs and online news agencies. ComputacionySistemas2013; 17(2): 207–217.
29.
DehghaniMAsadpourMShakeryA. An evolutionary-based method for reconstructing conversation threads in email corpora. In: Proceedings of the IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM), Istanbul, 2012, pp. 1132–1137; doi: 10.1109/ASONAM.2012.195
30.
JoshiSContractorDNgK. Auto-grouping emails for faster e-discovery. Very Large Databases (VLDB)2011; 4(12): 1284–1294.
31.
AniNBaggaA.Facilitating email thread access by extractive summary generation. In: Proceedings of recent advances in natural language processing (RANLP), Borovets, Bulgaria, 2003.
32.
RambowOShresthaLChenJ.. Summarizing email threads. In: Proceedings of the conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Boston, MA, 2004, pp. 105–108.
33.
WanSMcKeownK. Generating overview summaries of ongoing email thread discussions. In: Proceedings of the international conference on computational linguistics (COLING), Geneva, 2004, pp. 549–555.
34.
WangXXuMZhengN. Email conversations reconstruction based on messages threading for multi-person. In: International workshop on geoscience and remote sensing education technology and training, Vol. 1, 2008, pp. 676–680; doi: 10.1109/ETTandGRS.2008.321.
35.
ZajicDMDorrBJLinJ.Single-document and multi-document summarization techniques for email threads using sentence compression. Information Processing and Management2008; 44: 1600–1610.
36.
DubouePA.Extractive email thread summarization: Can we do better than he said she said? In: Proceedings of the 7th international natural language generation conference (INLG 2012), 2012, pp. 85–89.
37.
KerrB.Thread arcs: An email thread visualization. In: Proceedings of the 9th IEEE symposium on information visualization (InfoVis 2003), Seattle, WA, 2003, pp. 211–218.
38.
DehghaniMShakeryAAsadpourM. A learning approach for email conversation thread reconstruction. Journal of Information Science2013; 39(6): 846–863.
39.
YehJYHarnlyA.Email thread reassembly using similarity matching. In: Proceedings of third conference on email and anti-spam (CEAS 2006), Mountain View, CA, 2006.
40.
FonsecaOFazzionELas-CasasPHB. Neighborhoods and bands: An analysis of the origins of spam. Journal of Internet Services and Applications2015; 6(1): 9.
41.
JohnGHLangleyP.Estimating continuous distributions in bayesian classifiers. In: Proceedings of the 11th conference on uncertainty in artificial intelligence, San Mateo, 1995, pp. 338–345.
42.
MccallumANigamKA. Comparison of event models for naive Bayes text classification. In: Proceedings of the 15th national conference on artificial intelligence (AAAI 1998) workshop on learning for text categorization, Madison, WI, 1998, pp. 41–48.
VapnikV.The nature of statistical learning theory. Berlin: Springer, 1995, pp. 138–167.
45.
BleiDMNgAYJordanMI.Latent Dirichlet allocation. The Journal of Machine Learning Research2003; 3: 993–1022.
46.
LeeDDSeungHS.Learning the parts of objects by non-negative matrix factorization. Nature1999; 401: 788–791.
47.
XuWLiuXGongY. Document clustering based on non-negative matrix factorization. In: Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval, 2003, pp. 267–273.
48.
FeldmanRSangerJ.The text mining handbook: Advanced approaches in analyzing unstructured data. Cambridge: Cambridge University Press, 2007.
49.
HanJKamberM.Data mining: Concepts and technique, 2nd edn.San Francisco, CA: Morgan Kaufmann, 2009.
50.
HartiganJAWongMA.Algorithm AS 136: A K-means clustering algorithm. Journal of the Royal Statistical Society. Series C (Applied Statistics)1979; 28(1): 100–108.
51.
CselleGAlbrechtKWattenhoferR.BuzzTrack: Topic detection and tracking in email. In: Proceedings of international conference on intelligent user interfaces (IUI’07), Honolulu, HI, 2007.
52.
McCallumAK.Mallet: A machine learning for language toolkit, 2002.
53.
WittenIHFrankETriggLE. Weka: Practical machine learning tools and techniques with Java implementations, 1999.
