A classification and regression algorithm based on quantitative association rule tree

Abstract

Although the association classification approach based on frequent patterns has been recently presented, the majority of the methods proposed so far do not deal with the quantitative data directly, and also do not consider the problem of exploring these rules to predict the future behavior of certain variables based on some other known variables. In light of these issues, a new algorithm based on quantitative association rules tree(CRQAR-tree) that synergizes association classification and rule-based TS fuzzy inference is developed to generate the rule tree structure and realize the classification and regression prediction. The classification and regression quantitative association rules are built on the improved Apriori algorithm which offered an efficient way for frequent itemsets learning. To manage the model complexity without sacrificing its predictive accuracy, CRQAR-tree can effectively match the rules to predict new samples that have little contribution over time. The proposed approach is applied to UCI benchmark datasets and a real application, the simulation results show that the performance of the CRQAR-tree is better than other methods, so it is a promising classification and regression algorithm.

Keywords

Quantitative association rule tree classification TS fuzzy inference regression

Get full access to this article

View all access options for this article.

References

Cherkassky

and Mulier

, Learning from Data: Concepts, Theory, and Methods [M]// Learning from Data: Concepts, Theory, and Methods, Wiley-IEEE Press, 1998, pp. 105–106.

Liu

, Hsu

and Ma

, Integrating Classification and Association Rule Mining [J], Proc of Kdd, 2010), 80–86.

, Han

and Pei

, CMAR: Accurate and efficient classification based on multiple class-association rules, in Proc IEEE Int Conf Data Mining (2001), San Jose, CA, 28, 369–376.

Yin

and Han

, CPAR: Classification based on predictive association rules, in Proc 3rd SIAM Int Conf Data Mining, 2003, San Francisco, CA, pp. 331–335.

Antonelli

, Ducange

, Lazzerini

and Marcelloni

, Multi-objective evolutionary design of granular rule-based classifiers, Granular Computing1(1) (2016), 37–58.

Ling

Wang

, Lu Lu

and MEi

Fu Dong

., A density-based fuzzy adaptive clustering algorithm, Journal of University of Science and Technology Beijing36(11) (2014), 1560–1565.

Han

, Pei

, Yin

and Mao

, Mining frequent patterns without candidate generation: A frequent-pattern tree approach, Data Mining Knowl Discov8(1) (2004), 53–87.

Agrawal

and Srikant

, Fast algorithms for mining association rules, 20[J], Proc Int Conf Very Large Databases Vldb23(3) (1994), 21–30.

Zeng

, He

and Shi

, Parallel implementation of apriori algorithm based on mapreduce, In Proc Of SNPD, 2012, pp. 236–241.

10.

Srikant

and Agrawal

, Mining quantitative association rules in large relational tables [J], Acm Sigmod Record25 (1996), 1–12.

11.

Zhang

, Sun

and Wu

, Research on the Fuzzy Quantitative Association Rules Mining Algorithm and Its Simulation[C]// Fuzzy Systems and Knowledge Discovery, Fourth International Conference on IEEE Computer Society120 (2007), 973–982.

12.

Blake

C.L.

and Merz

C.J.

, UCI Repository of machine learning databases, Glass + Identification. Irvine, CA: University of California, Department of Information and Computer Science, 1998. http://archive.ics.uci.edu/ml/datasets/.

13.

Hall , Mark , Frank , et al., The WEKA data mining software: An update[J], Acm Sigkdd Explorations Newsletter11(1) (2009), 10–18.

14.

Smola

A.J.

and Schölkopf

, A tutorial on support vector regression [J], Statistics & Computing14(3) (2004), 199–222.

15.

Tsekouras

G.E.

and Tsimikas

, On training RBF neural networks using input–output fuzzy clustering and particle swarm optimization [J], Fuzzy Sets & Systems221(5) (2013), 65–89.

16.

Huang

G.B.

, Zhu

Q.Y.

and Siew

C.K.

, Extreme learning machine: Theory and applications, Neurocomputing 70[J], Neurocomputing70 (2006), 489–501.

17.

Bishop

C.M.

, Neural Networks for Pattern Recognition, Oxford University Press Inc., New York, NY, 1995.

18.

Quinlan

J.R.

, C4.5: Programs for machine learning [M]//, Morgan Kaufmann Publishers Inc., 1993.

19.

Aha

D.W.

, Kibler

and Albert

M.K.

, Instance-based learning algorithms, [J], Machine Learning6(1) (1991), 37–66.

20.

Demsar

, Statistical comparisons of classifiers over multiple data sets [J], Journal of Machine Learning Research7(1) (2006), 1–30.

21.

Chinese Metals of Hot-Rolled Plate and Strip Academic Committee. Chinese Hot-Rolled Wide Strip Rolling Mill and Production Technology, Beijing: Metallurgical Industry Press, 2002, (in Chinese).

22.

Xie

, Wang

, Li

, et al., Research and Application on Improved Bp Neural Network Algorithm [J], Industrial Electronics & Applications E IEEE Conference on, 2010, pp. 1462–1466.

23.

Zhao

and Sun

J.A.

, Fast method to approximately train hard support vector regression [J], Neural Networks the Official Journal of the International Neural Network Society23(10) (2010), 1276–1285.

24.

Rutkowski

, Jaworski

, Pietruczuk

, et al., The CART decision tree for mining data streams [J], Information Sciences266(5) (2014), 1–15.

25.

Abdulshahed

A.M.

, Longstaff

A.P.

and Fletcher

, The application of ANFIS prediction models for thermal error compensation on CNC machine tools [J], Applied Soft Computing (2015), 158–168.