Automatic classification method of power user’s requirements text based on parallel naive Bayesian algorithm

Abstract

In order to ensure the efficiency of power user’s requirements processing, an automatic classification method for demand test of power users based on parallel naive Bayesian algorithm is proposed. Polynomial naive Bayes is selected to build Hadoop cluster, and the feature words of power user’s requirements are selected through chi square test. The weight of each feature item is calculated by word frequency-inverse text frequency index method, and the weight sum of each category is calculated. The weight sum is input into naive Bayes algorithm to output the text classification results of power user’s requirements. At the same time, The naive Bayes classification algorithm is parallelized and encapsulated to reduce the cost of data movement and exchange in the classification process, and improve the operation efficiency of demand text classification of power user. The experimental results show that this method can accurately extract the feature words of power user’s requirements, effectively realize the automatic classification of power user’s requirements text, and have a more accurate classification effect. The average fitness value of the proposed method tends to be stable after more than 20 training times, and the number of network convergence steps is 7. When the ratio of energy function is about 0.4 and 0.6, the average IU value is the highest. When the required number of texts ranges from 500 to 1500, the delay time of text classification is 0.02 s, and the peak signal-to-noise ratio is more than 33, among which the highest peak signal-to-noise ratio is 42.52, and the normalization coefficient is 1.

Keywords

MapReduce Naive Bayes power user’s requirements automatic text classification parallel processing

Get full access to this article

View all access options for this article.

References

Tandon

, Kiran

and Sah

A.N.

, Customer satisfaction as mediator between website service quality and repurchase intention: an emerging economy case, Operations Research 59(1-2) (2019), 155–156.

Mortaz

and Valenzuela

, Evaluating the impact of renewable generation on transmission expansion planning, Electric Power Systems Research 169(APR.) (2019), 35–44.

Franz, Kaiser, Karen and Alim , Order parameter allows classification of planar graphs based on balanced fixed points in the kuramoto model, Physical Review E 99(5) (2019), 52308–52308.

Lopes

, Agnelo

, Teixeira

C.A.

, Laranjeiro

and Bernardino

, Automating orthogonal defect classification using machine learning algorithms, Future Generation Computer Systems 102(Jan.) (2020), 932–947.

Zhou

, Ma

and Li

, Feature selection based on term frequency deviation rate for text classification, Applied Intelligence 51(1) (2021), 1–20.

Xue

, Wei

and Guo

, A real-time naive bayes classifier accelerator on fpga, IEEE Access PP(99) (2020), 1–1.

Liu

, Zhao

H.H.

, Teng

J.Y.

, Yang

Y.Y.

and Zhu

Z.W.

, Parallel naive bayes algorithm for large-scale chinese text classification based on spark, Journal of Central South University 26(1) (2019), 1–12.

Aridas

K.C.

, Karlos

, Kanas

G.V.

, Fazakis

and Kotsiantis

S.B.

, Uncertainty Based Under-Sampling for Learning Naive Bayes Classifiers Under Imbalanced Data Sets[J], IEEE Access PP(99) (2019), 1–1.

Arvor

, Betbeder

, Daher

, Blossier

and Junior

, Towards user-adaptive remote sensing: knowledge-driven automatic classification of sentinel-2 time series, Remote Sensing of Environment 264(17) (2021), 112615.

10.

Eken

, Menhour

and Koksal

, Doca: a content-based automatic classification system over digital documents, IEEE Access 7(99) (2019), 97996–98004.

11.

Wang

, Xu

and Che

, Power quality disturbance classification based on compressed sensing and deep convolution neural networks, IEEE Access PP(99) (2019), 1–1.

12.

Strack

J.L.

, Carugati

, Orallo

C.M.

, Maestri

S.O.

, Donato

P.G.

and Funes

M.A.

, Three-phase voltage events classification algorithm based on an adaptive threshold, Electric Power Systems Research 172(JUL.) (2019), 167–176.

13.

Lin

, Wang

, Zhao

, Chen

and Huang

, Power quality disturbance feature selection and pattern recognition based on image enhancement techniques, IEEE Access PP(99) (2019), 1–1.

14.

Babakmehr

, Sartipizadeh

and Simes

M.G.

, Compressive informative sparse representation-based power quality events classification, IEEE Transactions on Industrial Informatics 16(2) (2020), 909–921.

15.

, An

, Yan

and Ji

, Incremental attribute reduction method based on chi-square statistics and information entropy, IEEE Access PP(99) (2020), 1–1.

16.

Lopes

, Agnelo

, Teixeira

C.A.

, Laranjeiro

and Bernardino

, Automating orthogonal defect classification using machine learning algorithms, Future Generation Computer Systems 102(Jan.) (2020), 932–947.

17.

, Wu

and Xue

, Transfer naive bayes algorithm with group probabilities, Applied Intelligence 50(1) (2020), 61–73.

18.

Shi

, Zurada

, Karwowski

, Guan

and Cakit

, Batch and data streaming classification models for detecting adverse events and understanding the influencing factors, Engineering Applications of Artificial Intelligence 85(Oct.) (2019), 72–84.

19.

Mohamed

M.R.

, Nasr

A.A.

, Tarrad

I.F.

and Abdulmageed

S.R.

, Exploiting incremental classifiers for the training of an adaptive intrusion detection model, International Journal of Network Security 21(2) (2019), 275–289.

20.

Wei

X.Z.

and Zhao

H.N.

, Research on Multi-source and multi-modal big Data Retrieval Based on Mapreduce [J], Computer Simulation 38(04) (2021), 422–426.