Sage Journals: Discover world-class research

Abstract

The data collected by the distributed high-speed network has multiple sources. Therefore, in order to realize the rapid integration of multi-source data, this paper designs a rapid data integration method based on the characteristics of the distributed high-speed network. First, we use linear regression analysis to build a distributed perceptual data model, so that network nodes can only transmit the parameter information of the regression model, so as to simplify the data collection. Then, a dead band amplitude limiting nonlinear link is added at the high frequency channel side to filter and assimilate the data. Finally, the data feature vectors are extracted as the training samples of the neural network to obtain the mapping relationship between different feature vectors, and then the decision level data integration is achieved by training the neural network. The experimental results show that this method can accurately collect high-speed network data, and the data collection deviation is always less than 5 μrad; This method has good filtering effect on data and can eliminate the interference of burr signal; The convergence speed of this method is fast, and the data assimilation can be completed within 0.4 s, which is conducive to improving the speed of data integration; With the increase of network size, the average traffic load of this method increases less.

Keywords

Distributed system data acquisition high-speed network multi-source data integration nonlinear filtering heterogeneous assimilation

Get full access to this article

View all access options for this article.

References

Balakrishna,

Thirumaran,

Kumar Solanki and

E.R.

Núñez Valdez, Incremental Hierarchical Clustering driven Automatic Annotations for Unifying IoT Streaming Data, International Journal of Interactive Multimedia and Artificial Intelligence (2020), in press.

Cai,

Chen,

Ai,

Miao,

Lin and

Feng, Feedback convolutional network for intelligent data fusion based on near-infrared collaborative IoT technology, IEEE Transactions on Industrial Informatics 18(2) (2021), 1200–1209. doi:10.1109/TII.2021.3076513.

Chai,

Xu,

Luo and

Li, A multi-source heterogeneous data analytic method for future price fluctuation prediction, Neurocomputing 7(73) (2020), 41–50.

Cheng,

Li,

Tian,

Cheng and

X.Z.

Cheng, A model for integrating heterogeneous sensory data in IoT systems, Computer networks 150(26) (2019), 1–14.

Cheng and

Wang, Heterogeneous database integration simulation based on topic mapping metadata, Computer Simulation 37 (2020), 198–201.

Ht,

Zl and

Zd, Distributed nonlinear Kalman filter with communication protocol, Information Sciences 513 (2020), 270–288. doi:10.1016/j.ins.2019.10.053.

Jia and

Guo, Reliability analysis for complex system with multi-source data integration and multi-level data transmission, Reliability Engineering and System Safety 217 (2022), 1–10.

Kim,

Kwon,

S.Y.

Woo,

W.M.

Kang and

J.H.

Lee, Hardware-based spiking neural network architecture using simplified backpropagation algorithm and homeostasis functionality, Neurocomputing 428(38) (2020), 16–20.

Lee,

Kwon and

Rhu, Understanding the implication of non-volatile memory for large-scale graph neural network training, IEEE Computer Architecture Letters 20(2) (2021), 118–121. doi:10.1109/LCA.2021.3098943.

10.

Li, Community discovery method based on complex network of data fusion based on super network perspective, International Journal of Computer Applications in Technology 61(2) (2019), 54–59.

11.

Ma,

Li and

Guo, Application of data fusion based on deep belief network in air quality monitoring, Procedia Computer Science 183(1) (2019), 254–260.

12.

Z.C.

Ma,

H.F.

Yuan,

Gu,

Y.R.

Liu and

Zhang, Research and implementation of document-relational data query execution technology, Journal of Frontiers of Computer Science & Technology 14(08) (2020), 1315–1326.

13.

Pan,

Liu,

A.K.

Sangaiah and

Khan, Visual attention feature (VAF): A novel strategy for visual tracking based on cloud platform in intelligent surveillance systems, Journal of Parallel and Distributed Computing 120 (2018), 182–194. doi:10.1016/j.jpdc.2018.06.012.

14.

Shuai,

Gaocheng and

Huiyu, A robust parallel object tracking method for illumination variations, Mobile Networks and Applications 24(1) (2019), 5–17. doi:10.1007/s11036-018-1134-8.

15.

Usman,

M.A.

Jan,

Jolfaei,

Xu,

X.J.

He and

Chen, Daac: A distributed and anonymous data collection framework based on multi-level edge computing architecture, IEEE Transactions on Industrial Informatics 16(9) (2019), 6114–6123. doi:10.1109/TII.2019.2952645.

16.

Wei,

Shuai,

Wenjia,

Mohammed,

Shancang and

Dingzhu, Fractal intelligent privacy protection in online social network using attribute-based encryption schemes, IEEE Transactions on Computational Social Systems 5(3) (2018), 736–747. doi:10.1109/TCSS.2018.2855047.

17.

Wei and

Yu, Energy aware and trust based cluster head selection for ad-hoc sensor networks, International Journal of Network Security 20(3) (2018), 496–501.

18.

Xu,

Luo,

Wu,

Dong and

Zhou, Identification and portrait of urban functional zones based on multisource heterogeneous data and ensemble learning, Remote Sensing 13(3) (2021), 373–378. doi:10.3390/rs13030373.

19.

H.Y.

Yun,

He,

Li and

X.H.

Wang, Research on multi-source data integration based on ontology and karma modeling, International Journal of Intelligent Information Technologies 15(2) (2019), 69–87. doi:10.4018/IJIIT.2019040105.

20.

Zhang and

Liu, A real-time distributed cluster storage optimization for massive data in Internet of multimedia things, Multimedia Tools and Applications 78(5) (2019), 5479–5492. doi:10.1007/s11042-018-7006-1.

21.

Z.M.

Zhao, Research on multi-source heterogeneous land data integration and cloud sharing method, Geomatics & Spatial Information Technology 42(11) (2019), 173–176.

22.

Zhu,

Li,

Zhang,

Pang and

Du, Joint feature extraction for multi-source data using similar double-concentrated network, Neurocomputing 3(88) (2021), 45–48. doi:10.1016/j.neucom.2021.05.004.

Design and implementation of a fast integration method for multi-source data in high-speed network

Abstract

Keywords

Get full access to this article

References