Sage Journals: Discover world-class research

Abstract

The current massive data storage and sharing algorithm based on file system and NIOT have not considered the heterogeneous and real-time characteristics of data in distributed and heterogeneous environment, which has the problems of high storage capacity, high time delay of data sharing, and poor security of data. To address this problem, massive data storage and sharing algorithm in distributed heterogeneous environment is proposed in this paper. Hierarchical analysis of distributed heterogeneous environment is carried out. By using the file system, database technology, and hybrid technology, with the heterogeneous and real-time characteristics of massive data in distributed heterogeneous architecture, a three-level storage framework is obtained. Distributed storage algorithm is applied to save massive data. Through HBase-based massive data sharing algorithm in distributed heterogeneous environment, based on data integration mode of data warehouse, massive data sharing is achieved based on blackboard system to reduce data sharing delay. The node encryption unit is used to improve data security. Experimental results show that the proposed algorithm can reduce the occupancy rate of storage capacity, with stable storage speed and low sharing time delay. It can play a good role for data security.

Keywords

Distributed heterogeneous environment massive data storage sharing distributed storage HBase

Get full access to this article

View all access options for this article.

References

Bao

and Shi

, Beamforming design based on energy efficiency analysis in heterogeneous networks, Computer Simulation32(7) (2015), 178–181.

Xie

, Low

K.S.

and Gunawan

, A distributed transmission rate adjustment algorithm in heterogeneous CSMA/CA networks, Sensors15(4) (2015), 7434.

Luo

, Zhang

, Wu

et al., Boafft: Distributed Deduplication for Big Data Storage in the Cloud, IEEE Transactions on Cloud ComputingPP(99) (2015), 1.

Tang

, Liu

, Ammar

et al., An optimized MapReduce workflow scheduling algorithm for heterogeneous computing, Journal of Supercomputing72(6) (2014), 1–21.

Yao

, Cao

and Vasilakos

A.V.

, EDAL: An energy-efficient, delay-aware, and lifetime-balancing data collection protocol for heterogeneous wireless sensor networks, IEEE/ACM Transactions on Networking23(3) (2015), 810–823.

Browne

E.C.

, Franklin

J.P.

, Canagaratna

M.R.

et al., Changes to the chemical composition of soot from heterogeneous oxidation reactions, Journal of Physical A Chemistry119(7) (2015), 1154.

Vasile

M.A.

, Pop

, Tutueanu

R.I.

et al., Resource-aware hybrid scheduling algorithm in heterogeneous distributed computing, Future Generation Computer Systems51(C) (2015), 61–71.

Yang

X.-Q.

, Simulation analysis of parallel and efficient detection method in large database, Computer Simulation33(7) (2016), 392–394.

and Wu

C.Q.

, Performance analysis and optimization of distributed workflows in heterogeneous network environments, IEEE Transactions on Computers65(4) (2016), 1246–1262.

10.

Salehin

, Packman

A.I.

and Paradis

, Hyporheic exchange with heterogeneous streambeds: Laboratory experiments and modelling, Water Resources Research40(11) (2016), 309–316.

11.

Jiang

, Zhou

, Song

et al., An experiment study on fluid heat and mass transfer properties in porous media using MRI, Russian Journal of Physical A Chemistry88(12) (2014), 2214–2219.

12.

Edwards

J.W.

and Orellana

, Increasing selection response by bayesian modeling of heterogeneous environmental variances, Crop Science55(2) (2015), 556.

13.

Nasonov

, Butakov

, Balakhontseva

et al., Hybrid evolutionary workflow scheduling algorithm for dynamic heterogeneous distributed computational environment, Journal of Applied Logic299 (2016), 83–92.

14.

Schlegel

, Stiller

, Bienert

et al., Large-eddy simulation study of the effects on flow of a heterogeneous forest at sub-tree resolution, Boundary-Layer Meteorology154(1) (2015), 27–56.

15.

Soliman

M.S.

, Nosier

S.A.

, Hussein

et al., Mass and heat transfer beavihor of a new heterogeneous stirred tank reactor with serpentine tube baffles, Chemical Engineering Research & Design124 (2017), 211–221.

16.

Massioni

, Distributed control for alpha-heterogeneous dynamically coupled systems, Systems & Control Letters72 (2014), 30–35.

17.

Orellana

, Edwards

and Carriquiry

, Heterogeneous variances in multi-environment yield trials for corn hybrids, Crop Science54(3) (2014), 1048.

18.

Wang

, Li

, Chen

et al., Energy-aware data allocation and task scheduling on heterogeneous multiprocessor systems with time constraints, IEEE Transactions on Emerging Topics in Computing2(2) (2014), 134–148.

19.

Wang

L.-J.

, Text information retrieval algorithm simulation analysis under massive data, Computer Simulation33(4) (2016), 429–432.

20.

Seibert

, Prommer

, Siade

et al., Heat and mass transport during a groundwater replenishment trial in a highly heterogeneous aquifer, Water Resources Research50(12) (2015), 9463–9483.

21.

Gao

, Wang

and Shi

, The first multiplication atom-bond connectivity index of molecular structures in drugs, Saudi Pharmaceutical Journal25(4) (2017), 548–555.

22.

Khalaf

and Al-Zamel

, Occurrence of recent dedolomite crust on pedogenic calcrete in Al-Jabal Al-Akhdar, Northern Oman, Kuwait Journal of Science45(1) (2018), 128–137.

23.

, Gu

and Ye

, Synergy evaluation of industry-university-research institute synergetic innovation system based on knowledge creation, Journal of Discrete Mathematical Sciences and Cryptography20(1) (2017), 361–376.

24.

Luo

and Jiang

, A simple method for monitoring sleeping conditions by all-night breath sound measurement, Journal of Interdisciplinary Mathematics20(1) (2017), 307–317.

25.

and Qiao

, Performance of Financial Expenditure in China’s basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, Eurasia Journal of Mathematics Science and Technology Education13(8) (2017), 5217–5224.

26.

Imran

, Raffoul

, Usman

and Zhang

, A study of bifurcation parameters in travelling wave solutions of a damped forced korteweg de vries-kuramoto sivashinsky type equation, Discrete and Continuous Dynamical Systems-Series S11(4SI) (2018), 691–705.

27.

Lokesha

, Deepika

, Ranjini

P.S.

and Cangul

I.N.

, Operations of nanostructures via SDD, ABC4 and GA5 indices, Applied Mathematics and Nonlinear Sciences2 (2017), 173–180.

28.

Youssef

I.K.

and El Dewaik

M.H.

, Solving poissons equations with fractional order using haarwavelet, Applied Mathematics and Nonlinear Sciences2 (2017), 271–284.

Massive data storage and sharing algorithm in distributed heterogeneous environment

Abstract

Keywords

Get full access to this article

References