Optimizing resource allocation in 5G networks through enhanced Particle Swarm Optimization leveraging deep deterministic policy gradient techniques

Abstract

The development of telecommunications technologies from 4G to the much-hyped 5G meant that unthinkably high data speeds with ultra-low latencies and a high level of connectivity among numerous devices would be offered. The complex and turbulent nature of 5G networks brings very challenging problems in resource allocation needing newer solutions due to fluctuations in user demands with limited resources. Indeed, the complexities have often rendered conventional resource management methodologies inefficient, hence suboptimality and, by extension, compromised network performance. Particle Swarm Optimization has established itself, emulating the evolutionary social behavior of a particular dynamic system by effectively and quickly setting solutions to a variety of optimization problems within telecommunications industries. Particle Swarm Optimization simulates the balance between flying particles in an intelligent swarm when dozens, hundreds, or thousands of particles’ combined knowledge are used to fly through extreme solution spaces during resource allocation. The most recent state of the art in deep reinforcement learning, Deep Deterministic Policy Gradients (DDPG) presents a solid framework appropriate for the current decision-making in continuous action space environments, notably applicable to the kind of dynamic scenarios present in 5G networks. In this paper a new hybrid approach between PSO and DDPG is proposed, with the objective to increase resource allocation efficiency by bringing in adaptive learning with real-time decisions based on feedback from the environment. Illuminating the awareness of the role DDPG takes in perfecting the process of resource allocation and how PSO enters into resource allocation is an objective of this study, looking forward to drawing examples in which, collectively, techniques might deal with challenging issues that are hounding resource management in the 5G network in terms of energy consumption, resource utility optimization, and strengthening the network by answering the requirements, in the future to come inter-connected.

Keywords

5G networks resource allocation Deep Deterministic Policy Gradients (DDPG)

Get full access to this article

View all access options for this article.

References

Internet of things: Recent advances and applications. June 2013. doi:https://doi.org/10.1109/CSCWD.2013.6580928

Zhou

, et al. Guest Editorial Special Section on Advances and Applications of Internet of Things for Smart Automated Systems. IEEE Trans Autom Sci Eng June 2016. doi:https://doi.org/10.1109/TASE.2016.2579538

Willner

. The industrial internet of things. 2018. doi:https://doi.org/10.1002/9781119456735.CH11

Madueno

, et al. Cellular 5G access for massive internet of things. 2017. doi:https://doi.org/10.1017/9781316771655.018

Ulusar

, et al. An Overview of Internet of Things and Wireless Communications. In: 2017. doi:https://doi.org/10.1109/UBMK.2017.8093446

Iraji

, et al. Recent advances in M2 M communications and internet of things (IoT). Int J Wireless Inf Networks Sept. 2017. doi:https://doi.org/10.1007/S10776-017-0362-3

Yang

, et al. IoT technologies and applications. In: 2020. doi:https://doi.org/10.1007/978-3-030-23185-9_1

Nurhayati

. Integration of IoT and 5G communication. Trans Comput Syst Netw Jan. 2023. doi:https://doi.org/10.1007/978-981-99-0109-8_3

Javaid

. 5G Technologies: Fundamental shift in mobile networking philosophy. Soc Sci Res Netw Nov. 2013. doi:https://doi.org/10.2139/SSRN.2387193

10.

Onwuegbuzie

. 5G: Next generation mobile wireless technology for a fast pacing world. June 2022. doi:https://doi.org/10.56180/jpas.vol1.iss1.57

11.

Madduru

. Artificial intelligence as a service in distributed multi access edge computing on 5g extracting data using Iot and including Ar/vr for real-time reporting. Mar. 2021. doi:https://doi.org/10.17762/ITII.V9I1.220

12.

Zhong

, et al. A multi-user cost-efficient crowd-assisted VR content delivery solution in 5G-and-beyond heterogeneous networks. IEEE Trans Mob Comput Aug. 2023. doi:https://doi.org/10.1109/TMC.2022.3162147

13.

Chih-Lin

, et al. Cloud radio access networks for 5G systems. 2017. doi:https://doi.org/10.1017/9781316771655.003

14.

Zhu

, et al. Three major operating scenarios of 5G: eMBB, mMTC, URLLC. 2022. doi:https://doi.org/10.1016/b978-0-32-385655-3.00006-0

15.

Cologon

. Application of Computer Technology (CT) in 5G communication network. 2023. doi:https://doi.org/10.1007/978-981-99-1157-8_9

16.

Leonard

, et al. 5G applications in heterogeneous network issues and challenges. Sept. 2020. doi:https://doi.org/10.47760/IJCSMC.2020.V09I09.010

17.

Panse

. Analysing the Need for 5G Networks Based on Smartphone Market Penetration. In: International Conference on Speech Technology and Human-Computer Dialogue, 2023. doi:https://doi.org/10.1109/ICCT56969.2023.10075753

18.

Yerra

Tsang-Ling

. Coordinated resource allocations for eMBB and URLLC in 5G Communication Networks. IEEE Trans Veh Technol. doi:https://doi.org/10.1109/TVT.2022.3176018

19.

Tajaldeen

Manaa

. Improving of 5G wireless networks using optimization method. In: 2021 1st Babylon International Conference on Information Technology and Science (BICITS), Babil, Iraq, 2021, pp.139–144. doi: https://doi.org/10.1109/BICITS51482.2021.9509911

20.

Manaa

Shamsi

. Improved MANET routing protocols performance using optimization methods. Int J Eng Technol 2018; 7: 642–648.

21.

Ebrahim

Manaa

. Fog-Based resource allocation hybrid approach using metaheuristic for Mobile networks. In: 2023 6th International Conference on Engineering Technology and its Applications (IICETA), Al-Najaf, Iraq, 2023, pp.408–413. doi: https://doi.org/10.1109/IICETA57613.2023.10351347

22.

Chen

, et al. Coexistence of URLLC and eMBB Services in MIMO-NOMA Systems. IEEE Trans Veh Technol Jan. 2023. doi:https://doi.org/10.1109/TVT.2022.3205658

23.

Agarwal

Togou

Ruffini

, et al. QoE-Driven optimization in 5G O-RAN-enabled HetNets for enhanced video service quality. IEEE Commun Mag 2023; 61: 56–62.

24.

Lubna

Yasar

Jonathan

, et al. Efficient resource allocation using distributed edge computing in D2D based 5G-HCN with network slicing. IEEE Access 2021; 9: 134148–134162.

25.

Hua

. Optimal Allocation Method of 5G Communication System Resources Assisted by Artificial Intelligence Technology. Wirel Commun Mob Comput 2022; 2022: –9.

26.

Yichen

Ziwei

. A fast resource allocation algorithm based on reinforcement learning in edge computing networks considering user cooperation. Electronics (Basel) 2023; 12: 1459–1459.

27.

Sher

Amir

MuhibUr

, et al. Deep learning (DL) based joint resource allocation and RRH association in 5G-multi-tier networks. IEEE Access 2021; 9: 118357–118366.

28.

Yuan

Lei

Jianquan

, et al. Deep reinforcement learning-based joint scheduling of 5G and TSN in industrial networks. Electronics (Basel) 2023; 12: 2686–2686.

29.

Filippo

Cesare

Suri

, et al. Value is king: the MECForge deep reinforcement learning solution for resource management in 5G and beyond. J Netw Syst Manage 2022; 30: 1–35.

30.

Umesh

Sushil Kumar

Santhosh

, et al. Radio resource allocation for 5G network using deep reinforcement learning. Int J Sci Technol Eng 2023; 11: 677–683.

31.

Leela

Rani

Devi

, et al. Innovative resource allocation mechanism for optimizing 5G multi user-massive multiple input multiple output system. Internet Technol Lett 2024. doi: https://doi.org/10.1002/itl2.569

32.

Konstantinos

Chrysostomos-Athanasios

Vasileios

, et al. Optimizing resource allocation in 5G MIMO networks using DUDe techniques. 2024; null: 454–459. doi: https://doi.org/10.1109/csndsp60683.2024.10636538

33.

Chandrasekhar

Poonam

. Optimization of resource allocation in 5G networks: A network slicing approach with hybrid NOMA for enhanced uRLLC and eMBB coexistence. Int J Commun Syst 2024; null. doi: https://doi.org/10.1002/dac.5928

34.

Radhia

Salwa

Aymen

. Resource allocation for secure and efficient communication in 5G networks using a modified crossover genetic algorithm. 2024; null. doi: https://doi.org/10.21203/rs.3.rs-4313596/v1

35.

. Edge server placement for service offloading in internet of things. Secur Commun Netw 2021; 2021: 1–16.

36.

Asghari

Sohrabi

Yaghmaee

. Task scheduling, resource provisioning, and load balancing on scientific workflows using parallel SARSA reinforcement learning agents and genetic algorithm. J Supercomput 2021; 77: 2800–2828.

37.

Singh

Salim

Cha

, et al. Machine learning-based network sub-slicing framework in a sustainable 5g environment. Sustainability 2020; 12: 6250.

38.

Zhang

Dou

Chong

PHJ

, et al. Fuzzy logic-based resource allocation algorithm for V2X communications in 5G cellular networks. IEEE J Sel Areas Commun 2021; 39: 2501–2513.

39.

Sohaib

Onireti

Sambo

, et al. Intelligent resource management for eMBB and URLLC in 5G and beyond wireless networks. IEEE Access 2023; 11: 65205–65221.

40.

Aktar

Anower

Sarkar

MZI

, et al. Energy-efficient hybrid powered cloud radio access network (C-RAN) for 5G. IEEE Access 2023; 11: 3208–3220.

41.

Chen

. Computation offloading and resource allocation based on cell-free radio access network. In: 2022 IEEE 6th Information Technology and Mechatronics Engineering Conference (ITOEC), Vol. 6, 2022, pp.1498–1502: IEEE Access.

42.

Boateng

Ayepah-Mensah

Doe

, et al. Blockchain-enabled resource trading and deep reinforcement learning-based autonomous RAN slicing in 5G. IEEE Trans Netw Serv Manage 2021; 19: 216–227.