This paper provides an extensive overview of recent advancements in Multi-Agent Systems, focusing on three principal areas: cooperative observation, cooperative control, and collaborative decision-making. First, the cooperative observation is highlighted for its utilization of distributed sensing and state estimation techniques, enabling agents to collectively perceive their surroundings with improved accuracy and resilience. Then, the cooperative control is emphasized for the significance of distributed algorithms and consensus protocols, which facilitate synchronized behaviours and system stability under dynamic and uncertain conditions. Next, the collaborative decision-making is discussed as an integration of cognitive models and adaptive strategies, empowering agents to make informed, real-time decisions as a group. By scrutinizing these aspects, the cognitive models like the Observe-Orient-Decide-Act (OODA) loop are used for a dynamic and adaptive decision-making in MAS. Two key aspects are discussed: 1) how the amalgamation of these techniques amplifies the performance, adaptability, and robustness of MAS in diverse applications such as robotics, cyber-physical systems, and intelligent transportation systems has been discussed, and 2) how the centrality of agent coordination and cooperation facilitates the evolution of MAS. Overall, the document emphasizes the importance of integrating cooperative observation, control, and decision-making for optimized MAS operation and identifies future research avenues that include refining these techniques and exploring their potential in emerging application domains.
LiBYangLXiaoJ, et al.Collaborative mapping and autonomous parking for multi-story parking garage. IEEE trans Intell Transp Syst2018; 19: 1629–1639.
2.
NamCShellDA. Assignment algorithms for modeling resource contention in multirobot task allocation. IEEE Trans Autom Sci Eng2015; 12: 889–900.
3.
JinXDuWHeW, et al.Twisting-based finite-time consensus for euler-lagrange systems with an event-triggered strategy. IEEE Trans Netw Sci Eng2020; 7: 1007–1018.
4.
DaiYZhangLYanK, et al.An integrated cooperative control strategy for EVs accessed community uninterruptible power system. IEEE Trans Intell Vehic2023; 8: 2482–2493.
5.
LiCXuLJinC, et al.GraphPS: graph pair sequences–based noisy–robust multi–hop collaborative perception. IEEE Trans Intell Vehic2024; 9: 3895–3905.
6.
NamCShellDA. Robots in the huddle: upfront computation to reduce global communication at run time in multirobot task allocation. IEEE Trans Robot2020; 36: 125–141.
7.
YuanCStegagnoPHeH, et al.Cooperative adaptive containment control with parameter convergence via Cooperative finite-time excitation. IEEE Trans Automat Contr2021; 66: 5612–5618.
8.
CattivelliFSayedAH. Diffusion strategies for distributed kalman filtering and smoothing. IEEE Trans Automat Contr2010; 55: 2069–2084.
9.
CattivelliFSSayedAH. Diffusion strategies for distributed kalman filtering and smoothing. IEEE Trans Automat Contr2010; 55: 2069–2084.
10.
LiuDHuangBZhuH. Solving the tree-structured task allocation problem via group multirole assignment. IEEE Trans Autom Sci Eng2020; 17: 41–55.
11.
LiuDDouLZhangR, et al.Multi-agent reinforcement learning-based coordinated dynamic task allocation for heterogenous UAVs. IEEE Trans Vehic Technol2023; 72: 4372–4383.
12.
ViegasDBatistaPOliveiraP, et al.Distributed state estimation for linear multi-agent systems with time-varying measurement topology. Automatica2015; 54: 72–79.
13.
ChenGSongY-D. Cooperative tracking control of nonlinear multiagent systems using self-structuring neural networks. IEEE Trans Neural Netw Learn Syst2014; 25: 1496–1507.
14.
HeGCuiSDaiY, et al.Learning task–oriented channel allocation for multi–agent communication. IEEE Trans Vehic Technol2022; 71: 12016–12029.
15.
NotomistaG, et al.A resilient and energy-aware task allocation framework for heterogeneous multirobot systems. IEEE Trans Robot2022; 38: 159–179.
16.
SayyaadiHMoarrefM. A distributed algorithm for proportional task allocation in networks of mobile agents. IEEE Trans Automat Contr2011; 56: 405–410.
17.
GabrielJDeutscherJ. Robust cooperative output regulation for networks of hyperbolic PIDE–ODE systems. IEEE Trans Automat Contr2024; 69: 888–903.
18.
MaJYuXLiuL, et al.Global cooperative output regulation of linear multiagent systems with limited bandwidth. IEEE Trans Control Netw Syst2022; 9: 1017–1028.
19.
TurnerJMengQSchaeferG, et al.Distributed task rescheduling with time constraints for the optimization of total task allocations in a multirobot system. IEEE Trans Cybern2018; 48: 2583–2597.
20.
XuJCaiYLiuD, et al.Model-free formation control: Multi-input iterative learning super-twisting approach. IEEE Trans Syst Man Cyber: Syst2024; 54: 2765–2774.
21.
XuJNiuYShiP. Adaptive multi–input super twisting control for a quadrotor: Singular perturbation approach. IEEE Trans Indust Elect2024; 71: 5195–5204.
22.
XuJNiuYZouY. Finite-time consensus for singularity perturbed multi-agent system via memory output-feedback sliding mode control. IEEE Trans Cybern2022; 52: 8692–8702.
23.
XuJNiuYLamHK. Adaptive distributed attitude consensus of a heterogeneous multi-agent quadrotor system: singular perturbation approach. IEEE Trans Aerosp Electron Syst2023; 59: 9722–9732.
24.
XuJTangYShiY, et al.Event–triggered formation control for a class of uncertain euler–lagrange systems: theory and experiment. IEEE Trans Control Syst Technol2022; 30: 336–343.
25.
ZhaoJLiXYuX, et al.Finite-time cooperative control for bearing-defined leader-following formation of multiple double-integrators. IEEE Trans Cybern2022; 52: 13363–13372.
MovricKHLewisFL. Cooperative optimal control for multi-agent systems on directed graph topologies. IEEE Trans Automat Contr2014; 59: 769–774.
28.
LinKGaoJLiY, et al.Multi–granularity collaborative decision with cognitive networking in intelligent transportation systems. IEEE trans Intell Transp Syst2023; 24: 1088–1098.
29.
Brinon-ArranzLSeuretACanudas-de-WitC. Cooperative control design for time–varying formations of multi–agent systems. IEEE Trans Automat Contr2014; 59: 2283–2288.
30.
Brinon-ArranzLSeuretACanudas-de-WitC. Cooperative control design for time-varying formations of multi-agent systems. IEEE Trans Cybern2014; 59: 2283–2288.
31.
JinLLiSLaHM, et al.Dynamic task allocation in multi-robot coordination for moving target tracking: a distributed approach. Automatica2019; 100: 75–81.
32.
LuoLChakrabortyNSycaraK. Provably-good distributed algorithm for constrained multi-robot task assignment for grouped tasks. IEEE Trans Robot2015; 31: 19–30.
33.
WangLMorseAS. A distributed observer for a time-invariant linear system. In Proceedings of american control conference, 2017, 2020–2025, Seattle, USA.
34.
BürgerMNotarstefanoGBulloF, et al.A distributed simplex algorithm for degenerate linear programs and multi-agent assignments. Automatica2012; 48: 2298–2304.
35.
NiuMChengBFengY, et al.GMTA: a geo-aware multi-agent task allocation approach for scientific workflows in container-based cloud. IEEE Trans Netw Serv Manage2020; 17: 1568–1581.
36.
RamicicMBonariniA. Selective perception as a mechanism to adapt agents to the environment: an evolutionary approach. IEEE Trans Cognit Dev Syst2020; 12: 64–72.
37.
GePDouXQuanX, et al.Extended-state-observer-based distributed robust secondary voltage and frequency control for an autonomous microgrid. IEEE Trans Sustain Energy2020; 11: 195–205.
38.
ShiPShenQ. Cooperative control of multi-agent systems with unknown state-dependent controlling effects. IEEE Trans Autom Sci Eng2015; 12: 827–834.
39.
ShenQShiPShiY. Distributed adaptive fuzzy control for nonlinear multiagent systems via sliding mode observers. IEEE Trans Cybern2015; 46: 3086–3097.
40.
IervolinoRManfrediS. Global stability of multi-agent systems with heterogeneous transmission and perception functions. Automatica2024; 162: 111510.
41.
LiuR, et al.ROS-based collaborative driving framework in autonomous vehicular networks. IEEE Trans Vehic Technol2023; 72: 6987–6999.
42.
GaoSXuCDongH. Deterministic reinforcement learning consensus control of nonlinear multi-agent systems via autonomous convergence perception. IEEE Trans Circu Syst II2024; 71: 2229–2233.
43.
LuoWLuPDuC, et al.Cooperative output tracking control of heterogeneous multi-agent systems with random communication constraints: An observer-based predictive control approach. IEEE Trans Circ Syst II2022; 69: 1139–1143.
44.
WangWanyuanJiangYichuan. Community-aware task allocation for social networked multiagent systems. IEEE Trans Cybern2014; 44: 1529–1543.
45.
JinXShiYTangY, et al.Event-triggered fixed-time attitude consensus with fixed and switching topologies. IEEE Trans Automat Contr2022; 67: 4138–4145.
46.
JiangYZhouYWangW. Task allocation for undependable multiagent systems in social networks. IEEE Trans Parallel Distrib Syst2013; 24: 1671–1681.
47.
LiY, et al.Task placement and resource allocation for edge machine learning: a GNN-based multi-agent reinforcement learning paradigm. IEEE Trans Parallel Distrib Syst2023; 34: 3073–3089.
48.
SuY. Cooperative global output regulation of second-order nonlinear multi-agent systems with unknown control direction. IEEE Trans Automat Contr2015; 60: 3275–3280.
49.
TangY, et al.Perception and navigation in autonomous systems in the era of learning: a survey. IEEE Trans Neural Netw Learn Syst2023; 34: 9604–9624.
50.
TangYJinXShiY. Event-triggered attitude synchronization of multiple rigid body systems with velocity-free measurements. Automatica2022; 143: 110460.
51.
ZhaoYDuanZWenG, et al.Distributed finite-time tracking control for multi-agent systems: an observer-based approach. Syst Control Lett2013; 62: 22–28.
52.
SuYoufengHuangJie. Cooperative output regulation of linear multi-agent systems. IEEE Trans Automat Contr2012; 57: 1062–1066.
53.
NowzariCGarciaECortusJ. Event-triggered communication and control of networked systems for multi-agent consensus. Automatica2019; 105: 1–27.
54.
TangYGaoHZhangW. Leader-following consensus of a class of stochastic delayed multi-agent systems with partial mixed impulses. Automatica2015; 53: 346–354.
55.
BatistaPSilvestreCOliveiraP. Position and velocity optimal sensor based navigation filters for UAVs. In: Proceedings of the 2009 American control conference, Saint Louis, USA, June, 2009, pp. 5404–5409.
56.
BenderJG. An overview of systems studies of automated highway systems. IEEE Trans Vehic Technol1991; 40: 82–99.
57.
FanCHuJHuangJ. Few-shot multi-agent perception with ranking-based feature learning. IEEE Trans Pattern Anal Mach Intell2023; 45: 11810–11823.
58.
LedererAYangZJiaoJ, et al.Cooperative control of uncertain multiagent systems via distributed Gaussian processes. IEEE Trans Automat Contr2022; 68: 3091–3098.
59.
TangYXingXKarimiHR. Tracking control of networked multi-agent systems under new characterizations of impulses and its applications in robotic systems. IEEE Trans Indust Electron2016; 63: 1299–1307.
60.
SamieiASunL. Distributed matching–by–Clone hungarian-based algorithm for task allocation of multiagent systems. IEEE Trans Robot2024; 40: 851–863.
61.
SeidAMBoatengGOMareriB, et al.Multi-agent DRL for task offloading and resource allocation in multi-UAV enabled ioT edge network. IEEE Trans Network Serv Manag2021; 18: 4531–4547.
