This paper proposes a novel quantized alternating direction method of multipliers (ADMM) for distributed optimization problems where the strongly convex objective function contains smooth and non-smooth parts. When the objective function is strongly convex and smooth, we show that the proposed quantized ADMM converges to an exact solution with an R-linearly convergent rate. We also present that the proposed algorithm converges to a more accurate solution than that of existing optimization algorithms with a fixed quantization interval if the objective function is strongly convex and non-smooth. Moreover, the convergent performance and the computation complexity of the proposed algorithm are analyzed. Finally, we provide two numerical examples to illustrate the effectiveness of the proposed algorithm.
ChenZYiPLiL, et al. (2023) Distributed time-varying convex optimization with dynamic quantization. IEEE Transactions on Cybernetics53(2): 1078–1092.
4.
ChengSLiangSFanY (2021) Distributed solving Sylvester equations with fractional order dynamics. Control Theory and Technology19(2): 249–259.
5.
ChengSLiangSFanY, et al. (2023) Distributed gradient tracking for unbalanced optimization with different constraint sets. IEEE Transactions on Automatic Control68(6): 3633–3640.
6.
ChengSYuXZengX, et al. (2024) Distributed optimization and scaling design for solving Sylvester equations. Journal of Systems Science and Complexity. Epub ahead of print 11July. DOI: 10.1007/s11424-024-3407-6.
7.
FanYFengGWangY, et al. (2013) Distributed event-triggered control of multi-agent systems with combinational measurements. Automatica49(2): 671–675.
8.
HuYFuJWenG, et al. (2024) Policy consensus-based distributed deterministic multi-agent reinforcement learning over directed graphs. IEEE Transactions on Artificial Intelligence1: 1–14.
9.
HuangQFanYChengS (2024) Distributed unbalanced optimization design over nonidentical constraints. IEEE Transactions on Network Science and Engineering11: 3455–3466.
10.
KhiriratSMagnússonSJohanssonM (2020) Compressed gradient methods with Hessian-aided error compensation. IEEE Transactions on Signal Processing69: 998–1011.
11.
LeiJYiPShiG, et al. (2020) Distributed algorithms with finite data rates that solve linear equations. SIAM Journal on Optimization30(2): 1191–1222.
12.
LiHLiuSSohYC, et al. (2017) Event-triggered communication and data rate constraint for distributed optimization of multiagent systems. IEEE Transactions on Systems, Man, and Cybernetics: Systems48(11): 1908–1919.
13.
LiXChenMZSuH (2018) Quantized consensus of multi-agent networks with sampled data and Markovian interaction links. IEEE Transactions on Cybernetics49(5): 1816–1825.
14.
LiangSWangLYinG (2019a) Dual averaging push for distributed convex optimization over time-varying directed graph. IEEE Transactions on Automatic Control65(4): 1785–1791.
15.
LiangSYinGWangL (2019b) Exponential convergence of distributed primal–dual convex optimization algorithm without strong convexity. Automatica105: 298–306.
16.
LingQLiuYShiW, et al. (2016) Weighted ADMM for fast decentralized network optimization. IEEE Transactions on Signal Processing64(22): 5930–5942.
17.
LingQTianZ (2010) Decentralized sparse signal recovery for compressive sleeping wireless sensor networks. IEEE Transactions on Signal Processing58(7): 3816–3827.
18.
LiuYXuWWuG, et al. (2019) Communication-censored ADMM for decentralized consensus optimization. IEEE Transactions on Signal Processing67(10): 2565–2579.
19.
MaJLiuLJiH, et al. (2018) Quantized consensus of multiagent systems by event-triggered control. IEEE Transactions on Systems, Man, and Cybernetics: Systems50(9): 3231–3242.
20.
NedicAOzdaglarA (2009) Distributed subgradient methods for multi-agent optimization. IEEE Transactions on Automatic Control54(1): 48–61.
21.
ShiWLingQYuanK, et al. (2014) On the linear convergence of the ADMM in decentralized consensus optimization. IEEE Transactions on Signal Processing62(7): 1750–1761.
22.
SongZShiLPuS, et al. (2022) Compressed gradient tracking for decentralized optimization over general directed networks. IEEE Transactions on Signal Processing70: 1775–1787.
23.
WanYWenGYuX, et al. (2024) Distributed event-triggered learning-based control for battery energy storage systems under persistent false data injection attacks. IEEE Transactions on Smart Grid15: 4986–4997.
24.
WangDFangXWanY, et al. (2022) Distributed optimization algorithms for mass with network attacks: From continuous-time to event-triggered communication. IEEE Transactions on Network Science and Engineering9(5): 3332–3344.
25.
WangJPhamKD (2018) An approximate distributed gradient estimation method for networked system optimization under limited communications. IEEE Transactions on Systems, Man, and Cybernetics: Systems50(12): 5142–5151.
26.
WeiXYangJFanX (2021) Variational method-based distributed optimal guidance laws for multi-attackers’ simultaneous attack. Transactions of the Institute of Measurement and Control43: 1868–1879.
27.
WenGZhengWXWanY (2023) Distributed robust optimization for networked agent systems with unknown nonlinearities. IEEE Transactions on Automatic Control68(9): 5230–5244.
28.
XiongYWuLYouK, et al. (2022) Quantized distributed gradient tracking algorithm with linear convergence in directed networks. IEEE Transactions on Automatic Control68(9): 5638–5645.
29.
YiPHongY (2014) Quantized subgradient algorithm and data-rate analysis for distributed optimization. IEEE Transactions on Control of Network Systems1(4): 380–392.
30.
YiPHongY (2015) Stochastic sub-gradient algorithm for distributed optimization with random sleep scheme. Control Theory and Technology13(4): 333–347.
31.
YuWChengSHeS (2023a) Distributed solving linear algebraic equations with switched fractional order dynamics. Journal of Systems Science and Complexity36(2): 613–631.
32.
YuXFanYChengS (2023b) Event-triggered primal–dual design with linear convergence for distributed nonstrongly convex optimization. Journal of the Franklin Institute360(18): 14940–14953.
33.
YuanDHoDWJiangG (2017) An adaptive primal-dual subgradient algorithm for online distributed constrained optimization. IEEE Transactions on Cybernetics48(11): 3045–3055.
34.
YuanDHongYHoDW, et al. (2018) Optimal distributed stochastic mirror descent for strongly convex optimization. Automatica90: 196–203.
35.
YuanKXuWLingQ (2020) Can primal methods outperform primal-dual methods in decentralized dynamic optimization?IEEE Transactions on Signal Processing68: 4466–4480.
36.
ZengXChenJSunJ, et al. (2020) Distributed optimization approach for solving continuous-time Lyapunov equations with exponential rate of convergence. IEEE Transactions on Systems, Man, and Cybernetics: Systems52(3): 1684–1691.
37.
ZengXLeiJChenJ (2023) Dynamical primal-dual Nesterov accelerated method and its application to network optimization. IEEE Transactions on Automatic Control68(3): 1760–1767.
38.
ZengXYiPHongY, et al. (2018) Distributed continuous-time algorithms for nonsmooth extended monotropic optimization problems. SIAM Journal on Control and Optimization56(6): 3973–3993.
39.
ZhuJRenHZhangX, et al. (2022) Two-level optimization model of hybrid energy storage system in wind/solar distributed generation system. Transactions of the Institute of Measurement and Control. Epub ahead of print 22December. DOI: 10.1177/01423312221142374.
40.
ZhuKTangY (2023) Primal-dual ε-subgradient method for distributed optimization. Journal of Systems Science and Complexity36(2): 577–590.
41.
ZhuSHongMChenB (2016) Quantized consensus ADMM for multi-agent distributed optimization. In: 2016 IEEE international conference on acoustics, speech and signal processing, Shanghai, China, 20–25 March, pp. 4134–4138. New York: IEEE.
