To enhance battery longevity in electric vehicles (EVs), Hybrid Energy Storage Systems (HESS) integrate the high power density of supercapacitors with the high energy density of batteries. This paper proposes an economic adaptive cruise control (Eco-ACC) strategy for HESS-powered EVs based on hierarchical action-dependent heuristic dynamic programming (HESS-ADHDP). The method incorporates vehicle longitudinal dynamics, battery capacity degradation models, and power distribution mechanisms to construct a two-layer actor–critic learning architecture. The upper layer ensures vehicle safety and driving comfort, while the lower layer optimizes real-time energy allocation between the battery and the supercapacitor. Simulation experiments under various standard drive cycles validate the effectiveness of the proposed strategy. Compared to the baseline control method, the HESS-ADHDP-based approach reduces battery capacity degradation by 14.67%–73.75% and improves energy efficiency by up to 39.5%. The proposed strategy is model-free, real-time, and adaptable to complex driving scenarios, offering promising potential for intelligent energy management in future EV applications.
DeyKCYanLWangX, et al. A review of communication, driver characteristics, and controls aspects of cooperative adaptive cruise control (CACC). IEEE Trans Intell Transp Syst2015; 17(2): 491–509.
2.
BarkenbusJN.Eco-driving: an overlooked climate change initiative. Energy Policy2010; 38(2): 762–769.
3.
SuttonRSBartoAG.Reinforcement learning: an introduction. 2nd edn.MIT Press, 2018.
4.
ZhaiCChenXYanC, et al. Ecological cooperative adaptive cruise control for a heterogeneous platoon of heavy-duty vehicles with time delays. IEEE Access2020; 8: 146208–146219.
5.
MamoueiMKapariasIHalikiasG.A framework for user-and system-oriented optimisation of fuel efficiency and traffic flow in adaptive cruise control. Transp Res Part C Emerg Technol2018; 92: 27–41.
6.
TianXTaoFFuZ, et al. Optimizing fuel economy of fuel cell hybrid electric vehicle based on energy management strategy with integrated rapid thermal regulation. Eng Appl Artif Intell2024; 132: 107880.
7.
XieSHuXXinZ, et al. Time-efficient stochastic model predictive energy management for a plug-in hybrid electric bus with an adaptive reference state-of-charge advisory. IEEE Trans Veh Technol2018; 67(7): 5671–5682.
8.
HattoriMFujimotoH. Basic idea of quadrant dynamic programming for adaptive cruise control to create energy efficient velocity trajectory of electric vehicle. In: 2020 IEEE 16th international workshop on advanced motion control (AMC), Kristiansand, Norway, 14–16 September 2020.
9.
MadhusudhananAKNaX.Effect of a traffic speed based cruise control on an electric vehicle’s performance and an energy consumption model of an electric vehicle. IEEE CAA J Autom Sinica2020; 7(2): 386–394.
10.
JiaYJibrinRGörgesD.Energy-optimal adaptive cruise control for electric vehicles based on linear and nonlinear model predictive control. IEEE Trans Veh Technol2020; 69(12): 14173–14187.
11.
LiSChuLFuP, et al. Energy-oriented hybrid cooperative adaptive cruise control for fuel cell electric vehicle platoons. Sensors2024; 24(15): 5065.
12.
GoraPKatrakazasCDrabickiA, et al. Microscopic traffic simulation models for connected and automated vehicles (CAVs)–state-of-the-art. Procedia Comput Sci2020; 170: 474–481.
13.
WangYTanHWuY, et al. Hybrid electric vehicle energy management with computer vision and deep reinforcement learning. IEEE Trans Industr Inform2020; 17(6): 3857–3868.
14.
WangYYuanSWangX, et al. Nonlinear robust control of vehicle stabilization system with uncertainty based on neural network. Electronics2024; 13(10): 1988.
15.
EsmailyJMoranRRoudiY, et al. A model-free, reinforcement learning algorithm for perceptual decision making under uncertainty. J Comput Neurosci2024; 52(Suppl. 1): S21.
16.
PozziABaeSChoiY, et al. Ecological velocity planning through signalized intersections: a deep reinforcement learning approach. In: 2020 59th IEEE conference on decision and control (CDC), Jeju, Korea (South), 14–18 December 2020.
17.
LiGGörgesD.Ecological adaptive cruise control for vehicles with step-gear transmission based on reinforcement learning. IEEE Trans Intell Transp Syst2019; 21(11): 4895–4905.
18.
YangHZhaiCQiuJ, et al. A multistep reinforcement learning–based economic adaptive cruise control strategy for electric vehicles in a car-following scenario. J Transp Eng A Syst2025; 151(8): 04025052.
19.
RuanSMaYYangN, et al. Real-time energy-saving control for HEVs in car-following scenario with a double explicit MPC approach. Energy2022; 247: 123265.
20.
NguyenHTNguyen-VanSHoangTX, et al. Optimal energy management of a dual-motor electric vehicle using dynamic programming. In: 2021 IEEE vehicle power and propulsion conference (VPPC), Gijon, Spain, 25–28 October 2021.
21.
RekikMGramiMKrichenL. An optimal power control strategy for a plug in electric vehicle based on online multi-objective particle swarm optimization. In: 2022 5th international conference on advanced systems and emergent technologies (ICASET), Hammamet, Tunisia, 22–25 March 2022.
22.
LiKZhangYDuC, et al. Dynamic programming-based optimal charging scheduling for electric vehicles. In: 2022 IEEE 7th international conference on intelligent transportation engineering (ICITE), Beijing, China, 11–13 November 2022.
23.
VendotiSBhaskarMSKumarKD, et al. Dynamic programming-based energy management strategy optimization for PV system hybrid electric vehicles. In: 2023 international conference on intelligent and innovative technologies in computing, electrical and electronics (IITCEE), Bengaluru, India, 27–28 January 2023.
24.
WangWQuFLiW, et al. Research on energy control strategy of four-wheel drive hybrid electric vehicle based on dynamic programming. In: 2023 IEEE 6th information technology, networking, electronic and automation control conference (ITNEC), Chongqing, China, 24–26 February 2023.
25.
XueJYanCLiuL, et al. ADHDP-based housing energy management for two housing units with mobile storage. In: 2020 IEEE 9th data driven control and learning systems conference (DDCLS), Liuzhou, China, 20–22 November 2020.
26.
BianYQinXDuC, et al. A unified hierarchical framework for platoon control of connected vehicles with heterogeneous control modes. In: 2020 IEEE 23rd international conference on intelligent transportation systems (ITSC), Rhodes, Greece, 20–23 September 2020.
27.
ZhengHWuJWuW, et al. Integrated motion and powertrain predictive control of intelligent fuel cell/battery hybrid vehicles. IEEE Trans Industr Inform2019; 16(5): 3397–3406.
28.
LiWChenTGuoJ, et al. Adaptive car-following control of intelligent electric vehicles. In: 2018 IEEE 4th international conference on control science and systems engineering (ICCSSE), Wuhan, China, 21–23 August 2018.
29.
SrisukanunPNilkhamhangI. A case study of EV control on slip surface based on driving force distribution and hierarchical LQR. In: 2019 first international symposium on instrumentation, control, artificial intelligence, and robotics (ICA-SYMP), Bangkok, Thailand, 16–18 January 2019.
30.
ZhaiC.Intelligent vehicle cooperative control based on distributed model predictive control. PhD Thesis, South China University of Technology, China, 2019.
31.
ZhaiCLuoFLiuY.Cooperative power split optimization for a group of intelligent electric vehicles travelling on a highway with varying slopes. IEEE Trans Intell Transp Syst2022; 23(6): 4993–5005.
32.
BurressTACampbellSLCoomerC, et al. Evaluation of the 2010 Toyota Prius hybrid synergy drive system. Oak Ridge National Lab. (ORNL), Oak Ridge, TN, USA, 2011.
33.
LukicSMCaoJBansalRC, et al. Energy storage systems for automotive applications. IEEE Trans Ind Electron2008; 55(6): 2258–2267.
34.
LukicSMWirasinghaSGRodriguezF, et al. Power management of an ultracapacitor/battery hybrid energy storage system in an HEV. In: 2006 IEEE vehicle power and propulsion conference, Windsor, UK, 6–8 September 2006.
35.
PodderAKChakrabortyOIslamS, et al. Control strategies of different hybrid energy storage systems for electric vehicles applications. IEEE Access2021; 9: 51865–51895.
36.
BabuTSVasudevanKRRamachandaramurthyVK, et al. A comprehensive review of hybrid energy storage systems: converter topologies, control strategies and future prospects. IEEE Access2020; 8: 148702–148721.
37.
BeltJR. Battery test manual for plug-in hybrid electric vehicles. Idaho National Laboratory (INL), Technical Report INL/EXT-07-12536, Idaho Falls, ID (United States), 2010.
38.
HochgrafCGBascoJKBohnTP, et al. Effect of ultracapacitor-modified PHEV protocol on performance degradation in lithium-ion cells. J Power Sources2014; 246: 965–969.
39.
PetersonSBAptJWhitacreJF.Lithium-ion battery cell degradation resulting from realistic vehicle and vehicle-to-grid utilization. J Power Sources2010; 195(8): 2385–2392.
40.
MaghfirohHWahyunggoroOCahyadiAI.Energy management in hybrid electric and hybrid energy storage system vehicles: a fuzzy logic controller review. IEEE Access2024; 12: 56097–56109.
41.
Rakhtala RostamiMSAl-ShibaanyZ. Intelligent energy management for full-active hybrid energy storage systems in electric vehicles using teaching–learning-based optimization in fuzzy logic algorithms. IEEE Access2024; 12: 67665–67680.
42.
UpadhyayaAMahantaC.An overview of battery based electric vehicle technologies with emphasis on energy sources, their configuration topologies and management strategies. IEEE Trans Intell Transp Syst2024; 25(2): 1087–1111.
43.
MeyerRTDeCarloRAPekarekS.Hybrid model predictive power management of a battery-supercapacitor electric vehicle. Asian J Control2016; 18(1): 150–165.
44.
CaoJEmadiA.A new battery/ultracapacitor hybrid energy storage system for electric, hybrid, and plug-in hybrid electric vehicles. IEEE Trans Power Electron2011; 27(1): 122–132.
45.
SongZHofmannHLiJ, et al. Energy management strategies comparison for electric vehicles with hybrid energy storage system. Appl Energy2014; 134: 321–331.
46.
SongZHofmannHLiJ, et al. Optimization for a hybrid energy storage system in electric vehicles using dynamic programming approach. Appl Energy2015; 139: 151–162.
47.
LiLWangXSongJ.Fuel consumption optimization for smart hybrid electric vehicle during a car-following process. Mech Syst Signal Process2017; 87: 17–29.
48.
GolchoubianPAzadNL.Real-time nonlinear model predictive control of a battery–supercapacitor hybrid energy storage system in electric vehicles. IEEE Trans Veh Technol2017; 66(11): 9678–9688.
49.
LiMCaoZLiZ.A reinforcement learning-based vehicle platoon control strategy for reducing energy consumption in traffic oscillations. IEEE Trans Neural Netw Learn Syst2021; 32(12): 5309–5322.
50.
GroelkeBEarnhardtCBorekJ, et al. A predictive command governor-based adaptive cruise controller with collision avoidance for non-connected vehicle following. IEEE Trans Intell Transp Syst2022; 23(8): 12276–12286.
51.
ZegersJCSemsar-KazerooniEPloegJ, et al. Consensus control for vehicular platooning with velocity constraints. IEEE Trans Control Syst Technol2017; 26(5): 1592–1605.
52.
BaldiSLiuDJainV, et al. Establishing platoons of bidirectional cooperative vehicles with engine limits and uncertain dynamics. IEEE Trans Intell Transp Syst2020; 22(5): 2679–2691.
53.
XingHPloegJNijmeijerH.Compensation of communication delays in a cooperative ACC system. IEEE Trans Veh Technol2019; 69(2): 1177–1189.
