The Proton Exchange Membrane Fuel Cell (PEMFC) system, as an efficient, zero-pollution emission, and high-efficiency energy conversion device, is particularly suitable for heavy-duty transportation. Considering the limited power of the current PEMFC system, this study focuses on a hybrid fuel cell heavy-duty truck with dual stacks. Considering the optimal operating range of the PEMFC system and the health status of the lithium-ion battery pack, an energy management strategy (EMS) based on the Deep Deterministic Policy Gradient (DDPG) algorithm is established. This strategy optimizes the hydrogen consumption cost, degradation costs of lithium-ion battery and fuel cells. Additionally, a dynamic programming (DP) and an equivalent consumption minimization strategy (ECMS) based EMSs are established. The power allocation and overall transportation costs under the CSC driving cycle are compared and verified for the three EMSs. The results show that the DDPG algorithm provides a more optimal power allocation for the dual-stack fuel cells, improving the overall system efficiency, enhancing the lifecycle of heavy-duty trucks, and significantly reducing overall travel costs.
LeeDYElgowainyAKotzA, et al. Life-cycle implications of hydrogen fuel cell electric vehicle technology for medium-and heavy-duty trucks. J Power Sources2018; 393: 217–229.
2.
ÇabukogluEGeorgesGKüngL, et al. Fuel cell electric vehicles: an option to decarbonize heavy-duty transport? Results from a Swiss case-study. Transp Res D Transp Environ2019; 70: 35–48.
3.
da Costa LopesFKelouwaniSBoulonL, et al. Neural network modeling strategy applied to a multi-stack PEM fuel cell system. In: IEEE transportation electrification conference and expo (ITEC), Dearborn, MI, 27–29 June 2016, pp.1–7. New York: IEEE.
4.
WangTLiQYinL, et al. Hydrogen consumption minimization method based on the online identification for multi-stack PEMFCs system. Int J Hydrogen Energy2019; 44(11): 5074–5081.
5.
AhmadiSBathaeeSMTHosseinpourAH.Improving fuel economy and performance of a fuel-cell hybrid electric vehicle (fuel-cell, battery, and ultra-capacitor) using optimized energy management strategy. Energy Convers Manag2018; 160: 74–84.
6.
HanLJiaoXZhangZ.Recurrent neural network-based adaptive energy management control strategy of plug-in hybrid electric vehicles considering battery aging. Energies2020; 13(1): 202.
7.
ZhouSChenZHuangD, et al. Model prediction and rule based energy management strategy for a plug-in hybrid electric vehicle with hybrid energy storage system. IEEE Trans Power Electron2020; 36(5): 5926–5940.
8.
ChenXLiMChenZ.Meta rule-based energy management strategy for battery/supercapacitor hybrid electric vehicles. Energy2023; 285: 129365.
9.
FernandezAMKandidayeniMBoulonL, et al. An adaptive state machine based energy management strategy for a multi-stack fuel cell hybrid electric vehicle. IEEE Trans Veh Technol2019; 69(1): 220–234.
10.
VanLPHieuLHDo ChiK, et al. An improved state machine-based energy management strategy for renewable energy microgrid with hydrogen storage system. Energy Rep2023; 9: 194–201.
11.
YanMLiMHeH, et al. Rule-based energy management for dual-source electric buses extracted by wavelet transform. J Clean Prod2018; 189: 116–127.
12.
ZhaoZH.Improved fuzzy logic control-based energy management strategy for hybrid power system of FC/PV/battery/SC on tourist ship. Int J Hydrogen Energy2022; 47(16): 9719–9734.
13.
MengXLiQZhangG, et al. A dual-mode energy management strategy considering fuel cell degradation for energy consumption and fuel cell efficiency comprehensive optimization of hybrid vehicle. IEEE Access2019; 7: 134475–134487.
14.
LiHZhuDShangL, et al. Research on an energy management strategy and energy optimisation of hydraulic hybrid power mining trucks. Int J Veh Des2021; 85(2–4): 246–273.
15.
MotaponSNDessaintLAAl-HaddadK.A comparative study of energy management schemes for a fuel-cell hybrid emergency power system of more-electric aircraft. IEEE Trans Ind Electron2013; 61(3): 1320–1334.
16.
WeiCSunXChenY, et al. Comparison of architecture and adaptive energy management strategy for plug-in hybrid electric logistics vehicle. Energy2021; 230: 120858.
17.
RezkHNassefAMAbdelkareemMA, et al. Comparison among various energy management strategies for reducing hydrogen consumption in a hybrid fuel cell/supercapacitor/battery system. Int J Hydrogen Energy2021; 46(8): 6110–6126.
18.
DuCHuangSJiangY, et al. Optimization of energy management strategy for fuel cell hybrid electric vehicles based on dynamic programming. Energies2022; 15(12): 4325.
19.
HuJLiJHuZ, et al. Power distribution strategy of a dual-engine system for heavy-duty hybrid electric vehicles using dynamic programming. Energy2021; 215: 118851.
20.
HuangfuYLiPPangS, et al. An improved energy management strategy for fuel cell hybrid vehicles based on Pontryagin’s minimum principle. IEEE Trans Ind Appl2022; 58(3): 4086–4097.
21.
ZhangFHuXLangariR, et al. Adaptive energy management in automated hybrid electric vehicles with flexible torque request. Energy2021; 214: 118873.
22.
GarcíaPTorreglosaJPFernándezLM, et al. Viability study of a FC-battery-SC tramway controlled by equivalent consumption minimization strategy. Int J Hydrogen Energy2012; 37(11): 9368–9382.
23.
WangYMouraSJAdvaniSG, et al. Power management system for a fuel cell/battery hybrid vehicle incorporating fuel cell and battery degradation. Int J Hydrogen Energy2019; 44(16): 8479–8492.
24.
LiHZhuDShangL, et al. Collaborative optimization and energy management of hydraulic hybrid mining trucks. Proc IMechE, Part D: J Automobile Engineering2022; 236(12): 2773–2791.
25.
WuXHuXYinX, et al. Convex programming energy management and components sizing of a plug-in fuel cell urban logistics vehicle. J Power Sources2019; 423: 358–366.
26.
ReddyNPPasdeloupDZadehMK, et al. An intelligent power and energy management system for fuel cell/battery hybrid electric vehicle using reinforcement learning. In: IEEE transportation electrification conference and expo (ITEC), Detroit, MI, 19–21 June 2019, pp.1–6. New York: IEEE.
27.
LiuTWangBYangC.Online Markov chain-based energy management for a hybrid tracked vehicle with speedy Q-learning. Energy2018; 160: 544–555.
28.
WuJHeHPengJ, et al. Continuous reinforcement learning of energy management with deep Q network for a power split hybrid electric bus. Appl Energy2018, 222: 799–811.
29.
TangXZhouHWangF, et al. Longevity-conscious energy management strategy of fuel cell hybrid electric vehicle based on deep reinforcement learning. Energy2022; 238: 121593.
30.
LillicrapTPHuntJJPritzelA, et al. Continuous control with deep reinforcement learning. arxiv preprint arxiv:1509.02971, 2015.
31.
MnihVBadiaAPMirzaM, et al. Asynchronous methods for deep reinforcement learning. In: International conference on machine learning, New York, NY, June 2016, pp.1928–1937. PMLR.
32.
WuJWeiZLiW, et al. Battery thermal-and health-constrained energy management for hybrid electric bus based on soft actor-critic DRL algorithm. IEEE Trans Industr Inform2020; 17(6): 3751–3761.
33.
FujimotoSHoofHMegerD.Addressing function approximation error in actor-critic methods. In: International conference on machine learning, Stockholm, Sweden, July 2018, pp.1587–1596. PMLR.
34.
LianRPengJWuY, et al. Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle. Energy2020; 197: 117297.
35.
WuJYuanXZMartinJJ, et al. Proton exchange membrane fuel cell degradation under close to open-circuit conditions: part I: in situ diagnosis. J Power Sources2010; 195(4): 1171–1176.
36.
HuXZouCTangX, et al. Cost-optimal energy management of hybrid electric vehicles using fuel cell/battery health-aware predictive control. IEEE Trans Power Electron2019; 35(1): 382–392.
