DU Xiongchun, DENG Dongliang. Adaptive hyperparameter-optimized transformer algorithm for lithium-ion battery SOH prediction[J]. Energy Storage Science and Technology, 2026, 15(6): 2392-2394.
DU Xiongchun, DENG Dongliang. Adaptive hyperparameter-optimized transformer algorithm for lithium-ion battery SOH prediction[J]. Energy Storage Science and Technology, 2026, 15(6): 2392-2394.DOI: 10.19799/j.cnki.2095-4239.2026.0474.
Adaptive hyperparameter-optimized transformer algorithm for lithium-ion battery SOH prediction
This paper presents an adaptive Transformer with GA-based hyperparameter tuning for battery SOH prediction in energy storage systems. First
terminal voltage and operating current are extracted as input features based on a second-order RC equivalent circuit model
combined with SOH to form multi-dimensional time-series inputs. Then
the self-attention mechanism of the Transformer is employed to capture long-range dependencies in the charging and discharging process. Finally
GA is utilized to globally optimize key hyperparameters including learning rate
batch size
network depth
and the number of attention heads
thereby enhancing the model's generalization capability and prediction accuracy. Experimental results on the NASA battery aging dataset demonstrate that the proposed GA-Transformer outperforms CNN
RNN
LSTM
and GRU in terms of MAE
RMSE
MAPE
and
R
²
validating the effectiveness and superiority of the proposed method.
YANG Q, SUN H W, ZHANG F B. Research on SOC improved unscented Kalman filter estimation algorithm for lithium batteries[J]. Machinery Design & Manufacture, 2021(10): 220-224.
VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Advances in Neural Information Processing Systems. Red Hook: Curran Associates, 2017: 5998-6008.
DENG T, LUO W X, LI Z F, et al. Estimation state of health of electric vehicle battery by dual Kalman filter[J]. Battery Bimonthly, 2018, 48(2): 95-99. DOI:10.19535/j.1001-1579.2018.02.007.
SHEN S Q, LIU B C, ZHANG K, et al. Toward fast and accurate SOH prediction for lithium-ion batteries[J]. IEEE Transactions on Energy Conversion, 2021, 36(3): 2036-2046. DOI:10.1109/TEC.2021.3052504.
GAO M K, XU H L, WU M B. Review of SOC estimation methods for power battery based on equivalent circuit model[J]. Journal of Electrical Engineering, 2021, 16(1): 90-102. DOI:10.11985/2021.01.013.
李敏强. 遗传算法的基本理论与应用[M]. 北京: 科学出版社, 2002.LI M Q. Basic theory and application of genetic algorithm[M]. Beijing: Science Press, 2002.
YAYAN U, ARSLAN A T, YUCEL H. A novel method for SoH prediction of batteries based on stacked LSTM with quick charge data[J]. Applied Artificial Intelligence, 2021, 35(6): 421-439. DOI:10.1080/08839514.2021.1901033.
ZHANG S Y, WU C H, XIONG W Y. State of health estimation for lithium-ion batteries using recurrent neural networks with gated recurrent unit[J]. Infrared and Laser Engineering, 2021, 50(2): 20200339. DOI:10.3788/IRLA20200339.