English
Related papers

Related papers: Foundation Models Knowledge Distillation For Batte…

200 papers

Battery health prognostics are critical for ensuring safety, efficiency, and sustainability in modern energy systems. However, it has been challenging to achieve accurate and robust prognostics due to complex battery degradation behaviors…

Machine Learning · Computer Science 2025-10-06 Vijay Babu Pamshetti , Wei Zhang , Sumei Sun , Jie Zhang , Yonggang Wen , Qingyu Yan

Tabular foundation models (TFMs) achieve strong performance on health datasets, but their inference cost and infrastructure requirements limit practical use. We study whether their predictive behavior can be transferred to lightweight…

Machine Learning · Computer Science 2026-05-19 Aditya Tanna , Nassim Bouarour , Mohamed Bouadi , Vinay Kumar Sankarapu , Pratinav Seth

Medical foundation models pre-trained on large-scale datasets have shown powerful versatile performance. However, when adapting medical foundation models for specific medical scenarios, it remains the inevitable challenge due to the gap…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Siyuan Du , Yuhang Zhou , Haolin Li , Jiangchao Yao , Haishuai Wang , Hui Lin , Ya Zhang , Yanfeng Wang

Understanding battery degradation in electric vehicles (EVs) under real-world conditions remains a critical yet under-explored area of research. Central to this investigation is the challenge of estimating the specific degradation modes in…

Optimization and Control · Mathematics 2024-05-20 Raja Abhishek Appana , Faissal El Idrissi , Prashanth Ramesh , Marcello Canova , Chun Yong Kang , Kimoon Um

Lithium-ion batteries have found their way into myriad sectors of industry to drive electrification, decarbonization, and sustainability. A crucial aspect in ensuring their safe and optimal performance is monitoring their energy levels. In…

Systems and Control · Electrical Eng. & Systems 2025-01-13 Hao Tu , Manashita Borah , Scott Moura , Yebin Wang , Huazhen Fang

Current state-of-the-art object detectors are at the expense of high computational costs and are hard to deploy to low-end devices. Knowledge distillation, which aims at training a smaller student network by transferring knowledge from a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ruoyu Sun , Fuhui Tang , Xiaopeng Zhang , Hongkai Xiong , Qi Tian

Conventional Li-ion battery ageing models, such as electrochemical, semi-empirical and empirical models, require a significant amount of time and experimental resources to provide accurate predictions under realistic operating conditions.…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Lucu M. , Martinez-Laserna E. , Gandiaga I. , Liu K. , Camblong H. , Widanage W. D. , Marco J

Lithium-Ion (Li-I) batteries have recently become pervasive and are used in many physical assets. To enable a good prediction of the end of discharge of batteries, detailed electrochemical Li-I battery models have been developed. Their…

Machine Learning · Computer Science 2020-12-09 Ajaykumar Unagar , Yuan Tian , Manuel Arias-Chao , Olga Fink

Batteries can effectively improve the security of energy systems and mitigate climate change by facilitating wind and solar power. The installed capacity of battery energy storage system (BESS), mainly the lithium ion batteries are…

Systems and Control · Electrical Eng. & Systems 2024-10-23 Cunzhi Zhao , Xingpeng Li

Recent advancements in foundation models have yielded impressive performance across a wide range of tasks. Meanwhile, for specific applications, practitioners have been developing specialized application models. To enjoy the benefits of…

Machine Learning · Computer Science 2024-05-16 Zichang Liu , Qingyun Liu , Yuening Li , Liang Liu , Anshumali Shrivastava , Shuchao Bi , Lichan Hong , Ed H. Chi , Zhe Zhao

Battery prognostics and health management predictive models are essential components of safety and reliability protocols in battery management system frameworks. Overall, developing a robust and efficient battery model that aligns with the…

Data Analysis, Statistics and Probability · Physics 2022-12-05 Hamed Sadegh Kouhestani , Lin Liu , Ruimin Wang , Abhijit Chandra

As a significant ingredient regarding health status, data-driven state-of-health (SOH) estimation has become dominant for lithium-ion batteries (LiBs). To handle data discrepancy across batteries, current SOH estimation models engage in…

Machine Learning · Computer Science 2022-09-02 Yan Qin , Chau Yuen , Xunyuan Yin , Biao Huang

Previous Knowledge Distillation based efficient image retrieval methods employs a lightweight network as the student model for fast inference. However, the lightweight student model lacks adequate representation capacity for effective…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Yi Xie , Huaidong Zhang , Xuemiao Xu , Jianqing Zhu , Shengfeng He

Deep pre-training and fine-tuning models (like BERT, OpenAI GPT) have demonstrated excellent results in question answering areas. However, due to the sheer amount of model parameters, the inference speed of these models is very slow. How to…

Computation and Language · Computer Science 2019-04-23 Ze Yang , Linjun Shou , Ming Gong , Wutao Lin , Daxin Jiang

Cell inconsistency within a lithium-ion battery system poses a significant challenge in maximizing the system operational time. This study presents an optimization-driven active balancing method to minimize the effects of cell inconsistency…

Systems and Control · Electrical Eng. & Systems 2024-05-03 Yiming Xu , Xiaohua Ge , Ruohan Guo , Weixiang Shen

Accurate state-of-health (SOH) estimation is critical to guarantee the safety, efficiency and reliability of battery-powered applications. Most SOH estimation methods focus on the 0-100\% full state-of-charge (SOC) range that has similar…

Machine Learning · Computer Science 2023-04-12 Xin Chen , Yuwen Qin , Weidong Zhao , Qiming Yang , Ningbo Cai , Kai Wu

In this paper, we investigate the distillation of time series reasoning capabilities into small, instruction-tuned language models as a step toward building interpretable time series foundation models. Leveraging a synthetic dataset of…

Computation and Language · Computer Science 2025-07-11 Matthieu Boileau , Philippe Helluy , Jeremy Pawlus , Svitlana Vyetrenko

Longevity and safety of lithium-ion batteries are facilitated by efficient monitoring and adjustment of the battery operating conditions. Hence, it is crucial to implement fast and accurate algorithms for State of Health (SoH) monitoring on…

Applications · Statistics 2021-11-30 Clara Bertinelli Salucci , Azzeddine Bakdi , Ingrid K. Glad , Erik Vanem , Riccardo De Bin

Medical foundation models pre-trained on large-scale datasets have demonstrated powerful versatile capabilities for various tasks. However, due to the gap between pre-training tasks (or modalities) and downstream tasks (or modalities), the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yuhang Zhou , Siyuan Du , Haolin Li , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Batteries are a key enabling technology for the decarbonization of transport and energy sectors. The safe and reliable operation of batteries is crucial for battery-powered systems. In this direction, the development of accurate and robust…

Machine Learning · Computer Science 2024-07-16 Jokin Alcibar , Jose I. Aizpurua , Ekhi Zugasti