English
Related papers

Related papers: Staying Alive: Online Neural Network Maintenance a…

200 papers

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

Machine Learning · Computer Science 2021-12-16 Xiaoxuan Wang , Rolf Stadler

A broad range of applications involve signals with irregular structures that can be represented as a graph. As the underlying structures can change over time, the tracking dynamic graph topologies from observed signals is a fundamental…

Signal Processing · Electrical Eng. & Systems 2025-07-15 Lital Dabush , Nir Shlezinger , Tirza Routtenberg

The cubature Kalman filter (CKF), while theoretically rigorous for nonlinear estimation, often suffers performance degradation due to model-environment mismatches in practice. To address this limitation, we propose CKFNet-a hybrid…

Signal Processing · Electrical Eng. & Systems 2025-08-14 Jinhui Hu , Haiquan Zhao , Yi Peng

We introduce a computationally efficient variant of the model-based ensemble Kalman filter (EnKF). We propose two changes to the original formulation. First, we phrase the setup in terms of precision matrices instead of covariance matrices,…

Methodology · Statistics 2023-03-01 Håkon Gryvill , Håkon Tjelmeland

It is imperative to accelerate the training of neural network force field such as Deep Potential, which usually requires thousands of images based on first-principles calculation and a couple of days to generate an accurate potential energy…

Computational Physics · Physics 2022-12-15 Siyu Hu , Wentao Zhang , Qiuchen Sha , Feng Pan , Lin-Wang Wang , Weile Jia , Guangmng Tan , Tong Zhao

In this paper, we first review the theory of symmetry-preserving observers and we mention some recent results. Then, we apply the theory to Extended Kalman Filter-based Simultaneous Localization and Mapping (EKF SLAM). It allows to derive a…

Optimization and Control · Mathematics 2011-05-12 Silvere Bonnabel

Accurate estimation of power system dynamics is very important for the enhancement of power system reliability, resilience, security, and stability of power system. With the increasing integration of inverter-based distributed energy…

Systems and Control · Electrical Eng. & Systems 2020-12-14 Narayan Bhusal , Mukesh Gautam

Wireless sensor networks (WSNs) represent a critical research domain within the Internet of Things (IoT) technology. The distributed Kalman filter (DKF) has garnered significant attention as an information fusion method for WSNs. However,…

Signal Processing · Electrical Eng. & Systems 2025-03-11 Xuemei Mao , Gang Wang , Bei Peng , Jiacheng He , Kun Zhang , Song Gao , Jian Chen

Reinforcement learning for large language models suffers from high-variance token-level importance sampling (IS) ratios, which would destabilize policy optimization at scale. To improve stability, recent methods typically use a fixed…

Computation and Language · Computer Science 2026-03-03 Shuo He , Lang Feng , Xin Cheng , Lei Feng , Bo An

In many physical applications, the system's state varies with spatial variables as well as time. The state of such systems is modelled by partial differential equations and evolves on an infinite-dimensional space. Systems modelled by…

Optimization and Control · Mathematics 2022-02-17 Sepideh Afshar , Fabian Germ , Kirsten A. Morris

Kalman filter-based algorithms are fundamental for mobile robots, as they provide a computationally efficient solution to the challenging problem of state estimation. However, they rely on two main assumptions that are difficult to satisfy…

We consider online optimization procedures in the context of logistic regression, focusing on the Extended Kalman Filter (EKF). We introduce a second-order algorithm close to the EKF, named Semi-Online Step (SOS), for which we prove a…

Machine Learning · Computer Science 2019-02-27 Joseph De Vilmarest , Olivier Wintenberger

The fusion of camera sensor and inertial data is a leading method for ego-motion tracking in autonomous and smart devices. State estimation techniques that rely on non-linear filtering are a strong paradigm for solving the associated…

Robotics · Computer Science 2022-05-30 Arno Solin , Rui Li , Andrea Pilzer

Recent studies in neuroscience suggest that Successor Representation (SR)-based models provide adaptation to changes in the goal locations or reward function faster than model-free algorithms, together with lower computational cost compared…

Neural and Evolutionary Computing · Computer Science 2022-04-04 Parvin Malekzadeh , Mohammad Salimibeni , Ming Hou , Arash Mohammadi , Konstantinos N. Plataniotis

This paper proposes an Online Control-Informed Learning (OCIL) framework, which employs the well-established optimal control and state estimation techniques in the field of control to solve a broad class of learning tasks in an online…

Optimization and Control · Mathematics 2025-03-12 Zihao Liang , Tianyu Zhou , Zehui Lu , Shaoshuai Mou

Maps of dynamics are effective representations of motion patterns learned from prior observations, with recent research demonstrating their ability to enhance various downstream tasks such as human-aware robot navigation, long-term human…

Robotics · Computer Science 2025-04-01 Yufei Zhu , Andrey Rudenko , Luigi Palmieri , Lukas Heuer , Achim J. Lilienthal , Martin Magnusson

Large language models encode impressively broad world knowledge in their parameters. However, the knowledge in static language models falls out of date, limiting the model's effective "shelf life." While online fine-tuning can reduce this…

Computation and Language · Computer Science 2023-10-24 Nathan Hu , Eric Mitchell , Christopher D. Manning , Chelsea Finn

The filtering distribution in hidden Markov models evolves according to the law of a mean-field model in state-observation space. The ensemble Kalman filter (EnKF) approximates this mean-field model with an ensemble of interacting…

Machine Learning · Statistics 2025-12-25 Eviatar Bach , Ricardo Baptista , Edoardo Calvello , Bohan Chen , Andrew Stuart

Large-scale distributed systems such as sensor networks, often need to achieve filtering and consensus on an estimated parameter from high-dimensional measurements. Running a Kalman filter on every node in such a network is computationally…

Optimization and Control · Mathematics 2017-04-12 Mathias Hudoba de Badyn , Mehran Mesbahi

In areas such as finance, engineering, and science, we often face situations that change quickly and unpredictably. These situations are tough to handle and require special tools and methods capable of understanding and predicting what…

Systems and Control · Electrical Eng. & Systems 2024-04-23 Wencheng Bao , Shi Feng , Kaiwen Zhang