English
Related papers

Related papers: Online Learning of Nonlinear Parametric Models und…

200 papers

Accurate structural response prediction forms a main driver for structural health monitoring and control applications. This often requires the proposed model to adequately capture the underlying dynamics of complex structural systems. In…

Machine Learning · Computer Science 2023-07-04 Wei Liu , Zhilu Lai , Kiran Bacsa , Eleni Chatzi

This paper investigates the use of extended Kalman filtering to train recurrent neural networks with rather general convex loss functions and regularization terms on the network parameters, including $\ell_1$-regularization. We show that…

Machine Learning · Computer Science 2022-11-03 Alberto Bemporad

The use of model order reduction techniques in combination with ensemble-based methods for estimating the state of systems described by nonlinear partial differential equations has been of great interest in recent years in the data…

Numerical Analysis · Mathematics 2024-12-18 Francesco A. B. Silva , Cecilia Pagliantini , Karen Veroy

Learning in a non-stationary environment is an inevitable problem when applying machine learning algorithm to real world environment. Learning new tasks without forgetting the previous knowledge is a challenge issue in machine learning. We…

Machine Learning · Computer Science 2018-11-07 Honglin Li , Frieder Ganz , Shirin Enshaeifar , Payam Barnaghi

We study the Extended Kalman Filter in constant dynamics, offering a bayesian perspective of stochastic optimization. We obtain high probability bounds on the cumulative excess risk in an unconstrained setting. In order to avoid any…

Machine Learning · Computer Science 2020-06-29 Joseph de Vilmarest , Olivier Wintenberger

Latent variable models have become instrumental in computational neuroscience for reasoning about neural computation. This has fostered the development of powerful offline algorithms for extracting latent neural trajectories from neural…

Machine Learning · Statistics 2023-05-22 Matthew Dowling , Yuan Zhao , Il Memming Park

The alternating direction method of multipliers (ADMM) is a common optimization tool for solving constrained and non-differentiable problems. We provide an empirical study of the practical performance of ADMM on several nonconvex…

Optimization and Control · Mathematics 2016-12-13 Zheng Xu , Soham De , Mario Figueiredo , Christoph Studer , Tom Goldstein

In this paper, we investigate regrets of an online semi-proximal alternating direction method of multiplier (Online-spADMM) for solving online linearly constrained convex composite optimization problems. Under mild conditions, we establish…

Optimization and Control · Mathematics 2024-02-09 Yule Zhang , Zehao Xiao , Jia Wu , Liwei Zhang

We formulate the discrete-time inverse optimal control problem of inferring unknown parameters in the objective function of an optimal control problem from measurements of optimal states and controls as a nonlinear filtering problem. This…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Tian Zhao , Timothy L. Molloy

We study the problem of minimizing the sum of a smooth function and a nonsmooth convex regularizer over a compact Riemannian submanifold embedded in Euclidean space. By introducing an auxiliary splitting variable, we propose an adaptive…

Optimization and Control · Mathematics 2025-10-22 Kangkang Deng , Jiachen Jin , Jiang Hu , Hongxia Wang

This article introduces a new algorithm for nonlinear state estimation based on deterministic sigma point and EKF linearized framework for priori mean and covariance respectively. This method reduces the computation cost of UKF about 50%…

Systems and Control · Electrical Eng. & Systems 2019-07-25 Milad Behvandi , Mohammad Azam Khosravi , Amir Abolfazl Suratgar

This paper considers the problem of data-driven robust control design for nonlinear systems, for instance, obtained when discretizing nonlinear partial differential equations (PDEs). A robust learning control approach is developed for…

Optimization and Control · Mathematics 2025-09-01 Anant A. Joshi , Saviz Mowlavi , Mouhacine Benosman

We propose a novel type of nonlinear solver acceleration for systems of nonlinear partial differential equations (PDEs) that is based on online/adaptive learning. It is applied in the context of multiphase flow in porous media. The proposed…

Machine Learning · Computer Science 2025-04-28 Vinicius L S Silva , Pablo Salinas , Claire E Heaney , Matthew Jackson , Christopher C Pain

This paper studies the distributed state estimation problem for a class of discrete-time stochastic systems with nonlinear uncertain dynamics over time-varying topologies of sensor networks. An extended state vector consisting of the…

Systems and Control · Computer Science 2018-09-12 Xingkang He , Xiaocheng Zhang , Wenchao Xue , Haitao Fang

The Gaussian process state-space models (GPSSMs) represent a versatile class of data-driven nonlinear dynamical system models. However, the presence of numerous latent variables in GPSSM incurs unresolved issues for existing variational…

Machine Learning · Computer Science 2024-07-23 Zhidi Lin , Yiyong Sun , Feng Yin , Alexandre Hoang Thiéry

We study online linear optimization with matrix variables constrained by the operator norm, a setting where the geometry renders designing data-dependent and efficient adaptive algorithms challenging. The best-known adaptive regret bounds…

Optimization and Control · Mathematics 2026-02-10 Ruichen Jiang , Zakaria Mhammedi , Mehryar Mohri , Aryan Mokhtari

An open challenge in supervised learning is \emph{conceptual drift}: a data point begins as classified according to one label, but over time the notion of that label changes. Beyond linear autoregressive models, transfer and meta learning…

Optimization and Control · Mathematics 2019-09-13 Amrit Singh Bedi , Alec Koppel , Ketan Rajawat , Brian M. Sadler

This paper presents an algorithm to improve state estimation for legged robots. Among existing model-based state estimation methods for legged robots, the contact-aided invariant extended Kalman filter defines the state on a Lie group to…

Robotics · Computer Science 2026-01-29 Seokju Lee , Hyun-Bin Kim , Kyung-Soo Kim

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

Machine Learning · Computer Science 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

We propose a new algorithm for an adaptive optics system control law which allows to reduce the computational burden in the case of an Extremely Large Telescope (ELT) and to deal with non-stationary behaviors of the turbulence. This…

Instrumentation and Methods for Astrophysics · Physics 2015-06-17 Morgan Gray , Cyril Petit , Sergey Rodionov , Laurent Bertino , Marc Bocquet , Thierry Fusco