English
Related papers

Related papers: Control Disturbance Rejection in Neural ODEs

200 papers

Probabilistic models often use neural networks to control their predictive uncertainty. However, when making out-of-distribution (OOD)} predictions, the often-uncontrollable extrapolation properties of neural networks yield poor uncertainty…

Machine Learning · Computer Science 2022-01-19 Pierre Segonne , Yevgen Zainchkovskyy , Søren Hauberg

Learning to learn has emerged as an important direction for achieving artificial intelligence. Two of the primary barriers to its adoption are an inability to scale to larger problems and a limited ability to generalize to new tasks. We…

Controlling continuous-time dynamical systems is generally a two step process: first, identify or model the system dynamics with differential equations, then, minimize the control objectives to achieve optimal control function and optimal…

Artificial Intelligence · Computer Science 2024-04-23 Cheng Chi

Motivated by emerging applications in machine learning, we consider an optimization problem in a general form where the gradient of the objective function is available through a biased stochastic oracle. We assume a bias-control parameter…

Optimization and Control · Mathematics 2026-02-10 Yin Liu , Sam Davanloo Tajbakhsh

Rapid advances in data collection and processing capabilities have allowed for the use of increasingly complex models that give rise to nonconvex optimization problems. These formulations, however, can be arbitrarily difficult to solve in…

Multiagent Systems · Computer Science 2020-04-01 Stefan Vlaski , Ali H. Sayed

We address the tracking problem for a class of uncertain non-affine nonlinear systems with high relative degrees, performing non-repetitive tasks. We propose a rigorously proven, robust adaptive learning control scheme that relies on a…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Shuai Gao , Dong Shen , Abdelhamid Tayebi

Designing controllers that achieve task objectives while ensuring safety is a key challenge in control systems. This work introduces Opt-ODENet, a Neural ODE framework with a differentiable Quadratic Programming (QP) optimization layer to…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Keyan Miao , Liqun Zhao , Han Wang , Konstantinos Gatsis , Antonis Papachristodoulou

This paper extends algorithms that remove the fixed point bias of decentralized gradient descent to solve the more general problem of distributed optimization over subspace constraints. Leveraging the integral quadratic constraint…

Optimization and Control · Mathematics 2022-10-31 Dennis J. Marquis , Dany Abou Jaoude , Mazen Farhood , Craig A. Woolsey

This thesis is concerned with the rejection of time-varying disturbances in linear model predictive control of discrete-time systems. In the literature, disturbances are widely rejected by using velocity models, disturbance model with…

Systems and Control · Electrical Eng. & Systems 2022-10-04 Isah Abdulrasheed Jimoh

Online minimization of an unknown convex function over the interval $[0,1]$ is considered under first-order stochastic bandit feedback, which returns a random realization of the gradient of the function at each query point. Without knowing…

Machine Learning · Statistics 2020-02-21 Sattar Vakili , Sudeep Salgia , Qing Zhao

We study the problem of online non-stochastic control (ONC), which is the control of a linear system under adversarial disturbances and adversarial cost functions, with the aim of minimizing the total cost incurred. A recent line of…

Optimization and Control · Mathematics 2026-04-21 Vijeth Hebbar , Spencer Hutchinson , Mahnoosh Alizadeh , Cédric Langbort

Learning-based optimal control algorithms control unknown systems using past trajectory data and a learned model of the system dynamics. These controllers use either a linear approximation of the learned dynamics, trading performance for…

Systems and Control · Electrical Eng. & Systems 2023-07-21 Adam W. Hall , Melissa Greeff , Angela P. Schoellig

In this paper we investigate infinite horizon optimal control problems for parametrized partial differential equations. We are interested in feedback control via dynamic programming equations which is well-known to suffer from the curse of…

Optimization and Control · Mathematics 2018-10-02 Alessandro Alla , Bernard Haasdonk , Andreas Schmidt

Neural ordinary differential equations are an attractive option for modelling temporal dynamics. However, a fundamental issue is that the solution to an ordinary differential equation is determined by its initial condition, and there is no…

Machine Learning · Computer Science 2020-11-06 Patrick Kidger , James Morrill , James Foster , Terry Lyons

Numerous empirical evidence has corroborated that the noise plays a crucial rule in effective and efficient training of neural networks. The theory behind, however, is still largely unknown. This paper studies this fundamental problem…

Machine Learning · Computer Science 2019-09-10 Mo Zhou , Tianyi Liu , Yan Li , Dachao Lin , Enlu Zhou , Tuo Zhao

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

Machine Learning · Computer Science 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

Machine Learning · Statistics 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

Training dynamic models, such as neural ODEs, on long trajectories is a hard problem that requires using various tricks, such as trajectory splitting, to make model training work in practice. These methods are often heuristics with poor…

Machine Learning · Computer Science 2023-02-09 Valerii Iakovlev , Cagatay Yildiz , Markus Heinonen , Harri Lähdesmäki

When an online learning algorithm is used to estimate the unknown parameters of a model, the signals interacting with the parameter estimates should not decay too quickly for the optimal values to be discovered correctly. This requirement…

Machine Learning · Computer Science 2019-11-05 Kamil Nar , S. Shankar Sastry

We propose an approach to design a Model Predictive Controller (MPC) for constrained Linear Time Invariant systems performing an iterative task. The system is subject to an additive disturbance, and the goal is to learn to satisfy state and…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Monimoy Bujarbaruah , Akhil Shetty , Kameshwar Poolla , Francesco Borrelli