English
Related papers

Related papers: Implicit Regularization and Momentum Algorithms in…

200 papers

We introduce a new class of adaptive non-linear autoregressive (Nlar) models incorporating the concept of momentum, which dynamically estimate both the learning rates and momentum as the number of iterations increases. In our method, the…

Machine Learning · Computer Science 2024-12-03 Ramin Okhrati

Reasoning about the physical world requires models that are endowed with the right inductive biases to learn the underlying dynamics. Recent works improve generalization for predicting trajectories by learning the Hamiltonian or Lagrangian…

Machine Learning · Computer Science 2020-10-27 Marc Finzi , Ke Alexander Wang , Andrew Gordon Wilson

Recently, adversarial imitation learning has shown a scalable reward acquisition method for inverse reinforcement learning (IRL) problems. However, estimated reward signals often become uncertain and fail to train a reliable statistical…

Machine Learning · Computer Science 2023-01-06 Dong-Sig Han , Hyunseo Kim , Hyundo Lee , Je-Hwan Ryu , Byoung-Tak Zhang

We address the tracking problem for a class of uncertain non-affine nonlinear systems with high relative degrees, performing non-repetitive tasks. We propose a rigorously proven, robust adaptive learning control scheme that relies on a…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Shuai Gao , Dong Shen , Abdelhamid Tayebi

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics…

Robotics · Computer Science 2021-06-22 Spencer M. Richards , Navid Azizan , Jean-Jacques Slotine , Marco Pavone

Motivated by variational models in continuum mechanics, we introduce a novel algorithm to perform nonsmooth and nonconvex minimizations with linear constraints in Euclidean spaces. We show how this algorithm is actually a natural…

Analysis of PDEs · Mathematics 2015-03-20 Marco Artina , Massimo Fornasier , Francesco Solombrino

We propose a technique for the design and analysis of adaptation algorithms in dynamical systems. The technique applies both to systems with conventional Lyapunov-stable target dynamics and to ones of which the desired dynamics around the…

Optimization and Control · Mathematics 2007-05-23 Tyukin Ivan , Danil Prokhorov , Cees van Leeuwen

Model predictive control has emerged as an effective approach for real-time optimal control of connected and automated vehicles. However, nonlinear dynamics of vehicle and traffic systems make accurate modeling and real-time optimization…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Yunli Shao

This study presents a Bayesian learning perspective towards model predictive control algorithms. High-level frameworks have been developed separately in the earlier studies on Bayesian learning and sampling-based model predictive control.…

Machine Learning · Computer Science 2022-03-14 Namhoon Cho , Seokwon Lee , Hyo-Sang Shin , Antonios Tsourdos

In this paper we consider trajectory tracking problem for robotic systems affected by unknown external perturbations. Considering possible solutions, we restrict our attention to composite adaptation, which, particularly, ensures parametric…

Systems and Control · Electrical Eng. & Systems 2024-07-01 Anton Glushchenko , Konstantin Lastochkin

Learning-to-optimize is an emerging framework that seeks to speed up the solution of certain optimization problems by leveraging training data. Learned optimization solvers have been shown to outperform classical optimization algorithms in…

Optimization and Control · Mathematics 2023-02-27 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Carola-Bibiane Schönlieb

In this paper we propose a solution to the problem of parameter estimation of nonlinearly parameterized regressions--continuous or discrete time--and apply it for system identification and adaptive control. We restrict our attention to…

Optimization and Control · Mathematics 2019-10-18 Romeo Ortega , Vladislav Gromov , Emmanuel Nuño , Anton Pyrkin , Jose Guadalupe Romero

In this paper, we propose several set-point control schemes for achieving finite-time regulation in a class of Euler--Lagrange systems with $n$ degrees of freedom and uncertain potential energy. The proposed controllers are based on…

Optimization and Control · Mathematics 2026-05-12 Emmanuel Cruz-Zavala , Jaime A. Moreno , Antonio Loría

Given observations of a physical system, identifying the underlying non-linear governing equation is a fundamental task, necessary both for gaining understanding and generating deterministic future predictions. Of most practical relevance…

Numerical Analysis · Mathematics 2020-03-02 A. Goeßmann , M. Götte , I. Roth , R. Sweke , G. Kutyniok , J. Eisert

We study randomized variants of two classical algorithms: coordinate descent for systems of linear equations and iterated projections for systems of linear inequalities. Expanding on a recent randomized iterated projection algorithm of…

Optimization and Control · Mathematics 2008-06-19 D. Leventhal , A. S. Lewis

Trajectory optimization is an efficient approach for solving optimal control problems for complex robotic systems. It relies on two key components: first the transcription into a sparse nonlinear program, and second the corresponding solver…

Robotics · Computer Science 2022-10-31 Wilson Jallet , Antoine Bambade , Nicolas Mansard , Justin Carpentier

In this work, we consider optimal control problems for mechanical systems on vector spaces with fixed initial and free final state and a quadratic Lagrange term. Specifically, the dynamics is described by a second order ODE containing an…

Recently developed reduced-order modeling techniques aim to approximate nonlinear dynamical systems on low-dimensional manifolds learned from data. This is an effective approach for modeling dynamics in a post-transient regime where the…

Dynamical Systems · Mathematics 2023-09-27 Samuel E. Otto , Gregory R. Macchio , Clarence W. Rowley

Understanding the dynamics of neural network parameters during training is one of the key challenges in building a theoretical foundation for deep learning. A central obstacle is that the motion of a network in high-dimensional parameter…

Machine Learning · Computer Science 2021-03-30 Daniel Kunin , Javier Sagastuy-Brena , Surya Ganguli , Daniel L. K. Yamins , Hidenori Tanaka

Driven by the flexible manufacturing trend in the process control industry and the uncertain nature of chemical process models, this article aims to achieve offset-free tracking for a family of uncertain nonlinear systems (e.g., using…

Systems and Control · Electrical Eng. & Systems 2022-05-10 Lai Wei , Ryan McCloy , Jie Bao