English
Related papers

Related papers: Natural Gradient Descent for Control

200 papers

In this paper we consider a recently developed distributed optimization algorithm based on gradient tracking. We propose a system theory framework to analyze its structural properties on a preliminary, quadratic optimization set-up.…

Systems and Control · Electrical Eng. & Systems 2020-06-03 Michelangelo Bin , Ivano Notarnicola , Lorenzo Marconi , Giuseppe Notarstefano

Feedback optimization is a control paradigm that enables physical systems to autonomously reach efficient operating points. Its central idea is to interconnect optimization iterations in closed-loop with the physical plant. Since iterative…

Optimization and Control · Mathematics 2024-07-16 Zhiyu He , Saverio Bolognani , Jianping He , Florian Dörfler , Xinping Guan

Natural gradient descent, which preconditions a gradient descent update with the Fisher information matrix of the underlying statistical model, is a way to capture partial second-order information. Several highly visible works have…

Machine Learning · Computer Science 2020-06-09 Frederik Kunstner , Lukas Balles , Philipp Hennig

Nonlinear control-affine systems with time-varying vector fields are considered in the paper. We propose a unified control design scheme with oscillating inputs for solving the trajectory tracking and stabilization problems. This…

Optimization and Control · Mathematics 2023-10-31 Victoria Grushkovskaya , Alexander Zuyev

In this paper, we propose new structured second-order methods and structured adaptive-gradient methods obtained by performing natural-gradient descent on structured parameter spaces. Natural-gradient descent is an attractive approach to…

Machine Learning · Statistics 2022-02-22 Wu Lin , Frank Nielsen , Mohammad Emtiyaz Khan , Mark Schmidt

In a Hilbert setting, for convex differentiable optimization, we develop a general framework for adaptive accelerated gradient methods. They are based on damped inertial dynamics where the coefficients are designed in a closed-loop way.…

Optimization and Control · Mathematics 2025-01-28 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

In this paper, we propose several rules to tune the gains for a class of passivity-based controllers for nonlinear mechanical systems. Such tuning rules prescribe a desired local transient response behavior to the closed-loop system. To…

Systems and Control · Electrical Eng. & Systems 2020-12-18 Carmen Chan-Zheng , Pablo Borja , Jacquelien M. A. Scherpen

In this paper, we analyze the optimization landscape of gradient descent methods for static output feedback (SOF) control of discrete-time linear time-invariant systems with quadratic cost. The SOF setting can be quite common, for example,…

Optimization and Control · Mathematics 2023-10-31 Jingliang Duan , Jie Li , Shengbo Eben Li , Lin Zhao

From the perspective of control theory, the gradient descent optimization methods can be regarded as a dynamic system where various control techniques can be designed to enhance the performance of the optimization method. In this paper, we…

Optimization and Control · Mathematics 2025-03-19 Osama F. Abdel Aal , Necdet Sinan Ozbek , Jairo Viola , YangQuan Chen

Real-world physics can only be analytically modeled with a certain level of precision for modern intricate robotic systems. As a result, tracking aggressive trajectories accurately could be challenging due to the existence of residual…

Robotics · Computer Science 2026-04-16 Kexin Guo , Zihan Yang , Yuhang Liu , Jindou Jia , Xiang Yu

Modern automated driving solutions utilize trajectory planning and control components with numerous parameters that need to be tuned for different driving situations and vehicle types to achieve optimal performance. This paper proposes a…

Systems and Control · Electrical Eng. & Systems 2024-06-26 Hung-Ju Wu , Vladislav Nenchev , Christian Rathgeber

A new framework is developed for control of constrained nonlinear systems with structured parametric uncertainties. Forward invariance of a safe set is achieved through online parameter adaptation and data-driven model estimation. The new…

Systems and Control · Electrical Eng. & Systems 2020-06-01 Brett T. Lopez , Jean-Jacques E. Slotine , Jonathan P. How

Motion planning and control are two core components of the robotic systems autonomy stack. The standard approach to combine these methodologies comprises an offline/open-loop stage, planning, that designs a feasible and safe trajectory to…

Systems and Control · Electrical Eng. & Systems 2023-10-23 Tianqi Zheng , John W. Simpson-Porco , Enrique Mallada

The natural gradient descent optimisation technique is an efficient optimising protocol for broad classes of classical and quantum systems that takes the underlying geometry of the parameter manifold into account by means of using either…

Quantum Physics · Physics 2026-04-08 Ankit Gill , Kunal Pal

Generating collision-free and smooth motions remains a central challenge in robotic manipulation, particularly in cluttered environments and narrow passages where feasible regions are highly constrained and fragmented. We propose a…

Robotics · Computer Science 2026-05-28 Kisang Park , Chanwoo Kim , Kyungjae Lee , Sungjoon Choi

A novel method for control of dynamical systems, proposed in the paper, ensures an output signal belonging to the given set at any time. The method is based on a special change of coordinates such that the initial problem with given…

Systems and Control · Electrical Eng. & Systems 2019-12-19 Igor Furtat

Natural gradient descent is a principled method for adapting the parameters of a statistical model on-line using an underlying Riemannian parameter space to redefine the direction of steepest descent. The algorithm is examined via methods…

Disordered Systems and Neural Networks · Physics 2009-10-31 Magnus Rattray , David Saad

Quantum natural gradient has emerged as a superior minimisation technique in quantum variational algorithms. Classically simulating the algorithm running on near-future quantum hardware is paramount in its study, as it is for all…

Quantum Physics · Physics 2020-11-06 Tyson Jones

We propose a data-driven online convex optimization algorithm for controlling dynamical systems. In particular, the control scheme makes use of an initially measured input-output trajectory and behavioral systems theory which enable it to…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

Privacy-preserving training on sensitive data commonly relies on differentially private stochastic optimization with gradient clipping and Gaussian noise. The clipping threshold is a critical control knob: if set too small, systematic…

Machine Learning · Computer Science 2026-02-12 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen