English
Related papers

Related papers: Glocal Hypergradient Estimation with Koopman Opera…

200 papers

Most modern reinforcement learning algorithms optimize a cumulative single-step cost along a trajectory. The optimized motions are often 'unnatural', representing, for example, behaviors with sudden accelerations that waste energy and lack…

Machine Learning · Computer Science 2024-07-03 Motoya Ohnishi , Isao Ishikawa , Kendall Lowrey , Masahiro Ikeda , Sham Kakade , Yoshinobu Kawahara

This paper deals with a network of computing agents aiming to solve an online optimization problem in a distributed fashion, i.e., by means of local computation and communication, without any central coordinator. We propose the gradient…

Optimization and Control · Mathematics 2023-09-13 Guido Carnevale , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

Standard first-order stochastic optimization algorithms base their updates solely on the average mini-batch gradient, and it has been shown that tracking additional quantities such as the curvature can help de-sensitize common…

Machine Learning · Computer Science 2020-11-11 Ricky T. Q. Chen , Dami Choi , Lukas Balles , David Duvenaud , Philipp Hennig

Accurate driver behavior modeling is essential for improving the interaction and cooperation of the human driver with the driver assistance system. This paper presents a novel approach for modeling the response of human drivers to visual…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Mehmet Fatih Ozkan , Jeff Chrstos , Marcello Canova , Stephanie Stockar

Nonlinear optimal control is vital for numerous applications but remains challenging for unknown systems due to the difficulties in accurately modelling dynamics and handling computational demands, particularly in high-dimensional settings.…

Systems and Control · Electrical Eng. & Systems 2024-12-03 Zhexuan Zeng , Ruikun Zhou , Yiming Meng , Jun Liu

In the development of model predictive controllers for PDE-constrained problems, the use of reduced order models is essential to enable real-time applicability. Besides local linearization approaches, Proper Orthogonal Decomposition (POD)…

Optimization and Control · Mathematics 2020-12-15 Sebastian Peitz , Stefan Klus

Operator learning offers a powerful paradigm for solving parametric partial differential equations (PDEs), but scaling probabilistic neural operators such as the recently proposed Gaussian Processes Operators (GPOs) to high-dimensional,…

Machine Learning · Statistics 2025-06-23 Sawan Kumar , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty

Most machine learning algorithms are configured by one or several hyperparameters that must be carefully chosen and often considerably impact performance. To avoid a time consuming and unreproducible manual trial-and-error process to find…

Many large-scale constrained optimization problems can be formulated as bilevel distributed optimization tasks over undirected networks, where agents collaborate to minimize a global cost function while adhering to constraints, relying only…

Optimization and Control · Mathematics 2025-11-25 Ajay Tak , Mayank Baranwal

Representing nonlinear dynamical systems using the Koopman Operator and its spectrum has distinct advantages in terms of linear interpretability of the model as well as in analysis and control synthesis through the use of well-studied…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Shankar A. Deka , Umesh Vaidya

Koopman operator theory has found significant success in learning models of complex, real-world dynamical systems, enabling prediction and control. The greater interpretability and lower computational costs of these models, compared to…

Dynamical Systems · Mathematics 2025-01-08 William T. Redman , Dean Huang , Maria Fonoberova , Igor Mezić

Trajectory optimization is a widely used tool in the design and control of dynamical systems. Typically, not only nonlinear dynamics, but also couplings of the initial and final condition through implicit boundary constraints render the…

Optimization and Control · Mathematics 2024-12-05 Mohamed Abou-Taleb , Maximilian Raff , Kathrin Flaßkamp , C. David Remy

In this thesis, we propose new theoretical frameworks for the analysis of stochastic and distributed methods with error compensation and local updates. Using these frameworks, we develop more than 20 new optimization methods, including the…

Optimization and Control · Mathematics 2021-12-21 Eduard Gorbunov

We explore why many recently proposed robust estimation problems are efficiently solvable, even though the underlying optimization problems are non-convex. We study the loss landscape of these robust estimation problems, and identify the…

Machine Learning · Statistics 2020-05-29 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation…

Optimization and Control · Mathematics 2020-02-17 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

We introduce optimization methods for convolutional neural networks that can be used to improve existing gradient-based optimization in terms of generalization error. The method requires only simple processing of existing stochastic…

Machine Learning · Computer Science 2020-08-26 Dong Lao , Peihao Zhu , Peter Wonka , Ganesh Sundaramoorthi

Autonomous driving technologies have received notable attention in the past decades. In autonomous driving systems, identifying a precise dynamical model for motion control is nontrivial due to the strong nonlinearity and uncertainty in…

Systems and Control · Electrical Eng. & Systems 2023-08-11 Yongqian Xiao , Xinglong Zhang , Xin Xu , Xueqing Liu , Jiahang Liu

The Koopman operator provides a principled framework for analyzing nonlinear dynamical systems through linear operator theory. Recent advances in dynamic mode decomposition (DMD) have shown that trajectory data can be used to identify…

Machine Learning · Computer Science 2026-01-21 Minchan Jeong , J. Jon Ryu , Se-Young Yun , Gregory W. Wornell

Mastering a skill generally relies on both hands-on experience from doers and insightful, high-level guidance by mentors. Will this strategy also work well for solving complex non-convex optimization problems? Here, a common gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Zixian Guo , Ming Liu , Zhilong Ji , Jinfeng Bai , Yiwen Guo , Wangmeng Zuo

This paper studies a distributed multi-agent convex optimization problem. The system comprises multiple agents in this problem, each with a set of local data points and an associated local cost function. The agents are connected to a…

Optimization and Control · Mathematics 2021-08-20 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra