English
Related papers

Related papers: An optimization-based approach to parameter learni…

200 papers

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

Parametric stochastic simulators are ubiquitous in science, often featuring high-dimensional input parameters and/or an intractable likelihood. Performing Bayesian parameter inference in this context can be challenging. We present a neural…

Machine Learning · Statistics 2021-10-27 Benjamin Kurt Miller , Alex Cole , Patrick Forré , Gilles Louppe , Christoph Weniger

Nonlinear optimisation techniques are commonly employed to minimise complex cost functions, with their effectiveness determined largely by the structure of the underlying error landscape. These methods require initial parameter values, and…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Tilo Strutz

Learning to control unknown nonlinear dynamical systems is a fundamental problem in reinforcement learning and control theory. A commonly applied approach is to first explore the environment (exploration), learn an accurate model of it…

Machine Learning · Computer Science 2023-06-16 Andrew Wagenmaker , Guanya Shi , Kevin Jamieson

The study of optimal control problems under uncertainty plays an important role in scientific numerical simulations. This class of optimization problems is strongly utilized in engineering, biology and finance. In this paper, a stochastic…

Optimization and Control · Mathematics 2023-04-06 Caroline Geiersbach , Teresa Scarinci

We consider the problem of learning observation models for robot state estimation with incremental non-differentiable optimizers in the loop. Convergence to the correct belief over the robot state is heavily dependent on a proper tuning of…

Robotics · Computer Science 2023-09-07 Mohamad Qadri , Michael Kaess

In this article a special class of nonlinear optimal control problems involving a bilinear term in the boundary condition is studied. These kind of problems arise for instance in the identification of an unknown space-dependent Robin…

Numerical Analysis · Mathematics 2024-12-20 Max Winkler

Ordinary Differential Equations are a simple but powerful framework for modeling complex systems. Parameter estimation from times series can be done by Nonlinear Least Squares (or other classical approaches), but this can give…

Methodology · Statistics 2014-10-29 Quentin Clairon , Nicolas Brunel

Bearing-based distributed formation control is attractive because it can be implemented using vision-based measurements to achieve a desired formation. Gradient-descent-based controllers using bearing measurements have been shown to have…

Systems and Control · Electrical Eng. & Systems 2022-03-25 Zili Wang , Sean B. Andersson , Roberto Tron

Stochastic gradient descent algorithms for training linear and kernel predictors are gaining more and more importance, thanks to their scalability. While various methods have been proposed to speed up their convergence, the model selection…

Machine Learning · Computer Science 2014-06-17 Francesco Orabona

Projection-based reduced order models are effective at approximating parameter-dependent differential equations that are parametrically separable. When parametric separability is not satisfied, which occurs in both linear and nonlinear…

Numerical Analysis · Mathematics 2021-10-22 Peter Sentz , Kristian Beckwith , Eric C. Cyr , Luke N. Olson , Ravi Patel

In this paper, we propose a Transformer-based framework for approximating solutions to infinite-dimensional optimization problems: calculus of variations problems and optimal control problems. Our approach leverages offline training on data…

Optimization and Control · Mathematics 2025-11-20 Gage MacLin , Venanzio Cichella , Andrew Patterson , Irene Gregory

When considering an unconstrained minimization problem, a standard approach is to solve the optimality system with a Newton method possibly preconditioned by, e.g., nonlinear elimination. In this contribution, we argue that nonlinear…

Numerical Analysis · Mathematics 2024-09-04 Gabriele Ciaremalla , Tommaso Vanzan

This work presents a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art…

Numerical Analysis · Mathematics 2020-10-28 Peter Benner , Pawan Goyal , Boris Kramer , Benjamin Peherstorfer , Karen Willcox

Online parameter identification is of importance, e.g., for model predictive control. Since the parameters have to be identified simultaneously to the process of the modeled system, dynamical update laws are used for state and parameter…

Numerical Analysis · Mathematics 2016-04-20 Romana Boiger , Barbara Kaltenbacher

In this study, we develop a stochastic optimal control approach with reinforcement learning structure to learn the unknown parameters appeared in the drift and diffusion terms of the stochastic differential equation. By choosing an…

Optimization and Control · Mathematics 2023-08-22 Shuzhen Yang

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

This paper presents a machine learning approach for tuning the parameters of a family of stabilizing controllers for orbital tracking. An augmented random search algorithm is deployed, which aims at minimizing a cost function combining…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Gianni Bianchini , Andrea Garulli , Antonio Giannitrapani , Mirko Leomanni , Renato Quartullo

This study proposes a method for designing stabilizing suboptimal controllers for nonlinear stochastic systems. These systems include time-invariant stochastic parameters that represent uncertainty of dynamics, posing two key difficulties…

Optimization and Control · Mathematics 2025-01-22 Yuji Ito , Kenji Fujimoto

In this work, we investigate a particular class of shape optimization problems under uncertainties on the input parameters. More precisely, we are interested in the minimization of the expectation of a quadratic objective in a situation…

Optimization and Control · Mathematics 2015-06-01 M. Dambrine , C. Dapogny , H. Harbrecht