English
Related papers

Related papers: An Optimal Control Approach to Early Stopping Vari…

200 papers

We consider a nonlinear control system with vector-valued measures as controls and with dynamics depending on time delayed states. First, we introduce a notion of discontinuous, bounded variation solution associated with this system and…

Optimization and Control · Mathematics 2024-09-02 Giovanni Fusco , Monica Motta , Richard Vinter

Motion planning under differential constraints is a classic problem in robotics. To date, the state of the art is represented by sampling-based techniques, with the Rapidly-exploring Random Tree algorithm as a leading example. Yet, the…

Robotics · Computer Science 2015-03-03 Edward Schmerling , Lucas Janson , Marco Pavone

The present paper deals with the data-driven design of regularizers in the form of artificial neural networks, for solving certain inverse problems formulated as optimal control problems. These regularizers aim at improving accuracy,…

Optimization and Control · Mathematics 2023-03-06 Sebastien Court

Classifier guidance -- using the gradients of an image classifier to steer the generations of a diffusion model -- has the potential to dramatically expand the creative control over image generation and editing. However, currently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Bram Wallace , Akash Gokul , Stefano Ermon , Nikhil Naik

In this paper, we provide a mathematical framework for improving generalization in a class of learning problems which is related to point estimations for modeling of high-dimensional nonlinear functions. In particular, we consider a…

Optimization and Control · Mathematics 2024-12-13 Getachew K. Befekadu

Interpretation of Deep Neural Networks (DNNs) training as an optimal control problem with nonlinear dynamical systems has received considerable attention recently, yet the algorithmic development remains relatively limited. In this work, we…

Machine Learning · Computer Science 2021-06-14 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

Learning is a complex dynamical process shaped by a range of interconnected decisions. Careful design of hyperparameter schedules for artificial neural networks or efficient allocation of cognitive resources by biological learners can…

Disordered Systems and Neural Networks · Physics 2025-07-11 Francesca Mignacco , Francesco Mori

Many tasks in machine learning and signal processing can be solved by minimizing a convex function of a measure. This includes sparse spikes deconvolution or training a neural network with a single hidden layer. For these problems, we study…

Optimization and Control · Mathematics 2018-10-30 Lenaic Chizat , Francis Bach

Existing approaches to diffusion-based inverse problem solvers frame the signal recovery task as a probabilistic sampling episode, where the solution is drawn from the desired posterior distribution. This framework suffers from several…

Machine Learning · Computer Science 2024-12-24 Henry Li , Marcus Pereira

The remarkable success of diffusion and flow-matching models has ignited a surge of works on adapting them at test time for controlled generation tasks. Examples range from image editing to restoration, compression and personalization.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Or Ronai , Vladimir Kulikov , Tomer Michaeli

We consider the problem of learning observation models for robot state estimation with incremental non-differentiable optimizers in the loop. Convergence to the correct belief over the robot state is heavily dependent on a proper tuning of…

Robotics · Computer Science 2023-09-07 Mohamad Qadri , Michael Kaess

This study proposes a method for designing stabilizing suboptimal controllers for nonlinear stochastic systems. These systems include time-invariant stochastic parameters that represent uncertainty of dynamics, posing two key difficulties…

Optimization and Control · Mathematics 2025-01-22 Yuji Ito , Kenji Fujimoto

We transpose an optimal control technique to the image segmentation problem. The idea is to consider image segmentation as a parameter estimation problem. The parameter to estimate is the color of the pixels of the image. We use the…

Numerical Analysis · Mathematics 2011-05-24 Hend Ben Ameur , Guy Chavent , Francois Clément , Pierre Weis

Discrete gradient methods are well-known methods of Geometric Numerical Integration, which preserve the dissipation of gradient systems. The preservation of the dissipation of a system is an important feature in numerous image processing…

Numerical Analysis · Mathematics 2016-03-25 V Grimm , R I McLachlan , D McLaren , G R W Quispel , C-B Schönlieb

In this paper, we consider the nonsmooth convex optimization problems over the fixed point constraint sets of firmly nonexpansive operators. To find an optimal solution of the problem, we present an iterative method based on the hybrid…

Optimization and Control · Mathematics 2026-03-23 Ontima Pankoon , Nimit Nimana , Yeol Je Cho

In overparameterized logistic regression, gradient descent (GD) iterates diverge in norm while converging in direction to the maximum $\ell_2$-margin solution -- a phenomenon known as the implicit bias of GD. This work investigates…

Machine Learning · Computer Science 2025-07-01 Jingfeng Wu , Peter Bartlett , Matus Telgarsky , Bin Yu

Selecting the best regularization parameter in inverse problems is a classical and yet challenging problem. Recently, data-driven approaches have become popular to tackle this challenge. These approaches are appealing since they do require…

Statistics Theory · Mathematics 2025-10-22 Jonathan Chirinos Rodriguez , Ernesto De Vito , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

Real-time computation of optimal control is a challenging problem and, to solve this difficulty, many frameworks proposed to use learning techniques to learn (possibly sub-optimal) controllers and enable their usage in an online fashion.…

Diffusion and flow-based generative models have shown strong potential for image restoration. However, image denoising under unknown and varying noise conditions remains challenging, because the learned vector fields may become inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jigang Duan , Genwei Ma , Xu Jiang , Wenfeng Xu , Ping Yang , Xing Zhao

The paper addresses an optimal control problem for a perturbed sweeping process of the rate-independent hysteresis type described by a controlled "play and stop" operator with separately controlled perturbations. This problem can be reduced…

Optimization and Control · Mathematics 2015-12-01 Tan H. Cao , Boris S. Mordukhovich