English
Related papers

Related papers: Optimality Conditions for Bilevel Imaging Learning…

200 papers

The mathematical modeling of numerous real-world applications results in hierarchical optimization problems with two decision makers where at least one of them has to solve an optimal control problem of ordinary or partial differential…

Optimization and Control · Mathematics 2019-06-20 Patrick Mehlitz , Gerd Wachsmuth

We investigate local optimality conditions of first and second order for integer optimal control problems with total variation regularization via a finite-dimensional switching point problem. We show the equivalence of local optimality for…

Optimization and Control · Mathematics 2024-11-13 Jonas Marko , Gerd Wachsmuth

Motivated by its practical success, we show that the two-dimensional total variation denoiser satisfies a sharp oracle inequality that leads to near optimal rates of estimation for a large class of image models such as bi-isotonic, H\"older…

Statistics Theory · Mathematics 2016-06-17 Jan-Christian Hütter , Philippe Rigollet

In this article, we investigate a time-optimal state-constrained bilevel optimal control problem whose lower-level dynamics feature a sweeping control process involving a {\it truncated normal cone}. By bilevel, it is meant that the…

Optimization and Control · Mathematics 2022-01-07 Nathalie T. Khalil , Fernando Lobo Pereira

Bilevel optimization and bilevel minimax optimization have recently emerged as unifying frameworks for a range of machine-learning tasks, including hyperparameter optimization and reinforcement learning. The existing literature focuses on…

Machine Learning · Computer Science 2026-04-23 Xuelin Zhang , Peipei Yuan

We consider the problem of learning error covariance matrices for robotic state estimation. The convergence of a state estimator to the correct belief over the robot state is dependent on the proper tuning of noise models. During inference,…

Robotics · Computer Science 2023-09-19 Mohamad Qadri , Zachary Manchester , Michael Kaess

This chapter presents a self-contained approach of variational analysis and generalized differentiation to deriving necessary optimality in problems of bilevel optimization with Lipschitzian data. We mainly concentrate on optimistic models,…

Optimization and Control · Mathematics 2019-07-16 Boris S. Mordukhovich

Bilevel optimization is an important formulation for many machine learning problems. Current bilevel optimization algorithms assume that the gradient of the upper-level function is Lipschitz. However, recent studies reveal that certain…

Machine Learning · Computer Science 2024-01-19 Jie Hao , Xiaochuan Gong , Mingrui Liu

In this paper we consider the problem of learning variational models in the context of supervised learning via risk minimization. Our goal is to provide a deeper understanding of the two approaches of learning of variational models via…

Machine Learning · Statistics 2023-09-07 Christoph Brauer , Niklas Breustedt , Timo de Wolff , Dirk A. Lorenz

Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both the lower and upper levels are constrained on Riemannian…

Optimization and Control · Mathematics 2024-11-05 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Akiko Takeda

We consider optimization problems with a disjunctive structure of the constraints. Prominent examples of such problems are mathematical programs with equilibrium constraints or vanishing constraints. Based on the concepts of directional…

Optimization and Control · Mathematics 2016-11-28 Helmut Gfrerer

A class of mixed-order \emph{PDE}-constraint regularizer for image processing problem is proposed, generalizing the standard first order total variation $(TV)$. A semi-supervised (bilevel) training scheme, which provides a simultaneous…

Analysis of PDEs · Mathematics 2019-03-19 Pan Liu

We consider the problem of decomposing a higher-order tensor with binary entries. Such data problems arise frequently in applications such as neuroimaging, recommendation system, topic modeling, and sensor network localization. We propose a…

Machine Learning · Statistics 2020-09-22 Miaoyan Wang , Lexin Li

The aim of this paper is to introduce and study a two-step debiasing method for variational regularization. After solving the standard variational problem, the key idea is to add a consecutive debiasing step minimizing the data fidelity on…

Numerical Analysis · Mathematics 2017-06-23 Eva-Maria Brinkmann , Martin Burger , Julian Rasch , Camille Sutour

In this work we consider a generalized bilevel optimization framework for solving inverse problems. We introduce fractional Laplacian as a regularizer to improve the reconstruction quality, and compare it with the total variation…

Image and Video Processing · Electrical Eng. & Systems 2020-06-24 Harbir Antil , Zichao Di , Ratna Khatri

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

This paper introduces a novel double regularization scheme for bilevel optimization problems whose lower-level problem is composite and convex, but not necessarily strongly convex, in the lower-level variable. The analysis focuses on the…

Optimization and Control · Mathematics 2026-02-06 Mattia Solla , Johannes O. Royset

We present a method for supervised learning of sparsity-promoting regularizers for denoising signals and images. Sparsity-promoting regularization is a key ingredient in solving modern signal reconstruction problems; however, the operators…

Machine Learning · Computer Science 2023-09-07 Avrajit Ghosh , Michael T. McCann , Madeline Mitchell , Saiprasad Ravishankar

This paper is concerned with the derivation of first- and second-order sufficient optimality conditions for optimistic bilevel optimization problems involving smooth functions. First-order sufficient optimality conditions are obtained by…

Optimization and Control · Mathematics 2019-11-06 Patrick Mehlitz , Alain B. Zemkoho

Enhancing images in low-light scenes is a challenging but widely concerned task in the computer vision. The mainstream learning-based methods mainly acquire the enhanced model by learning the data distribution from the specific scenes,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Long Ma , Dian Jin , Nan An , Jinyuan Liu , Xin Fan , Risheng Liu