English
Related papers

Related papers: Approximation and exact penalization in simple bil…

200 papers

Classically, a mainstream approach for solving a convex-concave min-max problem is to instead solve the variational inequality problem arising from its first-order optimality conditions. Is it possible to solve min-max problems faster by…

Optimization and Control · Mathematics 2025-11-06 Henry Shugart , Jason M. Altschuler

Lifting methods allow to transform hard variational problems such as segmentation and optical flow estimation into convex problems in a suitable higher-dimensional space. The lifted models can then be efficiently solved to a global optimum,…

Numerical Analysis · Mathematics 2019-08-13 Thomas Vogt , Evgeny Strekalovskiy , Daniel Cremers , Jan Lellmann

In this paper, we are concerned with the sign-changing solutions of variational inequality problems. In order to give the existence results of the sign-changing solutions for variational inequality problems, we first construct a suitable…

Analysis of PDEs · Mathematics 2024-04-19 Xu Xian , Wang Taotao

We consider a general decomposable convex optimization problem. By using right-hand side allocation technique, it can be transformed into a collection of small dimensional optimization problems. The master problem is a convex non-smooth…

Optimization and Control · Mathematics 2020-10-05 Igor V. Konnov

Optimization problems, generalized equations, and the multitude of other variational problems invariably lead to the analysis of sets and set-valued mappings as well as their approximations. We review the central concept of set-convergence…

Optimization and Control · Mathematics 2020-02-25 Johannes O. Royset

We consider a bilevel problem involving two monotone equilibrium bifunctions and we show that this problem can be solved by a proximal point method with generalized proximal distances. We propose a framework for the convergence analysis of…

Optimization and Control · Mathematics 2014-07-09 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , P. A. Soares , A. Soubeyran

In optimization-based image restoration models, the correct selection of hyperparameters is crucial for achieving superior performance. However, current research typically involves manual tuning of these hyperparameters, which is highly…

Optimization and Control · Mathematics 2026-04-03 Hang Xie , Xuewen Li , Peili Li , Qiuyu Wang

We consider the problem of approximating the solution of variational problems subject to the constraint that the admissible functions must be convex. This problem is at the interface between convex analysis, convex optimization, variational…

Numerical Analysis · Mathematics 2015-03-19 Adam M. Oberman

We consider a multiobjective bilevel optimization problem with vector-valued upper- and lower-level objective functions. Such problems have attracted a lot of interest in recent years. However, so far, scalarization has appeared to be the…

Optimization and Control · Mathematics 2022-01-05 Lahoussine Lafhim , Alain Zemkoho

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

Machine Learning · Computer Science 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

In this paper, we propose a penalty dual-primal augmented lagrangian method for solving convex minimization problems under linear equality or inequality constraints. The proposed method combines a novel penalty technique with updates the…

Optimization and Control · Mathematics 2023-05-09 Jie Liu , Xiaoqing Ou , Jiawei Chen

Recent quasi-optimal error estimates for the finite element approximation of total-variation regularized minimization problems require the existence of a Lipschitz continuous dual solution. We discuss the validity of this condition and…

Numerical Analysis · Mathematics 2021-06-28 Sören Bartels , Robert Tovey , Friedrich Wassmer

We introduce a new system of split variational inequality problems which is a natural extension of split variational inequality problem in semi-inner product spaces. We use the retraction technique to propose an iterative algorithm for…

Functional Analysis · Mathematics 2017-01-20 K. R. Kazmi , Mohd Furkan

Interest in bilevel optimization has grown in recent years, partially due to its applications to tackle challenging machine-learning problems. Several exciting recent works have been centered around developing efficient gradient-based…

Optimization and Control · Mathematics 2024-08-27 Liuyuan Jiang , Quan Xiao , Victor M. Tenorio , Fernando Real-Rojas , Antonio G. Marques , Tianyi Chen

In this work, we investigate the convergence of numerical approximations to coercivity constants of variational problems. These constants are essential components of rigorous error bounds for reduced-order modeling; extension of these…

Numerical Analysis · Mathematics 2022-05-25 Peter Sentz , Jehanzeb Hameed Chaudhry , Luke N. Olson

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

This paper studies a class of simple bilevel optimization problems where we minimize a composite convex function at the upper-level subject to a composite convex lower-level problem. Existing methods either provide asymptotic guarantees for…

Optimization and Control · Mathematics 2024-03-06 Jiulin Wang , Xu Shi , Rujun Jiang

The paper presents complexity results and performance guaranties for a family of approximation algorithms for an optimisation problem arising in software testing and manufacturing. The problem is formulated as a partitioning of a set where…

Data Structures and Algorithms · Computer Science 2022-12-13 Yakov Zinder , Bertrand M. T. Lin , Joanna Berlińska

Low rank approximation is a commonly occurring problem in many computer vision and machine learning applications. There are two common ways of optimizing the resulting models. Either the set of matrices with a given rank can be explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution…

Machine Learning · Computer Science 2015-02-23 Pierre Baqué , Jean-Hubert Hours , François Fleuret , Pascal Fua