English
Related papers

Related papers: Source reconstruction using a bilevel optimisation…

200 papers

A new sampling method for inverse scattering problems is proposed to process far field data of one incident wave. As the linear sampling method, the method sets up ill-posed integral equations and uses the (approximate) solutions to…

Analysis of PDEs · Mathematics 2018-08-01 Juan Liu , Jiguang Sun

In this paper, we study a class of bilevel optimization problems where the lower-level problem is a convex composite optimization model, which arises in various applications, including bilevel hyperparameter selection for regularized…

Optimization and Control · Mathematics 2026-05-13 Xiaoning Bai , Shangzhi Zeng , Jin Zhang , Lezhi Zhang

Bilevel optimization have gained growing interests, with numerous applications found in meta learning, minimax games, reinforcement learning, and nested composition optimization. This paper studies the problem of distributed bilevel…

Machine Learning · Statistics 2022-06-23 Shuoguang Yang , Xuezhou Zhang , Mengdi Wang

The signal demixing problem seeks to separate a superposition of multiple signals into its constituent components. This paper studies a two-stage approach that first decompresses and subsequently deconvolves the noisy and undersampled…

Information Retrieval · Computer Science 2022-05-25 Zhenan Fan , Halyun Jeong , Babhru Joshi , Michael P. Friedlander

Bilevel optimization problems embed the optimality of a subproblem as a constraint of another optimization problem. We introduce the concept of near-optimality robustness for bilevel optimization, protecting the upper-level solution…

Optimization and Control · Mathematics 2024-07-15 Mathieu Besançon , Miguel F. Anjos , Luce Brotcorne

For many machine learning algorithms such as $k$-Nearest Neighbor ($k$-NN) classifiers and $ k $-means clustering, often their success heavily depends on the metric used to calculate distances between different data points. An effective…

Computer Vision and Pattern Recognition · Computer Science 2010-03-03 Chunhua Shen , Junae Kim , Lei Wang

Bilevel optimization has been successfully applied to many important machine learning problems. Algorithms for solving bilevel optimization have been studied under various settings. In this paper, we study the nonconvex-strongly-convex…

Optimization and Control · Mathematics 2022-06-14 Xuxing Chen , Minhui Huang , Shiqian Ma

We investigate the identification of the time-dependent source term in the diffusion equation using boundary measurements. This facilitates tracing back the origins of environmental pollutants. Employing the concept of dynamic complex…

Numerical Analysis · Mathematics 2023-11-21 Lingyun Qiu , Zhongjing Wang , Hui Yu , Shenwen Yu

Bilevel optimization enjoys a wide range of applications in emerging machine learning and signal processing problems such as hyper-parameter optimization, image reconstruction, meta-learning, adversarial training, and reinforcement…

Machine Learning · Computer Science 2025-01-08 Han Shen , Quan Xiao , Tianyi Chen

We present a likelihood-free probabilistic inversion method based on normalizing flows for high-dimensional inverse problems. The proposed method is composed of two complementary networks: a summary network for data compression and an…

Machine Learning · Computer Science 2024-12-30 Jice Zeng , Yuanzhe Wang , Alexandre M. Tartakovsky , David Barajas-Solano

Bayesian approaches are one of the primary methodologies to tackle an inverse problem in high dimensions. Such an inverse problem arises in hydrology to infer the permeability field given flow data in a porous media. It is common practice…

Methodology · Statistics 2023-10-02 Navid Shervani-Tabar

This review discusses methods for learning parameters for image reconstruction problems using bilevel formulations. Image reconstruction typically involves optimizing a cost function to recover a vector of unknown variables that agrees with…

Optimization and Control · Mathematics 2022-06-16 Caroline Crockett , Jeffrey A. Fessler

When faced with multiple minima of an "inner-level" convex optimization problem, the convex bilevel optimization problem selects an optimal solution which also minimizes an auxiliary "outer-level" convex objective of interest. Bilevel…

Optimization and Control · Mathematics 2024-10-10 Khanh-Hung Giang-Tran , Nam Ho-Nguyen , Dabeen Lee

Recent diffusion models provide a promising zero-shot solution to noisy linear inverse problems without retraining for specific inverse problems. In this paper, we reveal that recent methods can be uniformly interpreted as employing a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Xinyu Peng , Ziyang Zheng , Wenrui Dai , Nuoqian Xiao , Chenglin Li , Junni Zou , Hongkai Xiong

Bilevel learning has gained prominence in machine learning, inverse problems, and imaging applications, including hyperparameter optimization, learning data-adaptive regularizers, and optimizing forward operators. The large-scale nature of…

Optimization and Control · Mathematics 2025-05-20 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

We consider pessimistic bilevel stochastic programs in which the follower maximizes over a fixed compact convex set a strictly convex quadratic function, whose Hessian depends on the leader's decision. The resulting random variable is…

Optimization and Control · Mathematics 2021-11-30 Johanna Burtscheidt , Matthias Claus , Sergio Conti , Martin Rumpf , Josua Sassen , Rüdiger Schultz

Inverse Problem techniques offer powerful tools which deal naturally with marginal data and asymmetric or strongly smoothing kernels, in cases where parameter-fitting methods may be used only with some caution. Although they are typically…

Astrophysics · Physics 2007-05-23 Norman Gray , Iain J. Coleman

Bilevel optimization is a hierarchical framework where an upper-level optimization problem is constrained by a lower-level problem, commonly used in machine learning applications such as hyperparameter optimization. Existing bilevel…

Optimization and Control · Mathematics 2026-03-03 Yuman Wu , Xiaochuan Gong , Jie Hao , Mingrui Liu

We consider the bilevel optimisation approach proposed by De Los Reyes, Sch\"onlieb (2013) for learning the optimal parameters in a Total Variation (TV) denoising model featuring for multiple noise distributions. In applications, the use of…

Optimization and Control · Mathematics 2014-06-24 Luca Calatroni , Juan Carlos De Los Reyes , Carola-Bibiane Schönlieb

Image reconstruction under multiple light scattering is crucial in a number of applications such as diffraction tomography. The reconstruction problem is often formulated as a nonconvex optimization, where a nonlinear measurement model is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Yu Sun , Zhihao Xia , Ulugbek S. Kamilov