English
Related papers

Related papers: Inverse Optimization with Noisy Data

200 papers

We design a new iterative algorithm, called REINFORCE-OPT, for solving a general type of optimization problems. This algorithm parameterizes the solution search rule and iteratively updates the parameter using a reinforcement learning (RL)…

Optimization and Control · Mathematics 2025-01-27 Chen Xu , Yun-Bin Zhao , Zhipeng Lu , Ye Zhang

Imaging is a standard example of an inverse problem, where the task of reconstructing a ground truth from a noisy measurement is ill-posed. Recent state-of-the-art approaches for imaging use deep learning, spearheaded by unrolled and…

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

Machine Learning · Statistics 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

This paper presents a novel convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems with non-convex constraints that restrict the…

Optimization and Control · Mathematics 2019-11-21 Danylo Malyuta , Behcet Acikmese

This paper introduces a novel double regularization scheme for bilevel optimization problems whose lower-level problem is composite and convex, but not necessarily strongly convex, in the lower-level variable. The analysis focuses on the…

Optimization and Control · Mathematics 2026-02-06 Mattia Solla , Johannes O. Royset

Stochastic programs where the uncertainty distribution must be inferred from noisy data samples are considered. The stochastic programs are approximated with distributionally-robust optimizations that minimize the worst-case expected cost…

Optimization and Control · Mathematics 2024-01-04 Farhad Farokhi

Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a data fidelity term and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

This paper considers the linear inverse problem where we wish to estimate a structured signal $x$ from its corrupted observations. When the problem is ill-posed, it is natural to make use of a convex function $f(\cdot)$ that exploits the…

Information Theory · Computer Science 2013-12-06 Samet Oymak , Christos Thrampoulidis , Babak Hassibi

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

We study iterative regularization for linear models, when the bias is convex but not necessarily strongly convex. We characterize the stability properties of a primal-dual gradient based approach, analyzing its convergence in the presence…

Machine Learning · Statistics 2020-10-30 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their…

Numerical Analysis · Mathematics 2020-06-09 Markus Haltmeier , Linh V. Nguyen

The objective of this work is to quantify the reconstruction error in sparse inverse problems with measures and stochastic noise, motivated by optimal sensor placement. To be useful in this context, the error quantities must be explicit in…

Numerical Analysis · Mathematics 2024-04-19 Phuoc-Truong Huynh , Konstantin Pieper , Daniel Walter

In inverse problems, one attempts to infer spatially variable functions from indirect measurements of a system. To practitioners of inverse problems, the concept of "information" is familiar when discussing key questions such as which parts…

Numerical Analysis · Mathematics 2025-02-12 Wolfgang Bangerth , Chris R. Johnson , Dennis K. Njeru , Bart van Bloemen Waanders

We introduce a new class of inverse optimization problems in which an input solution is given together with $k$ linear weight functions, and the goal is to modify the weights by the same deviation vector $p$ so that the input solution…

Optimization and Control · Mathematics 2022-01-11 Kristóf Bérczi , Lydia Mirabel Mendoza-Cadena , Kitti Varga

In robust optimization, the general aim is to find a solution that performs well over a set of possible parameter outcomes, the so-called uncertainty set. In this paper, we assume that the uncertainty size is not fixed, and instead aim at…

Optimization and Control · Mathematics 2016-06-24 André Chassein , Marc Goerigk

We consider the maximum likelihood estimation of sparse inverse covariance matrices. We demonstrate that current heuristic approaches primarily encourage robustness, instead of the desired sparsity. We give a novel approach that solves the…

Machine Learning · Statistics 2021-11-08 Dimitris Bertsimas , Jourdain Lamperski , Jean Pauphilet

Regularization is a powerful technique for extracting useful information from noisy data. Typically, it is implemented by adding some sort of norm constraint to an objective function and then exactly optimizing the modified objective…

Data Structures and Algorithms · Computer Science 2011-04-28 Michael W. Mahoney , Lorenzo Orecchia

Variational regularization methods are commonly used to approximate solutions of inverse problems. In recent years, model-based variational regularization methods have often been replaced with data-driven ones such as the fields-of-expert…

Optimization and Control · Mathematics 2024-01-17 Danilo Riccio , Matthias J. Ehrhardt , Martin Benning

We consider an unsupervised bilevel optimization strategy for learning regularization parameters in the context of imaging inverse problems in the presence of additive white Gaussian noise. Compared to supervised and semi-supervised metrics…

Optimization and Control · Mathematics 2024-03-13 Carlo Santambrogio , Monica Pragliola , Alessandro Lanza , Marco Donatelli , Luca Calatroni

We consider the problem of global optimization of an unknown non-convex smooth function with zeroth-order feedback. In this setup, an algorithm is allowed to adaptively query the underlying function at different locations and receives noisy…

Machine Learning · Statistics 2018-03-26 Yining Wang , Sivaraman Balakrishnan , Aarti Singh
‹ Prev 1 3 4 5 6 7 10 Next ›