English
Related papers

Related papers: Plug-and-play superiorization

200 papers

Solving inverse problems, such as parameter estimation and optimal control, is a vital part of science. Many experiments repeatedly collect data and rely on machine learning algorithms to quickly infer solutions to the associated inverse…

Machine Learning · Computer Science 2022-10-14 Philipp Holl , Vladlen Koltun , Nils Thuerey

We aim at the solution of inverse problems in imaging, by combining a penalized sparse representation of image patches with an unconstrained smooth one. This allows for a straightforward interpretation of the reconstruction. We formulate…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Stanislas Ducotterd , Sebastian Neumayer , Michael Unser

Sharpness-Aware Minimization (SAM) is an optimization technique designed to improve generalization by favoring flatter loss minima. To achieve this, SAM optimizes a modified objective that penalizes sharpness, using computationally…

Machine Learning · Computer Science 2024-11-05 Nalin Tiwary , Siddarth Aananth

We conduct a study and comparison of superiorization and optimization approaches for the reconstruction problem of superiorized/regularized least-squares solutions of underdetermined linear equations with nonnegativity variable bounds.…

Optimization and Control · Mathematics 2020-04-02 Yair Censor , Stefania Petra , Christoph Schnörr

The main goal of this paper is to present the application of a superiorization methodology to solution of variational inequalities. Within this framework a variational inequality operator is considered as a small perturbation of a convex…

Optimization and Control · Mathematics 2016-11-30 Evgeni Nurminski

Regularization is a powerful technique for extracting useful information from noisy data. Typically, it is implemented by adding some sort of norm constraint to an objective function and then exactly optimizing the modified objective…

Data Structures and Algorithms · Computer Science 2011-04-28 Michael W. Mahoney , Lorenzo Orecchia

Inspired by the remarkable success of large neural networks, there has been significant interest in understanding the generalization performance of over-parameterized models. Substantial efforts have been invested in characterizing how…

Machine Learning · Computer Science 2024-01-12 Haoyuan Sun , Khashayar Gatmiry , Kwangjun Ahn , Navid Azizan

The Moment/Sum-of-squares hierarchy provides a way to compute the global minimizers of polynomial optimization problems (POP), at the cost of solving a sequence of increasingly large semidefinite programs (SDPs). We consider large-scale…

Optimization and Control · Mathematics 2023-09-13 Johannes Aspman , Gilles Bareilles , Vyacheslav Kungurtsev , Jakub Marecek , Martin Takáč

Optimization methods are at the core of many problems in signal/image processing, computer vision, and machine learning. For a long time, it has been recognized that looking at the dual of an optimization problem may drastically simplify…

Numerical Analysis · Computer Science 2014-12-04 Nikos Komodakis , Jean-Christophe Pesquet

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

The goal of image restoration (IR), a fundamental issue in computer vision, is to restore a high-quality (HQ) image from its degraded low-quality (LQ) observation. Multiple HQ solutions may correspond to an LQ input in this poorly posed…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Zeyu Xiao , Jiawang Bai , Zhihe Lu , Zhiwei Xiong

In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we…

Machine Learning · Statistics 2013-05-15 Julien Mairal

By the recent advances in computer technology leading to the invention of more powerful processors, the importance of creating models using data training is even greater than ever. Given the significance of this issue, this work tries to…

Optimization and Control · Mathematics 2023-12-27 Saman Khoramian

A new Plug-and-Play (PnP) alternating direction of multipliers (ADMM) scheme is proposed in this paper, by embedding a recently introduced adaptive denoiser using the Schroedinger equation's solutions of quantum physics. The potential of…

Image and Video Processing · Electrical Eng. & Systems 2021-10-22 Sayantan Dutta , Adrian Basarab , Bertrand Georgeot , Denis Kouamé

Metal artifact reduction (MAR) is a challenging problem in computed tomography (CT) imaging. A popular class of MAR methods replace sinogram measurements that are corrupted by metal with artificial data. While these ``projection…

Medical Physics · Physics 2021-01-27 T. Humphries , J. Wang

Dynamic imaging addresses the recovery of a time-varying 2D or 3D object at each time instant using its undersampled measurements. In particular, in the case of dynamic tomography, only a single projection at a single view angle may be…

Image and Video Processing · Electrical Eng. & Systems 2024-05-09 Berk Iskender , Marc L. Klasky , Yoram Bresler

This paper presents a novel method for restoring digital videos via a Deep Plug-and-Play (PnP) approach. Under a Bayesian formalism, the method consists in using a deep convolutional denoising network in place of the proximal operator of…

Image and Video Processing · Electrical Eng. & Systems 2022-09-16 Antoine Monod , Julie Delon , Matias Tassano , Andrés Almansa

We tackle the problem of Selective Classification where the objective is to achieve the best performance on a predetermined ratio (coverage) of the dataset. Recent state-of-the-art selective methods come with architectural changes either…

Machine Learning · Computer Science 2023-03-03 Leo Feng , Mohamed Osama Ahmed , Hossein Hajimirsadeghi , Amir Abdi

Robust optimisation is a well-established framework for optimising functions in the presence of uncertainty. The inherent goal of this problem is to identify a collection of inputs whose outputs are both desirable for the decision maker,…

Optimization and Control · Mathematics 2025-05-27 Ben Tu , Nikolas Kantas , Robert M. Lee , Behrang Shafei

Achieving high-quality Magnetic Resonance Imaging (MRI) reconstruction at accelerated acquisition rates remains challenging due to the inherent ill-posed nature of the inverse problem. Traditional Compressed Sensing (CS) methods, while…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Pierre-Antoine Comby , Benjamin Lapostolle , Matthieu Terris , Philippe Ciuciu