English
Related papers

Related papers: A primal-dual algorithm for image reconstruction w…

200 papers

We study the non-smooth optimization problems in machine learning, where both the loss function and the regularizer are non-smooth functions. Previous studies on efficient empirical loss minimization assume either a smooth loss function or…

Machine Learning · Computer Science 2013-07-29 Tianbao Yang , Mehrdad Mahdavi , Rong Jin , Shenghuo Zhu

We develop fast algorithms and robust software for convex optimization of two-layer neural networks with ReLU activation functions. Our work leverages a convex reformulation of the standard weight-decay penalized training problem as a set…

Machine Learning · Computer Science 2025-04-10 Aaron Mishkin , Arda Sahiner , Mert Pilanci

Focus of this work is solving a non-smooth constraint minimization problem by a primal-dual splitting algorithm involving proximity operators. The problem is penalized by the Bregman divergence associated with the non-smooth total variation…

Numerical Analysis · Mathematics 2020-02-25 Erdem Altuntac

We derive a memory-efficient first-order variable splitting algorithm for convex image reconstruction problems with non-smooth regularization terms. The algorithm is based on a primal-dual approach, where one of the dual variables is…

Optimization and Control · Mathematics 2019-04-02 Greg Ongie , Naveen Murthy , Laura Balzano , Jeffrey A. Fessler

A wide array of image recovery problems can be abstracted into the problem of minimizing a sum of composite convex functions in a Hilbert space. To solve such problems, primal-dual proximal approaches have been developed which provide…

Optimization and Control · Mathematics 2014-06-23 Patrick L. Combettes , Laurent Condat , Jean-Christophe Pesquet , Bang Cong Vu

Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based…

We introduce a model-based image reconstruction framework with a convolution neural network (CNN) based regularization prior. The proposed formulation provides a systematic approach for deriving deep architectures for inverse problems with…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Hemant Kumar Aggarwal , Merry P. Mani , Mathews Jacob

Regularized optimization has been a classical approach to solving imaging inverse problems, where the regularization term enforces desirable properties of the unknown image. Recently, the integration of flow matching generative models into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ji Li , Chao Wang

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

A common approach to solve inverse imaging problems relies on finding a maximum a posteriori (MAP) estimate of the original unknown image, by solving a minimization problem. In thiscontext, iterative proximal algorithms are widely used,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Hoang Trieu Vy Le , Audrey Repetti , Nelly Pustelnik

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Marc Kachelrieß , Marc Dewey , Christian Wald , Christoph Kolbitsch

Primal-dual methods in online optimization give several of the state-of-the art results in both of the most common models: adversarial and stochastic/random order. Here we try to provide a more unified analysis of primal-dual algorithms to…

Data Structures and Algorithms · Computer Science 2020-11-04 Marco Molinaro

In this paper, we consider a nonsmooth convex finite-sum problem with a conic constraint. To overcome the challenge of projecting onto the constraint set and computing the full (sub)gradient, we introduce a primal-dual incremental gradient…

Optimization and Control · Mathematics 2021-05-10 Afrooz Jalilzadeh

We develop a novel primal-dual algorithm to solve a class of nonsmooth and nonlinear compositional convex minimization problems, which covers many existing and brand-new models as special cases. Our approach relies on a combination of a new…

Optimization and Control · Mathematics 2021-04-20 Yuzixuan Zhu , Deyi Liu , Quoc Tran-Dinh

Regularization-based image restoration has remained an active research topic in computer vision and image processing. It often leverages a guidance signal captured in different fields as an additional cue. In this work, we present a general…

Computer Vision and Pattern Recognition · Computer Science 2016-12-21 Youngjung Kim , Hyungjoo Jung , Dongbo Min , Kwanghoon Sohn

Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a data fidelity term and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

We provide a general method to convert a "primal" black-box algorithm for solving regularized convex-concave minimax optimization problems into an algorithm for solving the associated dual maximin optimization problem. Our method adds…

Optimization and Control · Mathematics 2024-12-05 Yair Carmon , Arun Jambulapati , Liam O'Carroll , Aaron Sidford

Convex optimization problems with staged structure appear in several contexts, including optimal control, verification of deep neural networks, and isotonic regression. Off-the-shelf solvers can solve these problems but may scale poorly. We…

Optimization and Control · Mathematics 2020-10-28 Rudy Bunel , Oliver Hinder , Srinadh Bhojanapalli , Krishnamurthy , Dvijotham

We consider empirical risk minimization of linear predictors with convex loss functions. Such problems can be reformulated as convex-concave saddle point problems, and thus are well suitable for primal-dual first-order algorithms. However,…

Optimization and Control · Mathematics 2017-03-09 Jialei Wang , Lin Xiao

This paper is devoted to the study of an inertial accelerated primal-dual algorithm, which is based on a second-order differential system with time scaling, for solving a non-smooth convex optimization problem with linear equality…

Optimization and Control · Mathematics 2026-04-30 Huan Zhang , Xiangkai Sun , Shengjie Li , Kok Lay Teo