English
Related papers

Related papers: Efficient primal-dual algorithm for imaging applic…

200 papers

We propose several variants of the primal-dual method due to Chambolle and Pock. Without requiring full strong convexity of the objective functions, our methods are accelerated on subspaces with strong convexity. This yields mixed rates,…

Optimization and Control · Mathematics 2020-02-13 Tuomo Valkonen , Thomas Pock

We consider empirical risk minimization of linear predictors with convex loss functions. Such problems can be reformulated as convex-concave saddle point problems, and thus are well suitable for primal-dual first-order algorithms. However,…

Optimization and Control · Mathematics 2017-03-09 Jialei Wang , Lin Xiao

In modern engineering scenarios, there is often a strict upper bound on the number of algorithm iterations that can be performed within a given time limit. This raises the question of optimal algorithmic configuration for a fixed and finite…

Optimization and Control · Mathematics 2024-12-31 Yushun Zhang , Dmitry Rybin , Zhi-Quan Luo

In the paper, we introduce several accelerate iterative algorithms for solving the multiple-set split common fixed-point problem of quasi-nonexpansive operators in real Hilbert space. Based on primal-dual method, we construct several…

Optimization and Control · Mathematics 2023-06-08 Chenzheng Guo , Jing Zhao

In this paper we combine the stochastic variance reduced gradient (SVRG) method [17] with the primal dual fixed point method (PDFP) proposed in [7] to solve a sum of two convex functions and one of which is linearly composite. This type of…

Optimization and Control · Mathematics 2020-07-24 Ya-Nan Zhu , Xiaoqun Zhang

Many techniques for real-time trajectory optimization and control require the solution of optimization problems at high frequencies. However, ill-conditioning in the optimization problem can significantly reduce the speed of first-order…

Optimization and Control · Mathematics 2024-09-23 Govind M. Chari , Yue Yu , Behçet Açıkmeşe

Gradient-based methods successfully train highly overparameterized models in practice, even though the associated optimization problems are markedly nonconvex. Understanding the mechanisms that make such methods effective has become a…

Machine Learning · Computer Science 2026-01-21 Hippolyte Labarrière , Cesare Molinari , Lorenzo Rosasco , Cristian Vega , Silvia Villa

This work presents a GPU-accelerated solver for the unit commitment (UC) problem in large-scale power grids. The solver uses the Primal-Dual Hybrid Gradient (PDHG) algorithm to efficiently solve the relaxed linear subproblem, achieving…

Optimization and Control · Mathematics 2025-12-09 Hussein Sharadga , Javad Mohammadi

Regularized optimization has been a classical approach to solving imaging inverse problems, where the regularization term enforces desirable properties of the unknown image. Recently, the integration of flow matching generative models into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ji Li , Chao Wang

We develop a first-order accelerated algorithm for a class of constrained bilinear saddle-point problems with applications to network systems. The algorithm is a modified time-varying primal-dual version of an accelerated mirror-descent…

Optimization and Control · Mathematics 2024-10-04 Weijian Li , Xianlin Zeng , Lacra Pavel

Image inverse problems have numerous applications, including image processing, super-resolution, and computer vision, which are important areas in image science. These application models can be seen as a three-function composite…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Yunfei Qu , Deren Han

Model training algorithms which observe a small portion of the training set in each computational step are ubiquitous in practical machine learning, and include both stochastic and online optimization methods. In the vast majority of cases,…

Machine Learning · Computer Science 2024-06-19 Alex Shtoff

We study convex relaxation algorithms for phase retrieval on imaging problems. We show that structural assumptions on the signal and the observations, such as sparsity, smoothness or positivity, can be exploited to both speed-up convergence…

Optimization and Control · Mathematics 2014-04-09 Fajwel Fogel , Irène Waldspurger , Alexandre d'Aspremont

In recent years, there has been growing interest in solving linear optimization problems - or more simply "LP" - using first-order methods in order to avoid the costly matrix factorizations of traditional methods for huge-scale LP…

Optimization and Control · Mathematics 2026-01-06 Zikai Xiong , Robert Michael Freund

The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of $n$ local cost functions by using local information exchange is considered. This problem is an important component of many machine…

Optimization and Control · Mathematics 2022-01-11 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

Magnetic resonance imaging (MRI) is known to be a slow imaging modality and undersampling in k-space has been used to increase the imaging speed. However, image reconstruction from undersampled k-space data is an ill-posed inverse problem.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-08 Jing Cheng , Haifeng Wang , Leslie Ying , Dong Liang

We consider structured minimization problems subject to smooth inequality constraints and present a flexible algorithm that combines interior point (IP) and proximal gradient schemes. While traditional IP methods cannot cope with nonsmooth…

Optimization and Control · Mathematics 2024-07-11 Alberto De Marchi , Andreas Themelis

Iterative Hard Thresholding (IHT) is a class of projected gradient descent methods for optimizing sparsity-constrained minimization models, with the best known efficiency and scalability in practice. As far as we know, the existing…

Machine Learning · Computer Science 2017-06-22 Bo Liu , Xiao-Tong Yuan , Lezi Wang , Qingshan Liu , Dimitris N. Metaxas

Lagrangian duality in mixed integer optimization is a useful framework for problems decomposition and for producing tight lower bounds to the optimal objective, but in contrast to the convex counterpart, it is generally unable to produce…

Optimization and Control · Mathematics 2014-11-10 Robin Vujanic , Peyman Mohajerin Esfahani , Paul Goulart , Sebastien Mariethoz , Manfred Morari

This paper proposes two convergent adaptive mesh-refining algorithms for the hybrid high-order method in convex minimization problems with two-sided p-growth. Examples include the p-Laplacian, an optimal design problem in topology…

Numerical Analysis · Mathematics 2024-07-03 Carsten Carstensen , Ngoc Tien Tran