English
Related papers

Related papers: Modular proximal optimization for multidimensional…

200 papers

We study a generalized framework for structured sparsity. It extends the well-known methods of Lasso and Group Lasso by incorporating additional constraints on the variables as part of a convex optimization problem. This framework provides…

Machine Learning · Computer Science 2011-06-28 Andreas Argyriou , Luca Baldassarre , Jean Morales , Massimiliano Pontil

We define the space of functions of bounded variation ($BV$) on the graph. Using the notion of divergence of flows on graphs, we show that the unit ball of the dual space to $BV$ in the graph setting can be described as the image of the…

Optimization and Control · Mathematics 2019-11-27 Japhet Niyobuhungiro , Eric Setterqvist , Freddie Åström , George Baravdish

There has been tremendous research on the design of image regularizers over the years, from simple Tikhonov and Laplacian to sophisticated sparsity and CNN-based regularizers. Coupled with a model-based loss function, these are typically…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Pravin Nair , Kunal N. Chaudhury

Our work considers the optimization of the sum of a non-smooth convex function and a finite family of composite convex functions, each one of which is composed of a convex function and a bounded linear operator. This type of problem is…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Chuan-Xi Zhu , Meng Wen , Ji-Gen Peng

$\ell_1$ regularization has been used for logistic regression to circumvent the overfitting and use the estimated sparse coefficient for feature selection. However, the challenge of such a regularization is that the $\ell_1$ norm is not…

Machine Learning · Computer Science 2021-05-13 Majid Mohammadi , Amir Ahooye Atashin , Damian A. Tamburri

In this paper we present an active-set method for the solution of $\ell_1$-regularized convex quadratic optimization problems. It is derived by combining a proximal method of multipliers (PMM) strategy with a standard semismooth Newton…

Optimization and Control · Mathematics 2023-03-01 Spyridon Pougkakiotis , Jacek Gondzio , Dionysios S. Kalogerias

This paper suggests two novel ideas to develop new proximal variable-metric methods for solving a class of composite convex optimization problems. The first idea is a new parameterization of the optimality condition which allows us to…

Optimization and Control · Mathematics 2018-12-14 Quoc Tran-Dinh , Liang Ling , Kim-Chuan Toh

To reduce the x-ray dose in computerized tomography (CT), many constrained optimization approaches have been proposed aiming at minimizing a regularizing function that measures lack of consistency with some prior knowledge about the object…

Medical Physics · Physics 2017-04-05 Edgar Garduño , Gabor T. Herman

The modeling of phenomenological structure is a crucial aspect in inverse imaging problems. One emerging modeling tool in computational imaging is the optimal transport framework. Its ability to model geometric displacements across an…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 John Lee , Nicholas P. Bertrand , Christopher J. Rozell

We propose a set of iterative regularization algorithms for the TV-Stokes model to restore images from noisy images with Gaussian noise. These are some extensions of the iterative regularization algorithm proposed for the classical…

Numerical Analysis · Mathematics 2020-09-28 Bin Wu , Leszek Marcinkowski , Xue-Cheng Tai , Talal Rahman

While medical imaging typically provides massive amounts of data, the extraction of relevant information for predictive diagnosis remains a difficult challenge. Functional MRI (fMRI) data, that provide an indirect measure of task-related or…

Computer Vision and Pattern Recognition · Computer Science 2011-02-22 Vincent Michel , Alexandre Gramfort , Gaël Varoquaux , Evelyn Eger , Bertrand Thirion

Variational models with coupling terms are becoming increasingly popular in image analysis. They involve auxiliary variables, such that their energy minimisation splits into multiple fractional steps that can be solved easier and more…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Aaron Wewior , Joachim Weickert

We present a new method for minimizing the sum of a differentiable convex function and an $\ell_1$-norm regularizer. The main features of the new method include: $(i)$ an evolving set of indices corresponding to variables that are predicted…

Optimization and Control · Mathematics 2016-02-24 Tianyi Chen , Frank E. Curtis , Daniel P. Robinson

Recently, total variation (TV) based minimization algorithms have achieved great success in compressive sensing (CS) recovery for natural images due to its virtue of preserving edges. However, the use of TV is not able to recover the fine…

Computer Vision and Pattern Recognition · Computer Science 2012-12-27 Jian Zhang , Shaohui Liu , Debin Zhao , Ruiqin Xiong , Siwei Ma

Segmentation of microscopy images constitutes an ill-posed inverse problem due to measurement noise, weak object boundaries, and limited labeled data. Although deep neural networks provide flexible nonparametric estimators, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Seema K. Poudel , Sunny K. Khadka

Solving an optimization problem whose objective function is the sum of two convex functions has received considerable interests in the context of image processing recently. In particular, we are interested in the scenario when a…

Computer Vision and Pattern Recognition · Computer Science 2014-12-16 Dai-Qiang Chen

The parameter selection is crucial to regularization based image restoration methods. Generally speaking, a spatially fixed parameter for regularization item in the whole image does not perform well for both edge and smooth areas. A larger…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Tingting Zhang , Jie Chen , Caiying Wu , Zhifei He , Tieyong Zeng , Qiyu Jin

In this paper, we utilize stochastic optimization to reduce the space complexity of convex composite optimization with a nuclear norm regularizer, where the variable is a matrix of size $m \times n$. By constructing a low-rank estimate of…

Machine Learning · Computer Science 2015-12-08 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

Recent studies of under-determined linear systems of equations with sparse solutions showed a great practical and theoretical efficiency of a particular technique called $\ell_1$-optimization. Seminal works \cite{CRT,DOnoho06CS} rigorously…

Information Theory · Computer Science 2013-06-18 Mihailo Stojnic

In recent years, there have been significant advances in efficiently solving $\ell_s$-regression using linear system solvers and $\ell_2$-regression [Adil-Kyng-Peng-Sachdeva, J. ACM'24]. Would efficient smoothed $\ell_p$-norm solvers lead…

Optimization and Control · Mathematics 2026-01-16 Deeksha Adil , Brian Bullins , Arun Jambulapati , Aaron Sidford