English
Related papers

Related papers: Continuous Multiclass Labeling Approaches and Algo…

200 papers

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations…

Optimization and Control · Mathematics 2012-10-10 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

Multibang regularization and combinatorial integral approximation decompositions are two actively researched techniques for integer optimal control. We consider a class of polyhedral functions that arise particularly as convex lower…

Optimization and Control · Mathematics 2021-03-31 Paul Manns

With the advent of multi-coil imaging and compressed sensing, a number of model based reconstruction algorithms have been created. They incorporate a multitude of different regularization functions based on physics, observed phenomenology,…

Image and Video Processing · Electrical Eng. & Systems 2023-02-03 Nicholas Dwork , Ethan M. I. Johnson , Daniel O'Connor , Jeremy W. Gordon , Adam B. Kerr , Corey A. Baron , John M. Pauly , Peder E. Z. Larson

Regularization techniques are crucial to improving the generalization performance and training efficiency of deep neural networks. Many deep learning algorithms rely on weight decay, dropout, batch/layer normalization to converge faster and…

Machine Learning · Computer Science 2025-05-23 Peng Lu , Ahmad Rashid , Ivan Kobyzev , Mehdi Rezagholizadeh , Philippe Langlais

We develop a general framework for MAP estimation in discrete and Gaussian graphical models using Lagrangian relaxation techniques. The key idea is to reformulate an intractable estimation problem as one defined on a more tractable graph,…

Artificial Intelligence · Computer Science 2007-10-02 Jason K. Johnson , Dmitry M. Malioutov , Alan S. Willsky

We develop tractable convex relaxations for rank-constrained quadratic optimization problems over $n \times m$ matrices, a setting for which tractable relaxations are typically only available when the objective or constraints admit spectral…

Optimization and Control · Mathematics 2026-05-22 Ryan Cory-Wright , Jean Pauphilet

Composite minimization involves a collection of smooth functions which are aggregated in a nonsmooth manner. In the convex setting, we design an algorithm by linearizing each smooth component in accordance with its main curvature. The…

Optimization and Control · Mathematics 2019-03-26 Jérôme Bolte , Zheng Chen , Edouard Pauwels

Optimization problems with rank constraints appear in many diverse fields such as control, machine learning and image analysis. Since the rank constraint is non-convex, these problems are often approximately solved via convex relaxations.…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Pontus Giselsson

In recent years, research on learning with noisy labels has focused on devising novel algorithms that can achieve robustness to noisy training labels while generalizing to clean data. These algorithms often incorporate sophisticated…

Machine Learning · Computer Science 2023-07-12 Hui Kang , Sheng Liu , Huaxi Huang , Jun Yu , Bo Han , Dadong Wang , Tongliang Liu

We propose an adaptive regularization scheme in a variational framework where a convex composite energy functional is optimized. We consider a number of imaging problems including denoising, segmentation and motion estimation, which are…

Computer Vision and Pattern Recognition · Computer Science 2017-03-01 Byung-Woo Hong , Ja-Keoung Koo , Hendrik Dirks , Martin Burger

In this work we study convex relaxations of quadratic optimisation problems over permutation matrices. While existing semidefinite programming approaches can achieve remarkably tight relaxations, they have the strong disadvantage that they…

Optimization and Control · Mathematics 2018-08-01 Florian Bernard , Christian Theobalt , Michael Moeller

Dense conditional random fields (CRFs) have become a popular framework for modelling several problems in computer vision such as stereo correspondence and multi-class semantic segmentation. By modelling long-range interactions, dense CRFs…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Thomas Joy , Alban Desmaison , Thalaiyasingam Ajanthan , Rudy Bunel , Mathieu Salzmann , Pushmeet Kohli , Philip H. S. Torr , M. Pawan Kumar

Continuous-domain visual signals are usually captured as discrete (digital) images. This operation is not invertible in general, in the sense that the continuous-domain signal cannot be exactly reconstructed based on the discrete image,…

Information Theory · Computer Science 2016-01-20 Mitra Fatemi , Arash Amini , Loic Baboulaz , Martin Vetterli

This article discusses nonconforming finite element methods for convex minimization problems and systematically derives dual mixed formulations. Duality relations lead to simple error estimates that avoid an explicit treatment of…

Numerical Analysis · Mathematics 2020-02-07 Sören Bartels

This paper proposes an algorithm for solving structured optimization problems, which covers both the backward-backward and the Douglas-Rachford algorithms as special cases, and analyzes its convergence. The set of fixed points of the…

Optimization and Control · Mathematics 2017-09-19 Nguyen Hieu Thao

In this paper we study the convex envelopes of a new class of functions. Using this approach, we are able to unify two important classes of regularizers from unbiased non-convex formulations and weighted nuclear norm penalties. This opens…

Optimization and Control · Mathematics 2021-03-18 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

In this paper we present a general convex optimization approach for solving high-dimensional multiple response tensor regression problems under low-dimensional structural assumptions. We consider using convex and weakly decomposable…

Statistics Theory · Mathematics 2017-04-17 Garvesh Raskutti , Ming Yuan , Han Chen

We propose an extended framework for marginalized domain adaptation, aimed at addressing unsupervised, supervised and semi-supervised scenarios. We argue that the denoising principle should be extended to explicitly promote domain-invariant…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Gabriela Csurka , Boris Chidlovski , Stephane Clinchant , Sophia Michel

Coordinate-wise minimization is a simple popular method for large-scale optimization. Unfortunately, for general (non-differentiable) convex problems it may not find global minima. We present a class of linear programs that coordinate-wise…

Optimization and Control · Mathematics 2020-09-15 Tomáš Dlask , Tomáš Werner

The aim of this paper is to develop an efficient algorithm for solving a class of unconstrained nondifferentiable convex optimization problems in finite dimensional spaces. To this end we formulate first its Fenchel dual problem and…

Optimization and Control · Mathematics 2012-03-12 Radu Ioan Bot , Christopher Hendrich