English
Related papers

Related papers: Relaxed multibang regularization for the combinato…

200 papers

Regularized nonnegative low-rank approximations, such as sparse Nonnegative Matrix Factorization or sparse Nonnegative Tucker Decomposition, form an important branch of dimensionality reduction models known for their enhanced…

Machine Learning · Computer Science 2025-01-31 Jeremy E. Cohen , Valentin Leplat

In the context of linear inverse problems, we propose and study a general iterative regularization method allowing to consider large classes of regularizers and data-fit terms. The algorithm we propose is based on a primal-dual diagonal…

Optimization and Control · Mathematics 2017-08-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

We consider the task of image reconstruction while simultaneously decomposing the reconstructed image into components with different features. A commonly used tool for this is a variational approach with an infimal convolution of…

Numerical Analysis · Mathematics 2025-04-16 Tobias Wolf , Derek Driggs , Kostas Papafitsoros , Elena Resmerita , Carola-Bibiane Schönlieb

We introduce a physics-inspired continuous relaxation framework that yields substantially improved solutions for NP-hard combinatorial optimization problems, including Quadratic Unconstrained Binary Optimization (QUBO), binary sparse…

Statistical Mechanics · Physics 2026-05-26 Khen Cohen , Mark Glass , Meir Feder , Yaron Oz

Boolean quadratic optimization problems occur in a number of applications. Their mixed integer-continuous nature is challenging, since it is inherently NP-hard. For this motivation, semidefinite programming relaxations (SDR's) are proposed…

Optimization and Control · Mathematics 2020-03-20 V. Cerone , S. M. Fosson , D. Regruto

Autoencoders provide a powerful framework for learning compressed representations by encoding all of the information needed to reconstruct a data point in a latent code. In some cases, autoencoders can "interpolate": By decoding the convex…

Machine Learning · Computer Science 2018-07-25 David Berthelot , Colin Raffel , Aurko Roy , Ian Goodfellow

We investigate continuous regularization methods for linear inverse problems of static and dynamic type. These methods are based on dynamic programming approaches for linear quadratic optimal control problems. We prove regularization…

Optimization and Control · Mathematics 2021-01-27 S. Kindermann , A. Leitao

Iterative regularization exploits the implicit bias of an optimization algorithm to regularize ill-posed problems. Constructing algorithms with such built-in regularization mechanisms is a classic challenge in inverse problems but also in…

Optimization and Control · Mathematics 2022-02-02 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

The minimization of a nonconvex composite function can model a variety of imaging tasks. A popular class of algorithms for solving such problems are majorization-minimization techniques which iteratively approximate the composite nonconvex…

Optimization and Control · Mathematics 2018-09-05 Jonas Geiping , Michael Moeller

In recent years, bilevel approaches have become very popular to efficiently estimate high-dimensional hyperparameters of machine learning models. However, to date, binary parameters are handled by continuous relaxation and rounding…

Machine Learning · Computer Science 2025-03-20 Sara Venturini , Marianna de Santis , Jordan Patracone , Francesco Rinaldi , Saverio Salzo , Martin Schmidt

We study a class of bilevel convex optimization problems where the goal is to find the minimizer of an objective function in the upper level, among the set of all optimal solutions of an optimization problem in the lower level. A wide range…

Optimization and Control · Mathematics 2018-09-27 Mostafa Amini , Farzad Yousefian

The present paper deals with the data-driven design of regularizers in the form of artificial neural networks, for solving certain inverse problems formulated as optimal control problems. These regularizers aim at improving accuracy,…

Optimization and Control · Mathematics 2023-03-06 Sebastien Court

We use convex relaxation techniques to provide a sequence of solutions to the matrix completion problem. Using the nuclear norm as a regularizer, we provide simple and very efficient algorithms for minimizing the reconstruction error…

Machine Learning · Statistics 2009-06-12 Rahul Mazumder , Trevor Hastie , Rob Tibshirani

In this article, we survey the primary research on polyhedral computing methods for constrained linear control systems. Our focus is on the modeling power of convex optimization, featured to design set-based robust and optimal controllers.…

Optimization and Control · Mathematics 2024-12-18 Boris Houska , Matthias A. Müller , Mario E. Villanueva

This paper proposes an epigraphical relaxation (ERx) technique for non-proximable mixed norm minimization. Mixed norm regularization methods play a central role in signal reconstruction and processing, where their optimization relies on the…

Signal Processing · Electrical Eng. & Systems 2021-06-09 Seisuke Kyochi , Shunsuke Ono , Ivan Selesnick

Regularized empirical risk minimization with constrained labels (in contrast to fixed labels) is a remarkably general abstraction of learning. For common loss and regularization functions, this optimization problem assumes the form of a…

Machine Learning · Computer Science 2016-02-23 Iaroslav Shcherbatyi , Bjoern Andres

We propose a functional lifting-based convex relaxation of variational problems with Laplacian-based second-order regularization. The approach rests on ideas from the calibration method as well as from sublabel-accurate continuous…

Numerical Analysis · Mathematics 2019-07-12 Thomas Vogt , Jan Lellmann

This article introduces a generalization of the discrete optimal transport, with applications to color image manipulations. This new formulation includes a relaxation of the mass conservation constraint and a regularization term. These two…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Sira Ferradans , Nicolas Papadakis , Gabriel Peyré , Jean-François Aujol

In this article we investigate the connection between regularization theory for inverse problems and dynamic programming theory. This is done by developing two new regularization methods, based on dynamic programming techniques. The aim of…

Numerical Analysis · Mathematics 2021-01-26 S. Kindermann , A. Leitao

Low rank regularization, in essence, involves introducing a low rank or approximately low rank assumption for matrix we aim to learn, which has achieved great success in many fields including machine learning, data mining and computer…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Zhanxuan Hu , Feiping Nie , Rong Wang , Xuelong Li
‹ Prev 1 3 4 5 6 7 10 Next ›