English
Related papers

Related papers: On Representer Theorems and Convex Regularization

200 papers

Many practical problems involve the recovery of a binary matrix from partial information, which makes the binary matrix completion (BMC) technique received increasing attention in machine learning. In particular, we consider a special case…

Machine Learning · Computer Science 2019-04-09 Chunsheng Liu

The need to blend observational data and mathematical models arises in many applications and leads naturally to inverse problems. Parameters appearing in the model, such as constitutive tensors, initial conditions, boundary conditions, and…

Statistics Theory · Mathematics 2010-09-16 J. Nolen , G. A. Pavliotis , A. M. Stuart

In this paper, Kernel PCA is reinterpreted as the solution to a convex optimization problem. Actually, there is a constrained convex problem for each principal component, so that the constraints guarantee that the principal component is…

Machine Learning · Computer Science 2017-10-25 Carlos M. Alaíz , Michaël Fanuel , Johan A. K. Suykens

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

Inverse problems are common and important in many applications in computational physics but are inherently ill-posed with many possible model parameters resulting in satisfactory results in the observation space. When solving the inverse…

Computational Physics · Physics 2020-06-24 Xin-Lei Zhang , Carlos Michelén-Ströfer , Heng Xiao

We develop a novel theoretical framework for understating OT schemes respecting a class structure. For this purpose, we propose a convex OT program with a sum-of-norms regularization term, which provably recovers the underlying class…

Machine Learning · Computer Science 2023-05-23 Arman Rahbar , Ashkan Panahi , Morteza Haghir Chehreghani , Devdatt Dubhashi , Hamid Krim

This article introduces a generalization of the discrete optimal transport, with applications to color image manipulations. This new formulation includes a relaxation of the mass conservation constraint and a regularization term. These two…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Sira Ferradans , Nicolas Papadakis , Gabriel Peyré , Jean-François Aujol

Variational methods for revealing visual concepts learned by convolutional neural networks have gained significant attention during the last years. Being based on noisy gradients obtained via back-propagation such methods require the…

Machine Learning · Computer Science 2018-05-02 Maximilian Baust , Florian Ludwig , Christian Rupprecht , Matthias Kohl , Stefan Braunewell

We investigate a level-set type method for solving ill-posed problems, with the assumption that the solutions are piecewise, but not necessarily constant functions with unknown level sets and unknown level values. In order to get stable…

Numerical Analysis · Mathematics 2012-10-30 Adriano De Cezaro

The Convex Envelope of a given function was recently characterized as the solution of a fully nonlinear Partial Differential Equation (PDE). In this article we study a modified problem: the Dirichlet problem for the underlying PDE. The main…

Analysis of PDEs · Mathematics 2010-07-07 Luis Silvestre , Adam M. Oberman

Derived from the concentration-compactness principle, the concept of generalized minimizer can be used to define generalized solutions of variational problems which may have components ``infinitely'' distant from each other. In this article…

Analysis of PDEs · Mathematics 2024-06-25 Jules Candau-Tilh

In this paper we consider inverse problems that are mathematically ill-posed. That is, given some (noisy) data, there is more than one solution that approximately fits the data. In recent years, deep neural techniques that find the most…

Machine Learning · Computer Science 2023-08-28 Moshe Eliasof , Eldad Haber , Eran Treister

In the first part of this doctoral thesis we develop a regularity theory for a polyconvex functional in compressible elasticity. In the second part, we will concentrate on uniqueness questions in various situations of finite elasticity.…

Analysis of PDEs · Mathematics 2022-10-27 Marcel Dengler

We develop two adaptive discretization algorithms for convex semi-infinite optimization, which terminate after finitely many iterations at approximate solutions of arbitrary precision. In particular, they terminate at a feasible point of…

Optimization and Control · Mathematics 2022-01-14 Jochen Schmid , Miltiadis Poursanidis

Newton's method for finding an unconstrained minimizer for strictly convex functions, generally speaking, does not converge from any starting point. We introduce and study the damped regularized Newton's method (DRNM). It converges globally…

Optimization and Control · Mathematics 2017-06-27 Roman Polyak

We prove existence and regularity of minimizers for a class of functionals defined on Borel sets in $R^n$. Combining these results with a refinement of the selection principle introduced by the authors in arXiv:0911.0786, we describe a…

Analysis of PDEs · Mathematics 2011-01-04 Marco Cicalese , Gian Paolo Leonardi

We propose an adaptive regularization scheme in a variational framework where a convex composite energy functional is optimized. We consider a number of imaging problems including denoising, segmentation and motion estimation, which are…

Computer Vision and Pattern Recognition · Computer Science 2017-03-01 Byung-Woo Hong , Ja-Keoung Koo , Hendrik Dirks , Martin Burger

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

In this paper, we mainly study solution uniqueness of some convex optimization problems. Our characterizations of solution uniqueness are in terms of the radial cone. This approach allows us to know when a unique solution is a strong…

Optimization and Control · Mathematics 2024-01-22 Jalal Fadili , Tran T. A. Nghia , Duy Nhat Phan

An algorithm which computes a solution of a set optimization problem is provided. The graph of the objective map is assumed to be given by finitely many linear inequalities. A solution is understood to be a set of points in the domain…

Optimization and Control · Mathematics 2014-05-29 Andreas Löhne , Carola Schrage