English
Related papers

Related papers: Effective Condition Number Bounds for Convex Regul…

200 papers

We consider linear and obstacle problems driven by a nonlocal integral operator, for which nonlocal interactions are restricted to a ball of finite radius. These type of operators are used to model anomalous diffusion and, for a special…

Numerical Analysis · Mathematics 2018-04-30 Olena Burkovska , Max Gunzburger

The softmax function is a ubiquitous component at the output of neural networks and increasingly in intermediate layers as well. This paper provides convex lower bounds and concave upper bounds on the softmax function, which are compatible…

Machine Learning · Computer Science 2023-03-06 Dennis Wei , Haoze Wu , Min Wu , Pin-Yu Chen , Clark Barrett , Eitan Farchi

We establish a result which states that regularizing an inverse problem with the gauge of a convex set $C$ yields solutions which are linear combinations of a few extreme points or elements of the extreme rays of $C$. These can be…

Optimization and Control · Mathematics 2018-12-12 Claire Boyer , Antonin Chambolle , Yohann de Castro , Vincent Duval , Frédéric de Gournay , Pierre Weiss

The use of convex regularizers allows for easy optimization, though they often produce biased estimation and inferior prediction performance. Recently, nonconvex regularizers have attracted a lot of attention and outperformed convex ones.…

Optimization and Control · Mathematics 2017-02-14 Quanming Yao , James. T Kwok

We present an algorithm for robust model predictive control with consideration of uncertainty and safety constraints. Our framework considers a nonlinear dynamical system subject to disturbances from an unknown but bounded uncertainty set.…

Optimization and Control · Mathematics 2021-04-23 Dongchan Lee , Konstantin Turitsyn , Jean-Jacques Slotine

We show that several classical quantities controlling compressed sensing performance directly match classical parameters controlling algorithmic complexity. We first describe linearly convergent restart schemes on first-order methods…

Optimization and Control · Mathematics 2018-11-05 Vincent Roulet , Nicolas Boumal , Alexandre d'Aspremont

In this paper, we introduce a general framework for analyzing the numerical conditioning of minimal problems in multiple view geometry, using tools from computational algebra and Riemannian geometry. Special motivation comes from the fact…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Hongyi Fan , Joe Kileel , Benjamin Kimia

Variational sparsity regularization based on $\ell^1$-norms and other nonlinear functionals has gained enormous attention recently, both with respect to its applications and its mathematical analysis. A focus in regularization theory has…

Numerical Analysis · Mathematics 2015-06-11 Martin Burger , Jens Flemming , Bernd Hofmann

We consider the problem of designing efficient regularization algorithms when regularization is encoded by a (strongly) convex functional. Unlike classical penalization methods based on a relaxation approach, we propose an iterative method…

Optimization and Control · Mathematics 2017-07-19 Simon Matet , Lorenzo Rosasco , Silvia Villa , Bang Long Vu

In two-phase image segmentation, convex relaxation has allowed global minimisers to be computed for a variety of data fitting terms. Many efficient approaches exist to compute a solution quickly. However, we consider whether the nature of…

Numerical Analysis · Mathematics 2018-08-01 Jack Spencer

We analyze a convex stochastic optimization problem where the state is assumed to belong to the Bochner space of essentially bounded random variables with images in a reflexive and separable Banach space. For this problem, we obtain…

Optimization and Control · Mathematics 2022-09-21 Caroline Geiersbach , Winnifried Wollner

Selecting appropriate regularization coefficients is critical to performance with respect to regularized empirical risk minimization problems. Existing theoretical approaches attempt to determine the coefficients in order for regularized…

Machine Learning · Computer Science 2019-09-05 Akihiro Yabe , Takanori Maehara

We propose an operator preconditioner for general elliptic pseudodifferential equations in a domain $\Omega$, where $\Omega$ is either in $\mathbb{R}^n$ or in a Riemannian manifold. For linear systems of equations arising from low-order…

Numerical Analysis · Mathematics 2021-06-03 Heiko Gimperlein , Jakub Stocek , Carolina Urzua-Torres

We present algorithms for efficiently learning regularizers that improve generalization. Our approach is based on the insight that regularizers can be viewed as upper bounds on the generalization gap, and that reducing the slack in the…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter

Using oblique projections and angles between subspaces we write condition number estimates for abstract nonsymmetric domain decomposition methods. In particular, we consider a restricted additive method for the Poisson equation and write a…

Numerical Analysis · Mathematics 2023-04-19 Juan Galvis

We prove three results concerning convolution operators and lacunary maximal functions associated to dilates of measures. First, we obtain an $H^1$ to $L^{1,\infty}$ bound for lacunary maximal operators under a dimensional assumption on the…

Classical Analysis and ODEs · Mathematics 2012-03-20 Andreas Seeger , James Wright

In this work we collect and compare to each other many different numerical methods for regularized regression problem and for the problem of projection on a hyperplane. Such problems arise, for example, as a subproblem of demand matrix…

In this paper, we study the solution uniqueness of an individual feasible vector of a class of convex optimization problems involving convex piecewise affine functions and subject to general polyhedral constraints. This class of problems…

Optimization and Control · Mathematics 2017-11-17 Seyedahmad Mousavi , Jinglai Shen

Solving inverse problems \(Ax = y\) is central to a variety of practically important fields such as medical imaging, remote sensing, and non-destructive testing. The most successful and theoretically best-understood method is convex…

Numerical Analysis · Mathematics 2025-09-23 Daniel Obmann , Gyeongha Hwang , Markus Haltmeier

The $L^2$ theory of the $\bar\partial$ operator on domains in $\mathbb{C}^n$ is predicated on establishing a good basic estimate. Typically, one proves not a single basic estimate but a family of basic estimates that we call a family of…

Complex Variables · Mathematics 2019-04-23 Phillip S. Harrington , Andrew Raich