English
Related papers

Related papers: Convergence rates for regularization functionals w…

200 papers

The randomized version of the Kaczmarz method for the solution of linear systems is known to converge linearly in expectation. In this work we extend this result and show that the recently proposed Randomized Sparse Kaczmarz method for…

Optimization and Control · Mathematics 2016-10-11 Frank Schöpfer , Dirk A. Lorenz

This article gives dual representations for convex integral functionals on the linear space of regular processes. This space turns out to be a Banach space containing many more familiar classes of stochastic processes and its dual can be…

Probability · Mathematics 2017-01-18 Teemu Pennanen , Ari-Pekka Perkkiö

Based on a result by Taylor, Hendrickx, and Glineur (J. Optim. Theory Appl., 178(2):455--476, 2018) on the attainable convergence rate of gradient descent for smooth and strongly convex functions in terms of function values, an elementary…

Optimization and Control · Mathematics 2022-03-25 André Uschmajew , Bart Vandereycken

Convex regression is the problem of fitting a convex function to a data set consisting of input-output pairs. We present a new approach to this problem called spectrahedral regression, in which we fit a spectrahedral function to the data,…

Optimization and Control · Mathematics 2021-11-01 Eliza O'Reilly , Venkat Chandrasekaran

Stochastic methods for minimizing a convex integral functional, as initiated by Robbins and Monro in the early 1950s, rely on the evaluation of a gradient (or subgradient if the function is not smooth) and moving in the corresponding…

Optimization and Control · Mathematics 2016-05-12 Miroslav Bacak

We introduce the notion of consistent error bound functions which provides a unifying framework for error bounds for multiple convex sets. This framework goes beyond the classical Lipschitzian and H\"olderian error bounds and includes…

Optimization and Control · Mathematics 2023-10-20 Tianxiang Liu , Bruno F. Lourenço

In this paper, we propose a first second-order scheme based on arbitrary non-Euclidean norms, incorporated by Bregman distances. They are introduced directly in the Newton iterate with regularization parameter proportional to the square…

Optimization and Control · Mathematics 2021-12-07 Nikita Doikov , Yurii Nesterov

Our work focuses on stochastic gradient methods for optimizing a smooth non-convex loss function with a non-smooth non-convex regularizer. Research on this class of problem is quite limited, and until recently no non-asymptotic convergence…

Optimization and Control · Mathematics 2019-05-15 Michael R. Metel , Akiko Takeda

We consider a statistical inverse learning problem, where we observe the image of a function $f$ through a linear operator $A$ at i.i.d. random design points $X_i$, superposed with an additive noise. The distribution of the design points is…

Machine Learning · Statistics 2016-04-15 Gilles Blanchard , Nicole Mücke

This paper deals with more refinements of inequalities related to deviations from Mean Value involving superquadratic and uniformly convex functions.

Functional Analysis · Mathematics 2025-08-12 Shoshana Abramovich

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

A common goal in observational research is to estimate marginal causal effects in the presence of confounding variables. One solution to this problem is to use the covariate distribution to weight the outcomes such that the data appear…

Methodology · Statistics 2020-08-18 Kevin P. Josey , Elizabeth Juarez-Colunga , Fan Yang , Debashis Ghosh

We propose a new stochastic gradient method for optimizing the sum of a finite set of smooth functions, where the sum is strongly convex. While standard stochastic gradient methods converge at sublinear rates for this problem, the proposed…

Optimization and Control · Mathematics 2013-03-12 Nicolas Le Roux , Mark Schmidt , Francis Bach

This paper studies the convergence of the mirror descent algorithm for finite horizon stochastic control problems with measure-valued control processes. The control objective involves a convex regularisation function, denoted as $h$, with…

Optimization and Control · Mathematics 2025-08-22 Bekzhan Kerimkulov , David Šiška , Łukasz Szpruch , Yufei Zhang

In this paper, we consider the asymptotical regularization with convex constraints for nonlinear ill-posed problems. The method allows to use non-smooth penalty terms, including the L1-like and the total variation-like penalty functionals,…

Numerical Analysis · Mathematics 2022-03-23 Min Zhong , Wei Wang

In this paper we introduce the class of infinite infimal convolution functionals and apply these functionals to the regularization of ill-posed inverse problems. The proposed regularization involves an infimal convolution of a continuously…

Optimization and Control · Mathematics 2024-12-17 Kristian Bredies , Marcello Carioni , Martin Holler , Yury Korolev , Carola-Bibiane Schönlieb

In recent years, a series of convergence rates conditions for regularization methods has been developed. Mainly, the motivations for developing novel conditions came from the desire to carry over convergence rates results from the Hilbert…

Functional Analysis · Mathematics 2014-09-29 Roman Andreev , Peter Elbau , Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

In this paper a new family of minimum divergence estimators based on the Bregman divergence is proposed, where the defining convex function has an exponential nature. These estimators avoid the necessity of using an intermediate kernel…

Methodology · Statistics 2019-11-25 Taranga Mukherjee , Abhijit Mandal , Ayanendranath Basu

We provide some counterexamples concerning the uniqueness and regularity of weak solutions to the initial-boundary value problem for gradient flows of certain strongly polyconvex functionals by showing that such a problem can possess a…

Analysis of PDEs · Mathematics 2022-05-17 Baisheng Yan

We consider the problem of minimizing a function, which is the sum of a linear function and a composition of a strongly convex function with a linear transformation, over a compact polyhedral set. Jaggi and Lacoste-Julien [14] showed that…

Optimization and Control · Mathematics 2015-04-21 Amir Beck , Shimrit Shtern
‹ Prev 1 4 5 6 7 8 10 Next ›