English
Related papers

Related papers: Universality for non-linear convex variational pro…

200 papers

The aim of this paper is to establish strong convergence theorems for a strongly relatively nonexpansive sequence in a smooth and uniformly convex Banach space. Then we employ our results to approximate solutions of the zero point problem…

Functional Analysis · Mathematics 2020-12-29 Koji Aoyama , Yasunori Kimura , Fumiaki Kohsaka

Finding the solutions of nonlinear operator equations has been a subject of research for decades but has recently attracted much attention. This paper studies the convergence of a newly introduced viscosity implicit iterative algorithm to a…

Functional Analysis · Mathematics 2020-07-20 Mathew O. Aibinu , Surendra C. Thakur , Sibusiso Moyo

Landweber-type methods are prominent for solving ill-posed inverse problems in Banach spaces and their convergence has been well-understood. However, how to derive their convergence rates remains a challenging open question. In this paper,…

Numerical Analysis · Mathematics 2024-11-15 Qinian Jin

We investigate 1) the rate at which refined properties of the empirical risk---in particular, gradients---converge to their population counterparts in standard non-convex learning tasks, and 2) the consequences of this convergence for…

Machine Learning · Computer Science 2018-11-13 Dylan J. Foster , Ayush Sekhari , Karthik Sridharan

The current paper presents a novel machinery for studying non-asymptotic minimax estimation of high-dimensional matrices, which yields tight minimax rates for a large collection of loss functions in a variety of problems. Based on the…

Statistics Theory · Mathematics 2013-06-18 Zongming Ma , Yihong Wu

In this article on variational regularization for ill-posed nonlinear problems, we are once again discussing the consequences of an oversmoothing penalty term. This means in our model that the searched-for solution of the considered…

Numerical Analysis · Mathematics 2023-05-02 Bernd Hofmann , Chantal Klinkhammer , Robert Plato

We present a framework to calculate large deviations for nonlinear functions of independent random variables supported on compact sets in Banach spaces, by extending the result in Chatterjee and Dembo [6]. Previous research on nonlinear…

Probability · Mathematics 2018-07-12 Jun Yan

Sufficient conditions for the invariance of evolution problems governed by perturbations of (possibly nonlinear) $m$-accretive operators are provided. The conditions for the invariance with respect to sublevel sets of a constraint…

Analysis of PDEs · Mathematics 2020-12-21 Aleksander Ćwiszewski , Grzegorz Gabor , Wojciech Kryszewski

We study sparse approximate solutions to convex optimization problems. It is known that in many engineering applications researchers are interested in an approximate solution of an optimization problem as a linear combination of elements…

Machine Learning · Statistics 2012-06-05 V. N. Temlyakov

In this paper we consider a dual gradient method for solving linear ill-posed problems $Ax = y$, where $A : X \to Y$ is a bounded linear operator from a Banach space $X$ to a Hilbert space $Y$. A strongly convex penalty function is used in…

Numerical Analysis · Mathematics 2022-06-16 Qinian Jin

Neural networks have become ubiquitous tools for solving signal and image processing problems, and they often outperform standard approaches. Nevertheless, training neural networks is a challenging task in many applications. The prevalent…

Optimization and Control · Mathematics 2022-10-28 Patrick L. Combettes , Jean-Christophe Pesquet , Audrey Repetti

This paper introduces a novel theoretical framework for the analysis of vector-valued neural networks through the development of vector-valued variation spaces, a new class of reproducing kernel Banach spaces. These spaces emerge from…

Machine Learning · Statistics 2024-08-21 Joseph Shenouda , Rahul Parhi , Kangwook Lee , Robert D. Nowak

Using the KKM technique, we establish some existence results for variational-hemivariational inequalities involving monotone set valued mappings on bounded, closed and convex subsets in reflexive Banach spaces. We also derive several…

Classical Analysis and ODEs · Mathematics 2009-09-09 Nicusor Costea , Cezar Lupu

This paper proposes novel algorithm for non-convex multimodal constrained optimisation problems. It is based on sequential solving restrictions of problem to sections of feasible set by random subspaces (in general, manifolds) of low…

Optimization and Control · Mathematics 2023-03-28 Dmitry A. Pasechnyuk , Alexander Gornov

While optimizing convex objective (loss) functions has been a powerhouse for machine learning for at least two decades, non-convex loss functions have attracted fast growing interests recently, due to many desirable properties such as…

Machine Learning · Statistics 2018-02-14 Chao Qu , Yan Li , Huan Xu

The primary objective of this research is to investigate an inverse problem of parameter identification in nonlinear mixed quasi-variational inequalities posed in a Banach space setting. By using a fixed point theorem, we explore properties…

Analysis of PDEs · Mathematics 2019-02-20 Stanislaw Migorski , Akhtar A. Khan , Shengda Zeng

We consider a class of inverse problems defined by a nonlinear map from parameter or model functions to the data. We assume that solutions exist. The space of model functions is a Banach space which is smooth and uniformly convex; however,…

Functional Analysis · Mathematics 2015-05-30 Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

We present a subgradient method for minimizing non-smooth, non-Lipschitz convex optimization problems. The only structure assumed is that a strictly feasible point is known. We extend the work of Renegar [5] by taking a different…

Optimization and Control · Mathematics 2018-02-28 Benjamin Grimmer

In this article, we present a greedy algorithm based on a tensor product decomposition, whose aim is to compute the global minimum of a strongly convex energy functional. We prove the convergence of our method provided that the gradient of…

Functional Analysis · Mathematics 2015-03-13 Eric Cances , Virginie Ehrlacher , Tony Lelievre

We introduce and investigate an iterative scheme for approximating common fixed point of a family of Bregman relatively-nonexpansive mappings in real reflexive Banach spaces. We prove strong convergence theorem of the sequence generated by…

Functional Analysis · Mathematics 2017-07-27 Oladipo Abiodun Timoye , Enyinnaya Ekuma-Okereke