English
Related papers

Related papers: Quantitative Strong Convergence for the Hybrid Ste…

200 papers

We propose and analyze the convergence of a novel stochastic forward-backward splitting algorithm for solving monotone inclusions given by the sum of a maximal monotone operator and a single-valued maximal monotone cocoercive operator. This…

Optimization and Control · Mathematics 2015-02-23 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

This work studies an explicit embedding of the set of probability measures into a Hilbert space, defined using optimal transport maps from a reference probability density. This embedding linearizes to some extent the 2-Wasserstein space,…

Machine Learning · Statistics 2022-05-05 Quentin Mérigot , Alex Delalande , Frédéric Chazal

In this work, we consider constrained stochastic optimization problems under hidden convexity, i.e., those that admit a convex reformulation via non-linear (but invertible) map $c(\cdot)$. A number of non-convex problems ranging from…

Optimization and Control · Mathematics 2024-11-12 Ilyas Fatkhullin , Niao He , Yifan Hu

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

We consider a class of nonsmooth optimization problems over the Stiefel manifold, in which the objective function is weakly convex in the ambient Euclidean space. Such problems are ubiquitous in engineering applications but still largely…

Optimization and Control · Mathematics 2021-03-26 Xiao Li , Shixiang Chen , Zengde Deng , Qing Qu , Zhihui Zhu , Anthony Man Cho So

We study a general class of bilevel problems, consisting in the minimization of an upper-level objective which depends on the solution to a parametric fixed-point equation. Important instances arising in machine learning include…

Machine Learning · Statistics 2020-07-13 Riccardo Grazzi , Luca Franceschi , Massimiliano Pontil , Saverio Salzo

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

We study posterior contraction rates for mixing measures in homoscedastic location-scale mixture models with infinitely many components. While posterior convergence at the level of densities is well understood, ensuring convergence of the…

Statistics Theory · Mathematics 2026-05-11 Nicola Bariletto , Dung Le , Alessandro Rinaldo , Nhat Ho

In this paper, we introduce a new iterative method to find a common solution of a generalized mixed equilibrium problem, a variational inequality problem and a hierarchical fixed point problem for a demicontinuous nearly nonexpansive…

Functional Analysis · Mathematics 2014-09-17 Ibrahim Karahan

We propose deep learning methods for classical Monge's optimal mass transportation problems, where where the distribution constraint is treated as penalty terms defined by the maximum mean discrepancy in the theory of Hilbert space…

Optimization and Control · Mathematics 2026-02-17 Takafumi Saito , Yumiharu Nakano

We study the convergence of the new family of mimetic finite difference schemes for linear diffusion problems recently proposed in [38]. In contrast to the conventional approach, the diffusion coefficient enters both the primary mimetic…

Numerical Analysis · Mathematics 2016-12-07 G. Manzini , K. Lipnikov , J. D. Moulton , M. Shashkov

The restricted strong convexity is an effective tool for deriving globally linear convergence rates of descent methods in convex minimization. Recently, the global error bound and quadratic growth properties appeared as new competitors. In…

Optimization and Control · Mathematics 2016-06-21 Hui Zhang

In this paper, we propose a unified convergence analysis for a class of generic shuffling-type gradient methods for solving finite-sum optimization problems. Our analysis works with any sampling without replacement strategy and covers many…

Optimization and Control · Mathematics 2021-09-21 Lam M. Nguyen , Quoc Tran-Dinh , Dzung T. Phan , Phuong Ha Nguyen , Marten van Dijk

We propose a family of optimization methods that achieve linear convergence using first-order gradient information and constant step sizes on a class of convex functions much larger than the smooth and strongly convex ones. This larger…

Optimization and Control · Mathematics 2018-09-14 Chris J. Maddison , Daniel Paulin , Yee Whye Teh , Brendan O'Donoghue , Arnaud Doucet

Stochastic gradient descent (SGD) is a promising method for solving large-scale inverse problems, due to its excellent scalability with respect to data size. In this work, we analyze a new data-driven regularized stochastic gradient descent…

Numerical Analysis · Mathematics 2024-09-30 Zehui Zhou

It is shown that the contraction mapping principle with the involvement of a Carleman Weight Function works for a Coefficient Inverse Problem for a 1D hyperbolic equation. Using a Carleman estimate, the global convergence of the…

Numerical Analysis · Mathematics 2022-03-23 Thuy T. Le , Michael V. Klibanov , Loc H. Nguyen , Anders Sullivan , Lam Nguyen

Discrete optimization is a central problem in mathematical optimization with a broad range of applications, among which binary optimization and sparse optimization are two common ones. However, these problems are NP-hard and thus difficult…

Optimization and Control · Mathematics 2018-11-26 Ganzhao Yuan , Li Shen , Wei-Shi Zheng

The motivation for this paper stems from the desire to develop an adaptive sampling method for solving constrained optimization problems in which the objective function is stochastic and the constraints are deterministic. The method…

Optimization and Control · Mathematics 2021-01-01 Yuchen Xie , Raghu Bollapragada , Richard Byrd , Jorge Nocedal

In infinite-dimensional Hilbert spaces we device a class of strongly convergent primal-dual schemes for solving variational inequalities defined by a Lipschitz continuous and pseudomonote map. Our novel numerical scheme is based on Tseng's…

Optimization and Control · Mathematics 2019-08-27 Benoit Duvocelle , Dennis Meier , Mathias Staudigl , Phan Tu Vuong

Constrained quasiconvex optimization problems appear in many fields, such as economics, engineering, and management science. In particular, fractional programming, which models ratio indicators such as the profit/cost ratio as fractional…

Optimization and Control · Mathematics 2019-09-02 Kazuhiro Hishinuma , Hideaki Iiduka