English
Related papers

Related papers: Exponential convergence of general iterative propo…

200 papers

We propose deep learning methods for classical Monge's optimal mass transportation problems, where where the distribution constraint is treated as penalty terms defined by the maximum mean discrepancy in the theory of Hilbert space…

Optimization and Control · Mathematics 2026-02-17 Takafumi Saito , Yumiharu Nakano

Incremental gradient and incremental proximal methods are a fundamental class of optimization algorithms used for solving finite sum problems, broadly studied in the literature. Yet, without strong convexity, their convergence guarantees…

Optimization and Control · Mathematics 2024-07-01 Xufeng Cai , Jelena Diakonikolas

Interior point methods (IPMs) are a common approach for solving linear programs (LPs) with strong theoretical guarantees and solid empirical performance. The time complexity of these methods is dominated by the cost of solving a linear…

Optimization and Control · Mathematics 2022-02-04 Gregory Dexter , Agniva Chowdhury , Haim Avron , Petros Drineas

In this paper, we introduce and study a new extragradient iterative process for finding a common element of the set of fixed points of an infinite family of nonexpansive mappings and the set of solutions of a variational inequality for an…

Functional Analysis · Mathematics 2014-05-22 Ibrahim Karahan , Murat Ozdemir

The ability to compare two degenerate probability distributions (i.e. two probability distributions supported on two distinct low-dimensional manifolds living in a much higher-dimensional space) is a crucial problem arising in the…

Machine Learning · Statistics 2017-10-23 Aude Genevay , Gabriel Peyré , Marco Cuturi

We consider and analyze applying a spectral inverse iteration algorithm and its subspace iteration variant for computing eigenpairs of an elliptic operator with random coefficients. With these iterative algorithms the solution is sought…

Numerical Analysis · Computer Science 2017-06-16 Harri Hakula , Mikael Laaksonen

An optimal transport (OT) problem seeks to find the cheapest mapping between two distributions with equal total density, given the cost of transporting density from one place to another. Unbalanced OT allows for different total density in…

Optimization and Control · Mathematics 2025-07-28 Jacob J. M. Francis , Colin J. Cotter , Marion P. Mittermaier

The robust PCA problem, wherein, given an input data matrix that is the superposition of a low-rank matrix and a sparse matrix, we aim to separate out the low-rank and sparse components, is a well-studied problem in machine learning. One…

Machine Learning · Computer Science 2017-07-06 U. N. Niranjan , Arun Rajkumar , Theja Tulabandhula

Complexity of the Operations Research Theory tasks can be often diminished in cases that do not require finding the exact solution. For example, forecasting two-dimensional hierarchical time series leads us to the transportation problem…

Optimization and Control · Mathematics 2019-09-06 S. V. Rotin , I. V. Gusakov , V. Ya. Gusakov

In this paper we address the complexity of solving linear programming problems with a set of differential equations that converge to a fixed point that represents the optimal solution. Assuming a probabilistic model, where the inputs are…

Computational Complexity · Computer Science 2007-05-23 Asa Ben-Hur , Joshua Feinberg , Shmuel Fishman , Hava T. Siegelmann

Flexible Bayesian models are typically constructed using limits of large parametric models with a multitude of parameters that are often uninterpretable. In this article, we offer a novel alternative by constructing an exponentially tilted…

Methodology · Statistics 2023-03-20 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

We present a method to extract temporal hypergraphs from sequences of 2-dimensional functions obtained as solutions to Optimal Transport problems. We investigate optimality principles exhibited by these solutions from the point of view of…

Discrete Mathematics · Computer Science 2023-01-10 Diego Baptista , Caterina De Bacco

We study the minimization of smooth, possibly nonconvex functions over the positive orthant, a key setting in Poisson inverse problems, using the exponentiated gradient (EG) method. Interpreting EG as Riemannian gradient descent (RGD) with…

Optimization and Control · Mathematics 2025-04-08 Yara Elshiaty , Ferdinand Vanmaele , Stefania Petra

In order to circumvent the difficulties in solving numerically the discrete optimal transport problem, in which one minimizes the linear target function $P\mapsto\langle C,P\rangle:=\sum_{i,j}C_{ij}P_{ij}$, Cuturi introduced a variant of…

Optimization and Control · Mathematics 2020-11-30 Daiji Tsutsui

We propose iterative proportional scaling (IPS) via decomposable submodels for maximizing likelihood function of a hierarchical model for contingency tables. In ordinary IPS the proportional scaling is performed by cycling through the…

Statistics Theory · Mathematics 2009-01-27 Yushi Endo , Akimichi Takemura

We analyse a version of the policy iteration algorithm for the discounted infinite-horizon problem for controlled multidimensional diffusion processes, where both the drift and the diffusion coefficient can be controlled. We prove that,…

Probability · Mathematics 2017-07-26 Saul D. Jacka , Aleksandar Mijatovic , Dejan Siraj

Recently there has been an increasing interest in primal-dual methods for model predictive control (MPC), which require minimizing the (augmented) Lagrangian at each iteration. We propose a novel first order primal-dual method, termed…

Optimization and Control · Mathematics 2020-12-21 Yue Yu , Purnanand Elango , Behçet Açikmeşe

The article is devoted to the formulation and proof of the theorem on convergence with probability 1 of expansion of iterated Ito stochastic integrals of arbitrary multiplicity based on generalized multiple Fourier series converging in the…

Probability · Mathematics 2026-02-11 Dmitriy F. Kuznetsov

Matrix scaling problems with sparse cost matrices arise frequently in various domains, such as optimal transport, image processing, and machine learning. The Sinkhorn-Knopp algorithm is a popular iterative method for solving these problems,…

Optimization and Control · Mathematics 2024-06-26 Jose Rafael Espinosa Mena

Many causal parameters depend on a moment of the joint distribution of potential outcomes. Such parameters are especially relevant in policy evaluation settings, where noncompliance is common and accommodated through the model of Imbens &…

Econometrics · Economics 2023-11-17 Daniel Ober-Reynolds