English
Related papers

Related papers: Exponential convergence rate for Iterative Markovi…

200 papers

Modified policy iteration (MPI) is a dynamic programming algorithm that combines elements of policy iteration and value iteration. The convergence of MPI has been well studied in the context of discounted and average-cost MDPs. In this…

Machine Learning · Computer Science 2024-02-16 Yashaswini Murthy , Mehrdad Moharrami , R. Srikant

We consider a space-time fractional parabolic problem. Combining a sinc-quadrature based method for discretizing the Riesz-Dunford integral with $hp$-FEM in space yields an exponentially convergent scheme for the initial boundary value…

Numerical Analysis · Mathematics 2024-07-25 Jens Markus Melenk , Alexander Rieder

We develop a Frank-Wolfe algorithm with corrective steps, generalizing previous algorithms including blended conditional gradients, blended pairwise conditional gradients, and fully-corrective Frank-Wolfe. For this, we prove tight…

Optimization and Control · Mathematics 2026-05-21 Jannis Halbey , Seta Rakotomandimby , Mathieu Besançon , Sébastien Designolle , Sebastian Pokutta

In this paper, an important discovery has been found for nonconforming immersed finite element (IFE) methods using the integral values on edges as degrees of freedom for solving elliptic interface problems. We show that those IFE methods…

Numerical Analysis · Mathematics 2023-05-17 Haifeng Ji , Feng Wang , Jinru Chen , Zhilin Li

In this paper, we propose an extension of the forward improvement iteration algorithm, originally introduced in Irle (2006) and recently reconsidered in Miclo and Villeneuve (2021). The main new ingredient is a flexible window parameter…

Probability · Mathematics 2021-11-29 Sören Christensen , Albrecht Irle , Julian Peter Lemburg

The paper investigates two inertial extragradient algorithms for seeking a common solution to a variational inequality problem involving a monotone and Lipschitz continuous mapping and a fixed point problem with a demicontractive mapping in…

Optimization and Control · Mathematics 2023-08-08 Bing Tan , Liya Liu , Xiaolong Qin

Recently there has been renewed interests in derivative free approaches to stochastic optimization. In this paper, we examine the rates of convergence for the Kiefer-Wolfowitz algorithm and the mirror descent algorithm, under various…

Optimization and Control · Mathematics 2016-10-31 Liyi Dai

In this paper, we provide a detailed analysis of the global convergence properties of an extensively studied and extremely effective fixed-point algorithm for the Kullback-Leibler approximation of spectral densities, proposed by Pavon and…

Optimization and Control · Mathematics 2018-01-26 Giacomo Baggio

The intrinsic mode function (IMF) provides adaptive function bases for nonlinear and non-stationary time series data. A fast convergent iterative method is introduced in this paper to find the IMF components of the data, the method is…

Numerical Analysis · Computer Science 2008-09-11 Louis Yu Lu

We give a new proof of a result of Rudolph stating that a countable-state mixing Markov chain with exponential return times is finitarily isomorphic to an IID process. Besides being short and direct, our proof has the added benefit of…

Probability · Mathematics 2025-06-05 Yinon Spinka

In a recent result by the authors (ref. [1]) it was proved that solutions of the self-similar fragmentation equation converge to equilibrium exponentially fast. This was done by showing a spectral gap in weighted $L^2$ spaces of the…

Analysis of PDEs · Mathematics 2011-12-06 María J. Cáceres , José A. Cañizo , Stéphane Mischler

Informed Markov chain Monte Carlo (MCMC) methods have been proposed as scalable solutions to Bayesian posterior computation on high-dimensional discrete state spaces, but theoretical results about their convergence behavior in general…

Computation · Statistics 2022-02-01 Quan Zhou , Aaron Smith

We revisit a unified methodology for the iterative solution of nonlinear equations in Hilbert spaces. Our key observation is that the general approach from [Heid & Wihler, Math. Comp. 89 (2020), Calcolo 57 (2020)] satisfies an energy…

Numerical Analysis · Mathematics 2021-02-18 Pascal Heid , Dirk Praetorius , Thomas P. Wihler

Motivated by applications to distributed optimization over networks and large-scale data processing in machine learning, we analyze the deterministic incremental aggregated gradient method for minimizing a finite sum of smooth functions…

Optimization and Control · Mathematics 2018-01-16 Mert Gurbuzbalaban , Asuman Ozdaglar , Pablo Parrilo

In this paper, we develop a unified framework able to certify both exponential and subexponential convergence rates for a wide range of iterative first-order optimization algorithms. To this end, we construct a family of parameter-dependent…

Optimization and Control · Mathematics 2018-02-26 Mahyar Fazlyab , Alejandro Ribeiro , Manfred Morari , Victor M. Preciado

In this paper it is shown that adaptive importance sampling algorithms converge at exponential rate for Markov chain expectation problems that admit a combination of a filtered estimator and a Markov zero-variance measure. It extends a…

Probability · Mathematics 2018-07-11 Ludolf E. Meester

Maximizing the Kullback-Leibler divergence (KLD) is a fundamental problem in waveform design for active sensing and hypothesis testing, as it directly relates to the error exponent of detection probability. However, the associated…

Signal Processing · Electrical Eng. & Systems 2026-01-05 Jeongwoo Park , Seongkyu Jung , Kaiming Shen , Jeonghun Park

Consider a reference Markov process with initial distribution $\pi_{0}$ and transition kernels $\{M_{t}\}_{t\in[1:T]}$, for some $T\in\mathbb{N}$. Assume that you are given distribution $\pi_{T}$, which is not equal to the marginal…

Computation · Statistics 2020-01-01 Espen Bernton , Jeremy Heng , Arnaud Doucet , Pierre E. Jacob

We consider the approximation of the ground state of the one-dimensional cubic nonlinear Schr{\"o}dinger equation by a normalized gradient algorithm combined with linearly implicit time integrator, and finite difference space approximation.…

Numerical Analysis · Mathematics 2016-03-09 Erwan Faou , Tiphaine Jézéquel

In this paper two types of multgrid methods, i.e., the Rayleigh quotient iteration and the inverse iteration with fixed shift, are developed for solving the Maxwell eigenvalue problem with discontinuous relative magnetic permeability and…

Numerical Analysis · Mathematics 2017-02-28 Jiayu Han