English
Related papers

Related papers: Exponential convergence rate for Iterative Markovi…

200 papers

This paper studies the mixing time of certain adaptive Markov Chain Monte Carlo algorithms. Under some regularity conditions, we show that the convergence rate of Importance Resampling MCMC (IRMCMC) algorithm, measured in terms of the total…

Probability · Mathematics 2014-07-29 Yves Atchadé , Yizao Wang

We investigate the problem of minimizing Kullback-Leibler divergence between a linear model $Ax$ and a positive vector $b$ in different convex domains (positive orthant, $n$-dimensional box, probability simplex). Our focus is on the SMART…

Optimization and Control · Mathematics 2024-01-11 Maren Raus , Yara Elshiaty , Stefania Petra

We introduce a mesh-type approach for tackling discrete-time, finite-horizon Markov Decision Processes (MDPs) characterized by state and action spaces that are general, encompassing both finite and infinite (yet suitably regular) subsets of…

Optimization and Control · Mathematics 2024-07-02 Denis Belomestny , John Schoenmakers

We prove optimal convergence rates for certain low-regularity integrators applied to the one-dimensional periodic nonlinear Schr\"odinger and wave equations under the assumption of $H^1$ solutions. For the Schr\"odinger equation we analyze…

Numerical Analysis · Mathematics 2026-04-15 Maximilian Ruff

To characterize the Kullback-Leibler divergence and Fisher information in general parametrized hidden Markov models, in this paper, we first show that the log likelihood and its derivatives can be represented as an additive functional of a…

Statistics Theory · Mathematics 2023-03-15 Cheng-Der Fuh , Chu-Lan Michael Kao , Tianxiao Pang

Iterative Proportional Fitting (IPF), combined with EM, is commonly used as an algorithm for likelihood maximization in undirected graphical models. In this paper, we present two iterative algorithms that generalize upon IPF. The first one…

Machine Learning · Computer Science 2013-01-07 Wim Wiegerinck , Tom Heskes

This paper establishes that an MDP with a unique optimal policy and ergodic associated transition matrix ensures the convergence of various versions of the Value Iteration algorithm at a geometric rate that exceeds the discount factor…

Machine Learning · Computer Science 2024-06-17 Arsenii Mustafin , Alex Olshevsky , Ioannis Ch. Paschalidis

Data heterogeneity has been a long-standing bottleneck in studying the convergence rates of Federated Learning algorithms. In order to better understand the issue of data heterogeneity, we study the convergence rate of the…

Machine Learning · Statistics 2026-03-24 Zhixu Tao , Rajita Chandak , Sanjeev Kulkarni

Schr\"{o}dinger bridge is a stochastic optimal control problem to steer a given initial state density to another, subject to controlled diffusion and deadline constraints. A popular method to numerically solve the Schr\"{o}dinger bridge…

Optimization and Control · Mathematics 2023-09-14 Alexis M. H. Teter , Yongxin Chen , Abhishek Halder

The perfect fluid limit can be obtained from the Boltzmann equation in the limit of vanishing Knudsen number. By treating the collision term in an implicit manner, the implicit-explicit (IMEX) time stepping scheme allows this limit to be…

Computational Physics · Physics 2020-04-22 Stefan T. Kis , Victor E. Ambrus

The goal of this paper is to investigate new and simple convergence analysis of dynamic programming for linear quadratic regulator problem of discrete-time linear time-invariant systems. In particular, bounds on errors are given in terms of…

Optimization and Control · Mathematics 2021-06-18 Donghwan Lee

Independent learning (IL), despite being a popular approach in practice to achieve scalability in large-scale multi-agent systems, usually lacks global convergence guarantees. In this paper, we study two representative algorithms,…

Machine Learning · Computer Science 2024-05-31 Ruiyang Jin , Zaiwei Chen , Yiheng Lin , Jie Song , Adam Wierman

The RFMP is an iterative regularization method for a class of linear inverse problems. It has proved to be applicable to problems which occur, for example, in the geosciences. In the early publications [Fischer2011] and [FischerMichel2012],…

Numerical Analysis · Mathematics 2021-12-23 Prof. Dr. Volker Michel , Sarah Orzlowski

The unified transform method (UTM) for analyzing initial-boundary value (IBV) problems provides an important generalization of the inverse scattering transform (IST) method for analyzing initial value problems. In comparison with the IST, a…

Exactly Solvable and Integrable Systems · Physics 2019-04-24 Baoqiang Xia

This paper deals with a method for the approximation of a spectral density function among the solutions of a generalized moment problem a` la Byrnes/Georgiou/Lindquist. The approximation is pursued with respect to the Kullback-Leibler…

Optimization and Control · Mathematics 2009-11-04 Augusto Ferrante , Federico Ramponi , Francesco Ticozzi

We compare exponential-type integrators for the numerical time-propagation of the equations of motion arising in the multi-configuration time-dependent Hartree-Fock method for the approximation of the high-dimensional multi-particle…

Numerical Analysis · Mathematics 2019-05-15 Winfried Auzinger , Alexander Grosz , Harald Hofstätter , Othmar Koch

We investigate the problem of balanced embedding of a non-compact complex manifold into an infinite-dimensional projective space. In this paper we prove the existence of such an embedding in a model case. The strategy is by using a gradient…

Complex Variables · Mathematics 2023-09-06 Jingzhou Sun , Song Sun

In this paper, we prove some convergence results of a special case of optimistic policy iteration algorithm for stochastic shortest path problem. We consider both Monte Carlo and $TD(\lambda)$ methods for the policy evaluation step under…

Machine Learning · Computer Science 2018-08-31 Yuanlong Chen

We prove that for compactly perturbed elliptic problems, where the corresponding bilinear form satisfies a Garding inequality, adaptive mesh-refinement is capable of overcoming the preasymptotic behavior and eventually leads to convergence…

Numerical Analysis · Mathematics 2017-01-30 Alex Bespalov , Alexander Haberl , Dirk Praetorius

We propose and analyze a mixed finite element method for the spatial approximation of a time-fractional Fokker--Planck equation in a convex polyhedral domain, where the given driving force is a function of space. Taking into account the…

Numerical Analysis · Mathematics 2024-03-26 Samir Karaa , Kassem Mustapha , Naveed Ahmed