English
Related papers

Related papers: Optimizing the eigenvector computation algorithm w…

200 papers

This paper concerns the use of the expectation-maximisation (EM) algorithm for inference in partially observed diffusion processes. In this context, a well known problem is that all except a few diffusion processes lack closed-form…

Statistics Theory · Mathematics 2010-08-18 Jimmy Olsson , Jonas Ströjby

We propose a second-order accurate method to estimate the eigenvectors of extremely large matrices thereby addressing a problem of relevance to statisticians working in the analysis of very large datasets. More specifically, we show that…

Numerical Analysis · Mathematics 2010-02-05 Noureddine El Karoui , Alexandre d'Aspremont

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are…

Optimization and Control · Mathematics 2018-06-08 Ran Xin , Usman A. Khan

In this paper we build on previous work which uses inferences techniques, in particular Markov Chain Monte Carlo (MCMC) methods, to solve parameterized control problems. We propose a number of modifications in order to make this approach…

Machine Learning · Computer Science 2012-05-14 Matthias Hoffman , Hendrik Kueck , Nando de Freitas , Arnaud Doucet

In this paper, we investigate distributed inference schemes, over binary-valued Markov random fields, which are realized by the belief propagation (BP) algorithm. We first show that a decision variable obtained by the BP algorithm in a…

Information Theory · Computer Science 2019-09-19 Younes Abdi , Tapani Ristaniemi

The behavior of a Lattice Monte Carlo algorithm (if it is designed correctly) must approach that of the continuum system that it is designed to simulate as the time step and the mesh step tend to zero. However, we show for an algorithm for…

Statistical Mechanics · Physics 2010-08-23 Mykyta V. Chubynsky , Gary W. Slater

We study efficient distributed algorithms for the fundamental problem of principal component analysis and leading eigenvector computation on the sphere, when the data are randomly distributed among a set of computational nodes. We propose a…

Optimization and Control · Mathematics 2021-10-28 Foivos Alimisis , Peter Davies , Bart Vandereycken , Dan Alistarh

We introduce discriminator guidance in the setting of Autoregressive Diffusion Models. The use of a discriminator to guide a diffusion process has previously been used for continuous diffusion models, and in this work we derive ways of…

Machine Learning · Computer Science 2024-09-24 Filip Ekström Kelvinius , Fredrik Lindsten

We obtain sufficient conditions for the uniqueness of a probability solution to the stationary Kolmogorov equation with a degenerate diffusion matrix. We employ the method of doubling variables known in stochastic analysis directly to the…

Analysis of PDEs · Mathematics 2025-11-13 V. I. Bogachev , S. V. Shaposhnikov , D. V. Shatilovich

This paper proposes a new sampling scheme based on Langevin dynamics that is applicable within pseudo-marginal and particle Markov chain Monte Carlo algorithms. We investigate this algorithm's theoretical properties under standard…

Methodology · Statistics 2016-05-30 Christopher Nemeth , Chris Sherlock , Paul Fearnhead

A novel orthogonalization-free method together with two specific algorithms are proposed to solve extreme eigenvalue problems. On top of gradient-based algorithms, the proposed algorithms modify the multi-column gradient such that earlier…

Numerical Analysis · Mathematics 2021-10-15 Weiguo Gao , Yingzhou Li , Bichen Lu

We present a convex-concave reformulation of the reversible Markov chain estimation problem and outline an efficient numerical scheme for the solution of the resulting problem based on a primal-dual interior point method for monotone…

Data Analysis, Statistics and Probability · Physics 2016-03-08 Benjamin Trendelkamp-Schroer , Hao Wu , Frank Noe

We develop a distributed algorithm for convex Empirical Risk Minimization, the problem of minimizing large but finite sum of convex functions over networks. The proposed algorithm is derived from directly discretizing the second-order…

Optimization and Control · Mathematics 2018-11-07 Jingzhao Zhang , César A. Uribe , Aryan Mokhtari , Ali Jadbabaie

We propose a diffusion approximation method to the continuous-state Markov Decision Processes (MDPs) that can be utilized to address autonomous navigation and control in unstructured off-road environments. In contrast to most…

Robotics · Computer Science 2024-02-08 Junhong Xu , Kai Yin , Zheng Chen , Jason M. Gregory , Ethan A. Stump , Lantao Liu

We present an algorithm that can efficiently compute a broad class of inferences for discrete-time imprecise Markov chains, a generalised type of Markov chains that allows one to take into account partially specified probabilities and other…

Probability · Mathematics 2019-07-02 Natan T'Joens , Thomas Krak , Jasper De Bock , Gert de Cooman

Markov chain Monte Carlo methods explicitly defined on the manifold of probability distributions have recently been established. These methods are constructed from diffusions across the manifold and the solution of the equations describing…

Computation · Statistics 2014-03-25 Simon Byrne , Mark Girolami

In this paper we describe a probabilistic method for estimating the position of an object along with its covariance matrix using neural networks. Our method is designed to be robust to outliers, have bounded gradients with respect to the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 David Mohlin , Gerald Bianchi , Josephine Sullivan

We propose a novel Bayesian inference framework for distributed differentially private linear regression. We consider a distributed setting where multiple parties hold parts of the data and share certain summary statistics of their portions…

Machine Learning · Statistics 2023-06-08 Barış Alparslan , Sinan Yıldırım , Ş. İlker Birbil

A theoretical analysis is given of the equation of motion method, due to Alben et al., to compute the eigenvalue distribution (density of states) of very large matrices. The salient feature of this method is that for matrices of the kind…

Computational Physics · Physics 2009-11-06 Anthony Hams , Hans De Raedt

We develop algorithms for inner approximating the cone of positive semidefinite matrices via linear programming and second order cone programming. Starting with an initial linear algebraic approximation suggested recently by Ahmadi and…

Optimization and Control · Mathematics 2016-03-14 Amir Ali Ahmadi , Sanjeeb Dash , Georgina Hall