English
Related papers

Related papers: A distance function for stochastic matrices

200 papers

The distance covariance of two random vectors is a measure of their dependence. The empirical distance covariance and correlation can be used as statistical tools for testing whether two random vectors are independent. We propose an analogs…

Statistics Theory · Mathematics 2017-03-31 Muneya Matsui , Thomas Mikosch , Gennady Samorodnitsky

In machine learning, observation features are measured in a metric space to obtain their distance function for optimization. Given similar features that are statistically sufficient as a population, a statistical distance between two…

Machine Learning · Statistics 2020-06-23 Xin Lu

Stochastic gradient descent (SGD) is a popular algorithm for minimizing objective functions that arise in machine learning. For constant step-sized SGD, the iterates form a Markov chain on a general state space. Focusing on a class of…

Optimization and Control · Mathematics 2025-03-26 David Shirokoff , Philip Zaleski

This work introduces a notion of approximate probabilistic trace equivalence for labelled Markov chains, and relates this new concept to the known notion of approximate probabilistic bisimulation. In particular this work shows that the…

Logic in Computer Science · Computer Science 2017-04-28 Gaoang Bian , Alessandro Abate

In Optimal Transport (OT) on a finite metric space, one defines a distance on the probability simplex that extends the distance on the ground space. The distance is the value of a Linear Programming (LP) problem on the set of…

Methodology · Statistics 2021-01-14 Giovanni Pistone , Fabio Rapallo , Maria Piera Rogantin

This work develops new results for stochastic approximation algorithms. The emphases are on treating algorithms and limits with discontinuities. The main ingredients include the use of differential inclusions, set-valued analysis, and…

Probability · Mathematics 2021-08-31 Nhu Nguyen , George Yin

Computation of the trace of a matrix function plays an important role in many scientific computing applications, including applications in machine learning, computational physics (e.g., lattice quantum chromodynamics), network analysis and…

Data Structures and Algorithms · Computer Science 2017-03-10 Insu Han , Dmitry Malioutov , Haim Avron , Jinwoo Shin

Decentralized stochastic gradient method emerges as a promising solution for solving large-scale machine learning problems. This paper studies the decentralized Markov chain gradient descent (DMGD) algorithm - a variant of the decentralized…

Optimization and Control · Mathematics 2021-04-14 Tao Sun , Dongsheng Li

In algorithms for finite metric spaces, it is common to assume that the distance between two points can be computed in constant time, and complexity bounds are expressed only in terms of the number of points of the metric space. We…

Computational Geometry · Computer Science 2019-01-28 Michael Kerber , Arnur Nigmetov

Similarity measures are used extensively in machine learning and data science algorithms. The newly proposed graph Relative Hausdorff (RH) distance is a lightweight yet nuanced similarity measure for quantifying the closeness of two graphs.…

Discrete Mathematics · Computer Science 2019-06-13 Sinan G. Aksoy , Kathleen E. Nowak , Emilie Purvine , Stephen J. Young

The shortest-path, commute time, and diffusion distances on undirected graphs have been widely employed in applications such as dimensionality reduction, link prediction, and trip planning. Increasingly, there is interest in using…

Social and Information Networks · Computer Science 2023-07-27 Zachary M. Boyd , Nicolas Fraiman , Jeremy L. Marzuola , Peter J. Mucha , Braxton Osting , Jonathan Weare

We study the convergence rate to stationarity for a class of exchangeable partition-valued Markov chains called cut-and-paste chains. The law governing the transitions of a cut-and-paste chain are determined by products of i.i.d. stochastic…

Probability · Mathematics 2012-09-25 Harry Crane , Steven P. Lalley

Information is an inherent component of stochastic processes and to measure the distance between different stochastic processes it is not sufficient to consider the distance between their laws. Instead, the information which accumulates…

Optimization and Control · Mathematics 2018-02-06 Julio Backhoff Veraguas , Mathias Beiglböck , Manu Eder , Alois Pichler

Markov Chain Monte Carlo methods have revolutionised mathematical computation and enabled statistical inference within many previously intractable models. In this context, Hamiltonian dynamics have been proposed as an efficient way of…

Computation · Statistics 2017-05-09 Alessandro Barp , Francois-Xavier Briol , Anthony D. Kennedy , Mark Girolami

We develop a practical approach to establish the stability, that is, the recurrence in a given set, of a large class of controlled Markov chains. These processes arise in various areas of applied science and encompass important numerical…

Statistics Theory · Mathematics 2015-02-02 Christophe Andrieu , Vladislav B. Tadić , Matti Vihola

Discrete partially ordered sets can be turned into distance spaces in several ways. The distance functions may or may not satisfy the triangle inequality, and restriction of the distance to finite chains may or may not coincide with the…

Combinatorics · Mathematics 2018-02-27 Stephan Foldes

A classical problem for Markov chains is determining their stationary (or steady-state) distribution. This problem has an equally classical solution based on eigenvectors and linear equation systems. However, this approach does not scale to…

Systems and Control · Electrical Eng. & Systems 2023-01-20 Tobias Meggendorfer

From longitudinal biomedical studies to social networks, graphs have emerged as a powerful framework for describing evolving interactions between agents in complex systems. In such studies, after pre-processing, the data can be represented…

Applications · Statistics 2018-03-12 Claire Donnat , Susan Holmes

This work considers the asymptotic behavior of the distance between two sample covariance matrices (SCM). A general result is provided for a class of functionals that can be expressed as sums of traces of functions that are separately…

Statistics Theory · Mathematics 2023-12-25 Roberto Pereira , Xavier Mestre , David Gregoratti

For a spatial characteristic, there exist commonly fat-tail frequency distributions of fragment-size and -mass of glass, areas enclosed by city roads, and pore size/volume in random packings. In order to give a new analytical approach for…

Statistical Mechanics · Physics 2015-06-12 Yukio Hayashi , Takayuki Komaki , Yusuke Ide , Takuya Machida , Norio Konno