English
Related papers

Related papers: A Generalized Markov-Chain Modelling Approach to $…

200 papers

It is common to subsample Markov chain output to reduce the storage burden. Geyer (1992) shows that discarding $k-1$ out of every $k$ observations will not improve statistical efficiency, as quantified through variance in a given…

Computation · Statistics 2017-04-12 Art B. Owen

Two approximation algorithms are proposed for $\ell_1$-regularized sparse rank-1 approximation to higher-order tensors. The algorithms are based on multilinear relaxation and sparsification, which are easily implemented and well scalable.…

Optimization and Control · Mathematics 2022-07-18 Xianpeng Mao , Yuning Yang

Due to the rapid growth of data and computational resources, distributed optimization has become an active research area in recent years. While first-order methods seem to dominate the field, second-order methods are nevertheless attractive…

Machine Learning · Computer Science 2018-06-21 Celestine Dünner , Aurelien Lucchi , Matilde Gargiani , An Bian , Thomas Hofmann , Martin Jaggi

We provide a unified framework to compute the stationary distribution of any finite irreducible Markov chain or equivalently of any irreducible random walk on a finite semigroup $S$. Our methods use geometric finite semigroup theory via the…

Probability · Mathematics 2019-03-11 John Rhodes , Anne Schilling

In the present paper, we propose a new generalization of the Borel-Cantelli lemma. This generalization can be further used to derive strong limit results for Markov chains. Illustrative applications are provided.

Methodology · Statistics 2014-01-31 Alexei Stepanov

Graphs are commonly used to model various complex systems, including social networks, power grids, transportation networks, and biological systems. In many applications, the connectivity of these networks can be expressed through the Mean…

Optimization and Control · Mathematics 2025-09-03 Christian P. C. Franssen , Alessandro Zocca , Bernd F. Heidergott

Understanding the reliability of large language models (LLMs) has recently garnered significant attention. Given LLMs' propensity to hallucinate, as well as their high sensitivity to prompt design, it is already challenging to predict the…

Machine Learning · Computer Science 2025-06-10 Michael J. Zellinger , Matt Thomson

Lecture notes (in French) of a master 2 level course in applied mathematics. Contents: Part I. Markov chains on a countable space. 1. Examples 2. Summary of basic properties. 3. Spectral theory and speed of convergence. 4. Lyapunov…

History and Overview · Mathematics 2024-12-11 Nils Berglund

A classical problem for Markov chains is determining their stationary (or steady-state) distribution. This problem has an equally classical solution based on eigenvectors and linear equation systems. However, this approach does not scale to…

Systems and Control · Electrical Eng. & Systems 2023-01-20 Tobias Meggendorfer

Markov Logic Networks (MLNs) are well-suited for expressing statistics such as "with high probability a smoker knows another smoker" but not for expressing statements such as "there is a smoker who knows most other smokers", which is…

Artificial Intelligence · Computer Science 2018-08-22 Víctor Gutiérrez-Basulto , Jean Christoph Jung , Ondrej Kuzelka

We improve upon previous oblivious sketching and turnstile streaming results for $\ell_1$ and logistic regression, giving a much smaller sketching dimension achieving $O(1)$-approximation and yielding an efficient optimization problem in…

Data Structures and Algorithms · Computer Science 2023-04-05 Alexander Munteanu , Simon Omlor , David Woodruff

This note focuses on a simple approach to the unified analysis of SGD-type methods from (Gorbunov et al., 2020) for strongly convex smooth optimization problems. The similarities in the analyses of different stochastic first-order methods…

Optimization and Control · Mathematics 2023-03-30 Eduard Gorbunov

Outline of several strategies for using Gaussian processes as surrogate models for the covariance matrix adaptation evolution strategy (CMA-ES).

Neural and Evolutionary Computing · Computer Science 2014-12-01 Lukáš Bajer , Martin Holeňa

Labeled Markov Chains (or LMCs for short) are useful mathematical objects to model complex probabilistic languages. A central challenge is to compare two LMCs, for example to assess the accuracy of an abstraction or to quantify the effect…

Logic in Computer Science · Computer Science 2025-11-25 Adrien Banse , Alessandro Abate , Raphaël M. Jungers

Maximum Likelihood Estimation (MLE) and Likelihood Ratio Test (LRT) are widely used methods for estimating the transition probability matrix in Markov chains and identifying significant relationships between transitions, such as equality.…

Methodology · Statistics 2024-06-04 Yining Zhou , Ming Gao , Yiting Chen , Xiaoping Shi

This paper offers a personal review of some things we've learned about rates of convergence of Markov chains to their stationary distributions. The main topic is ways of speeding up diffusive behavior. It also points to open problems and…

Statistics Theory · Mathematics 2013-10-01 Persi Diaconis

We present a type inference algorithm for lambda-terms in Elementary Affine Logic using linear constraints. We prove that the algorithm is correct and complete.

Logic in Computer Science · Computer Science 2007-05-23 Paolo Coppola , Simone Martini

In this paper, we are interested in optimal decisions in a partially observable Markov universe. Our viewpoint departs from the dynamic programming viewpoint: we are directly approximating an optimal strategic tree depending on the…

General Mathematics · Mathematics 2007-05-23 Frederic Dambreville

We give sublinear-time approximation algorithms for some optimization problems arising in machine learning, such as training linear classifiers and finding minimum enclosing balls. Our algorithms can be extended to some kernelized versions…

Machine Learning · Computer Science 2010-10-22 Kenneth L. Clarkson , Elad Hazan , David P. Woodruff

This paper is a continuation of our recent work in [9].

Analysis of PDEs · Mathematics 2016-11-24 Daoyin He , Ingo Witt , Huicheng Yin