English
Related papers

Related papers: Markov kernels in Mathlib's probability library

200 papers

Kernels are powerful and versatile tools in machine learning and statistics. Although the notion of universal kernels and characteristic kernels has been studied, kernel selection still greatly influences the empirical performance. While…

Machine Learning · Statistics 2019-02-28 Chun-Liang Li , Wei-Cheng Chang , Youssef Mroueh , Yiming Yang , Barnabás Póczos

This article extends weak convergence bounds of Markov transition kernels to convergence bounds on the variance of the Markov kernel applied to Lipschitz functions. In the reversible case, weak convergence rates of the transition kernels…

Statistics Theory · Mathematics 2026-04-29 Austin Brown

The probability density function of a probability distribution is a fundamental concept in probability theory and a key ingredient in various widely used machine learning methods. However, the necessary framework for compiling probabilistic…

Programming Languages · Computer Science 2019-03-14 Sooraj Bhat , Johannes Borgström , Andrew D. Gordon , Claudio Russo

We consider a finite-state, continuous-time Markov process, represented in the "linear framework" by a directed graph with labelled edges which specifies the infinitesimal generator of the process. If the graph is strongly connected, the…

Biological Physics · Physics 2023-10-17 Ugur Cetiner , Jeremy Gunawardena

The analysis of high-dimensional time series data has become increasingly important across a wide range of fields. Recently, a method for constructing the minimum information Markov kernel on finite state spaces was established. In this…

Methodology · Statistics 2026-01-13 Issey Sukeda , Tomonari Sei

This paper introduces a novel approach to probabilistic deep learning, kernel density matrices, which provide a simpler yet effective mechanism for representing joint probability distributions of both continuous and discrete random…

Machine Learning · Computer Science 2024-05-01 Fabio A. González , Raúl Ramos-Pollán , Joseph A. Gallego-Mejia

In this paper the relations between independence preserving (IP) involutions and reversible Markov kernels are investigated. We introduce an involutive augmentation H = (f, g_f) of a measurable function f and relate the IP property of H to…

Probability · Mathematics 2024-08-19 Mauro Piccioni , Jacek Wesołowski

Markov networks are popular models for discrete multivariate systems where the dependence structure of the variables is specified by an undirected graph. To allow for more expressive dependence structures, several generalizations of Markov…

Methodology · Statistics 2021-03-30 Johan Pensar , Henrik Nyman , Jukka Corander

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

Learning with kernels is an important concept in machine learning. Standard approaches for kernel methods often use predefined kernels that require careful selection of hyperparameters. To mitigate this burden, we propose in this paper a…

Machine Learning · Computer Science 2020-06-26 Yufan Zhou , Changyou Chen , Jinhui Xu

Markov random fields are known to be fully characterized by properties of their information diagrams, or I-diagrams. In particular, for Markov random fields, regions in the I-diagram corresponding to disconnected vertex sets in the graph…

Information Theory · Computer Science 2026-03-25 Leon Lang , Clélia de Mulatier , Rick Quax , Patrick Forré

We propose a probabilistic enhancement of standard kernel Support Vector Machines for binary classification, in order to address the case when, along with given data sets, a description of uncertainty (e.g., error bounds) may be available…

Machine Learning · Computer Science 2020-03-19 Yongxin Chen , Tryphon T. Georgiou , Allen R. Tannenbaum

Rapidly decaying kernels and frames (needlets) in the context of tensor product Jacobi polynomials are developed based on several constructions of multivariate $C^\infty$ cutoff functions. These tools are further employed to the development…

Classical Analysis and ODEs · Mathematics 2009-02-17 Kamen Ivanov , Pencho Petrushev , Yuan Xu

Traditional hidden Markov models have been a useful tool to understand and model stochastic dynamic data; in the case of non-Gaussian data, models such as mixture of Gaussian hidden Markov models can be used. However, these suffer from the…

Machine Learning · Statistics 2023-05-16 Carlos Puerto-Santana , Concha Bielza , Pedro Larrañaga , Gustav Eje Henter

The role of kernels is central to machine learning. Motivated by the importance of power-law distributions in statistical modeling, in this paper, we propose the notion of power-law kernels to investigate power-laws in learning problem. We…

Machine Learning · Computer Science 2013-04-02 Debarghya Ghoshdastidar , Ambedkar Dukkipati

Let $P$ be a Markov kernel on a measurable space $\X$ and let $V:\X\r[1,+\infty)$. This paper provides explicit connections between the $V$-geometric ergodicity of $P$ and that of finite-rank nonnegative sub-Markov kernels $\Pc_k$…

Probability · Mathematics 2014-01-24 Loïc Hervé , James Ledoux

Kernel mean embeddings -- integrals of a kernel with respect to a probability distribution -- are essential in Bayesian quadrature, but also widely used in other computational tools for numerical integration or for statistical inference…

Machine Learning · Statistics 2025-04-29 François-Xavier Briol , Alexandra Gessner , Toni Karvonen , Maren Mahsereci

Strong typicality and the Markov lemma have been used in the proofs of several multiterminal source coding theorems. Since these two tools can be applied to finite alphabets only, the results proved by them are subject to the same…

Information Theory · Computer Science 2010-06-03 Siu-Wai Ho

We construct default-free interest rate models in the spirit of the well-known Markov funcional models: our focus is analytic tractability of the models and generality of the approach. We work in the setting of state price densities and…

Pricing of Securities · Quantitative Finance 2009-10-28 Jiro Akahori , Yuji Hishida , Josef Teichmann , Takahiro Tsuchiya

We discuss rather systematically the principle, implicit in earlier works, that for a "random" element in an arithmetic subgroup of a (split, say) reductive algebraic group over a number field, the splitting field of the characteristic…

Number Theory · Mathematics 2012-01-25 F. Jouve , E. Kowalski , D. Zywina