English
Related papers

Related papers: An information-spectrum approach to large deviatio…

200 papers

Recent works have shown that high probability metrics with stochastic gradient descent (SGD) exhibit informativeness and in some cases advantage over the commonly adopted mean-square error-based ones. In this work we provide a formal…

Machine Learning · Computer Science 2022-11-03 Dragana Bajovic , Dusan Jakovetic , Soummya Kar

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

We present an Expectation-Maximization algorithm for the fractal inverse problem: the problem of fitting a fractal model to data. In our setting the fractals are Iterated Function Systems (IFS), with similitudes as the family of…

Machine Learning · Statistics 2017-07-03 Peter Bloem , Steven de Rooij

This work is a companion paper of Gamboa, Nagel, Rouault (J. Funct. Anal. 2016). We continue to explore the connections between large deviations for random objects issued from random matrix theory and sum rules. Here, we are concerned…

Probability · Mathematics 2017-01-31 Fabrice Gamboa , Jan Nagel , Alain Rouault

A large deviation function mathematically characterizes the statistical property of atypical events. Recently, in non-equilibrium statistical mechanics, large deviation functions have been used to describe universal laws such as the…

Statistical Mechanics · Physics 2012-04-26 Shin-ichi Sasa

We present a new method of estimating the dispersion of a distribution which is based on the surprising property of a function that measures information processing intensity. It turns out that this function has a maximum at its fixed point.…

Data Analysis, Statistics and Probability · Physics 2015-06-19 Rober Jankowski , Marcin Makowski , Edward W. Piotrowski

In this paper we prove a large deviation principle (LDP) for the empirical measure of a general system of mean-field interacting diffusions with singular drift (as the number of particles tends to infinity) and show convergence to the…

Probability · Mathematics 2020-07-02 Jasper Hoeksema , Thomas Holding , Mario Maurelli , Oliver Tse

Using the generalized entropies which depend on two parameters we propose a set of quantitative characteristics derived from the Information Geometry based on these entropies. Our aim, at this stage, is modest, as we are first constructing…

Mathematical Physics · Physics 2018-02-14 Demetris P. K. Ghikas , Fotios Oikonomou

We present a large deviation principle at speed N for the largest eigenvalue of some additively deformed Wigner matrices. In particular this includes Gaussian ensembles with full-rank general deformation. For the non-Gaussian ensembles, the…

Probability · Mathematics 2023-03-22 Benjamin McKenna

Item Response Theory (IRT) is a ubiquitous model for understanding humans based on their responses to questions, used in fields as diverse as education, medicine and psychology. Large modern datasets offer opportunities to capture more…

Machine Learning · Computer Science 2020-03-17 Mike Wu , Richard L. Davis , Benjamin W. Domingue , Chris Piech , Noah Goodman

We establish a large deviation principle for the empirical measure process associated with a general class of finite-state mean field interacting particle systems with Lipschitz continuous transition rates that satisfy a certain ergodicity…

Probability · Mathematics 2016-01-26 Paul Dupuis , Kavita Ramanan , Wei Wu

We show that the iterates generated by a generic first-order meta-algorithm satisfy a canonical perturbed Fenchel duality inequality. The latter in turn readily yields a unified derivation of the best known convergence rates for various…

Optimization and Control · Mathematics 2021-12-06 David H. Gutman , Javier F. Peña

In various disordered systems or non-equilibrium dynamical models, the large deviations of some observables have been found to display different scalings for rare values bigger or smaller than the typical value. In the present paper, we…

Statistical Mechanics · Physics 2021-05-12 Cecile Monthus

The theorem of Furstenberg and Kesten provides a strong law of large numbers for the norm of a product of random matrices. This can be extended under various assumptions, covering nonnegative as well as invertible matrices, to a law of…

Probability · Mathematics 2015-02-10 Dariusz Buraczewski , Sebastian Mentemeier

We derive a stochastic Gronwall lemma with suprema over the paths in the upper bound of the assumed affine-linear growth assumption. This allows applications to It\^o processes with coefficients which depend on earlier time points such as…

Probability · Mathematics 2022-06-03 Martin Hutzenthaler , Tuan Anh Nguyen

Large deviation principles and related results are given for a class of Markov chains associated to the "leaves" in random recursive trees and preferential attachment random graphs, as well as the "cherries" in Yule trees. In particular,…

Probability · Mathematics 2010-01-22 W. Bryc , D. Minda , S. Sethuraman

A rate-distortion problem motivated by the consideration of semantic information is formulated and solved. The starting point is to model an information source as a pair consisting of an intrinsic state which is not observable,…

Information Theory · Computer Science 2021-05-11 Jiakun Liu , Wenyi Zhang , H. Vincent Poor

A method based on orthogonal function series interpolation of the square root probability density to analyze higher dimensional scattered data is presented. The method is targeted for the use-case when the model and/or data are available…

Data Analysis, Statistics and Probability · Physics 2022-03-01 K. Gellerstedt , J. Sjölin

The notion of the H\"older convolution is introduced. The main result is that, under general conditions on functions L_1, ..., L_n, the function inverse to the Legendre--Fenchel transform of the H\"older convolution of L_1, ..., L_n…

Classical Analysis and ODEs · Mathematics 2013-06-04 Iosif Pinelis

This work concerns generalized backward stochastic differential equations, which are coupled with a family of reflecting diffusion processes. First of all, we establish the large deviation principle for forward stochastic differential…

Probability · Mathematics 2024-07-23 Yawen Liu , Huijie Qiao