English
Related papers

Related papers: Characterizations and Kullback-Leibler Divergence …

200 papers

This paper considers the distributionally robust chance constrained Markov decision process with random reward and ambiguous reward distribution. We consider individual and joint chance constraint cases with Kullback-Leibler divergence…

Optimization and Control · Mathematics 2023-08-01 Tian Xia , Jia Liu , Abdel Lisser

We consider three classes of linear differential equations on distribution functions, with a fractional order $\alpha\in [0,1].$ The integer case $\alpha =1$ corresponds to the three classical extreme families. In general, we show that…

Probability · Mathematics 2019-08-05 Lotfi Boudabsa , Thomas Simon , Pierre Vallois

In a regression setup with deterministic design, we study the pure aggregation problem and introduce a natural extension from the Gaussian distribution to distributions in the exponential family. While this extension bears strong…

Machine Learning · Statistics 2012-06-06 Philippe Rigollet

For a skew normal random sequence, convergence rates of the distribution of its partial maximum to the Gumbel extreme value distribution are derived. The asymptotic expansion of the distribution of the normalized maximum is given under an…

Methodology · Statistics 2012-12-06 Xin Liao , Zuoxiang Peng , Saralees Nadarajah , Xiaoqian Wang

We investigate conditions for the existence of the limiting conditional distribution of a bivariate random vector when one component becomes large. We revisit the existing literature on the topic, and present some new sufficient conditions.…

Probability · Mathematics 2010-02-21 Anne-Laure Fougères , Philippe Soulier

The Gumbel-Softmax probability distribution allows learning discrete tokens in generative learning, while the Gumbel-Argmax probability distribution is useful in learning discrete structures in discriminative learning. Despite the efforts…

Machine Learning · Computer Science 2024-06-05 Hedda Cohen Indelman , Tamir Hazan

We propose extreme value analogues of natural exponential families and exponential dispersion models, and introduce the slope function as an analogue of the variance function. The set of quadratic and power slope functions characterize…

Statistics Theory · Mathematics 2007-12-31 Bent Jørgensen , Yuri Goegebeur , José Raúl Martínez

We study the extreme value distribution of stochastic processes modeled by superstatistics. Classical extreme value theory asserts that (under mild asymptotic independence assumptions) only three possible limit distributions are possible,…

Statistical Mechanics · Physics 2015-06-22 Pau Rabassa , Christian Beck

We compute the expected value of the Kullback-Leibler divergence to various fundamental statistical models with respect to canonical priors on the probability simplex. We obtain closed formulas for the expected model approximation errors,…

Machine Learning · Statistics 2014-06-18 Guido F. Montufar , Johannes Rauh

We present a framework for describing the evolution of stochastic observables having a non-stationary distribution of values. The framework is applied to empirical volume-prices from assets traded at the New York stock exchange. Using…

Statistical Finance · Quantitative Finance 2016-05-18 Paulo Rocha , Frank Raischel , João P. Boto , Pedro G. Lind

We investigate the statistics of the maximal fluctuation of two-dimensional Gaussian interfaces. Its relation to the entropic repulsion between rigid walls and a confined interface is used to derive the average maximal fluctuation $<m> \sim…

Statistical Mechanics · Physics 2007-05-23 Deok-Sun Lee

Divergences are quantities that measure discrepancy between two probability distributions and play an important role in various fields such as statistics and machine learning. Divergences are non-negative and are equal to zero if and only…

Statistics Theory · Mathematics 2019-10-22 Tomohiro Nishiyama

We consider the problem of sampling from a probability distribution $\pi$ which admits a density w.r.t. a dominating measure. It is well known that this can be written as an optimisation problem over the space of probability distributions…

Methodology · Statistics 2026-05-06 Francesca Romana Crucinio

We present some product representations for random variables with the Linnik, Mittag-Leffler and Weibull distributions and establish the relationship between the mixing distributions in these representations. The main result is the…

Probability · Mathematics 2016-06-28 Victor Korolev , Alexander Zeifman

We study a model of interacting vortices in a type II superconductor. In the weak coupling limit, we constructed a mean-field theory which allows us to accurately calculate the vortex density distribution inside a confining potential. In…

Statistical Mechanics · Physics 2015-06-17 Yan Levin , Matheus Girotto , Alexandre Pereira dos Santos

We use the fitted Pareto law to construct an accompanying approximation of the excess distribution function. A selection rule of the location of the excess distribution function is proposed based on a stagewise lack-of-fit testing…

Statistics Theory · Mathematics 2008-08-08 Ion Grama , Vladimir Spokoiny

This archiving article consists of several short reports on the discussions between the two authors over the past two years at Oxford and Madrid, and their work carried out during that period on the upper bound of the Kullback-Leibler…

Information Theory · Computer Science 2019-11-20 Min Chen , Mateu Sbert

Stochastic interdependence of a probablility distribution on a product space is measured by its Kullback-Leibler distance from the exponential family of product distributions (called multi-information). Here we investigate low-dimensional…

Mathematical Physics · Physics 2016-01-08 Nihat Ay , Andreas Knauf

We present evidence that the best model for empirical volume-price distributions is not always the same and it strongly depends in (i) the region of the volume-price spectrum that one wants to model and (ii) the period in time that is being…

Statistical Finance · Quantitative Finance 2015-06-22 Paulo Rocha , Frank Raischel , João Pedro Boto , Pedro G. Lind

Most theoretical analysis for lifetime distribution explains origins of specific distribution based on independent failure. We develop a unified framework encompassing different lifetime distribution for failure-coupled network systems. We…

Physics and Society · Physics 2024-07-12 Yimeng Liu , Shaobo Sui , Dan Lu , Rui Peng , Mingyang Bai , Daqing Li