Related papers: Conditional Equi-concentration of Types
This expository note describes how to apply the method of maximum likelihood to estimate the parameters of the ``$q$-exponential'' distributions introduced by Tsallis and collaborators. It also describes the relationship of these…
In this paper we study the exponential decay of posterior probability of a set of sources and conditioning by rare sources for both uniform and general prior distributions of sources. The decay rate is determined by $L$-divergence and rare…
In classical extreme value theory probabilities of extreme events are estimated assuming all the components of a random vector to be in a domain of attraction of an extreme value distribution. In contrast, the conditional extreme value…
This paper provides second-order optimality conditions for optimization problems with generalized equation constraints (GEPs), a framework that encompasses several important and challenging models in mathematical programming, including…
A brief discussion is given of the traditional version of the Maximum Entropy Method, including a review of some of the criticism that has been made in regard to its use in statistical inference. Motivated by these questions, a modified…
Minimization problems with respect to a one-parameter family of generalized relative entropies are studied. These relative entropies, which we term relative $\alpha$-entropies (denoted $\mathscr{I}_{\alpha}$), arise as redundancies under…
We give rates of convergence in the strong invariance principle for stationary sequences satisfying some projective criteria. The conditions are expressed in terms of conditional expectations of partial sums of the initial sequence. Our…
We consider M-estimators and derive supremal-inequalities of exponential-or polynomial type according as a boundedness- or a moment-condition is fulfilled. This enables us to derive rates of r-complete convergence and also to show r-qick…
Tsallis has suggested a nonextensive generalization of the Boltzmann-Gibbs entropy, the maximization of which gives a generalized canonical distribution under special constraints. In this brief report we show that the generalized canonical…
Methods of construction of Max-semi-selfdecompsable laws are given. Implications of this method in random time changed extremal processes are discussed. Max-autoregressive model is introduced and characterized using the…
A method of estimating the joint probability mass function of a pair of discrete random variables is described. This estimator is used to construct the conditional Shannon-R\'eyni-Tsallis entropies estimates. From there almost sure rates of…
Three versions of the Weak Law of Large Numbers are proposed for weakly dependent and generally speaking non-equally distributed random variables, with finite or possibly infinite expectations.
The purpose of this paper is twofold. In one direction, we extend the spectral method for random piecewise expanding and hyperbolic dynamics developed by the first author \textit{et al}. to establish quenched versions of the large deviation…
The object of this paper is twofold. From one side we study the dichotomy, in terms of the Extremal Index of the possible Extreme Value Laws, when the rare events are centred around periodic or non periodic points. Then we build a general…
Asymptotic behavior (with respect to the number of trials) of symmetric generalizations of binomial distributions and their related entropies are studied through three examples. The first one derives from the q-exponential as a generating…
Most of the existing classification methods are aimed at minimization of empirical risk (through some simple point-based error measured with loss function) with added regularization. We propose to approach this problem in a more information…
We consider Coulomb gas models for which the empirical measure typically concentrates, when the number of particles becomes large, on an equilibrium measure minimizing an electrostatic energy. We study the behavior when the gas is…
The optimization problems defining meta-stable or stationary equilibrium are explored. The Gibbs scheme is modified aiming to describe the statistical properties of a class of non-equilibrium and metastable states. The system is assumed to…
Conditional probabilities are a core concept in machine learning. For example, optimal prediction of a label $Y$ given an input $X$ corresponds to maximizing the conditional probability of $Y$ given $X$. A common approach to inference tasks…
We show, on purely statistical grounds and without appeal to any physical model, that a power-law $q-$entropy $S_q$, with $0<q<1$, can be {\it extensive}. More specifically, if the components $X_i$ of a vector $X \in \mathbb{R}^N$ are…