English
Related papers

Related papers: A Kullback-Leibler divergence test for multivariat…

200 papers

In this paper, we develop a new elegant framework relying on the Kullback-Leibler Information Criterion to address the design of one-stage adaptive detection architectures for multiple hypothesis testing problems. Specifically, at the…

Signal Processing · Electrical Eng. & Systems 2021-03-23 Pia Addabbo , Sudan Han , Fillippo Biondi , Gaetano Giunta , Danilo Orlando

Selecting an appropriate divergence measure is a critical aspect of machine learning, as it directly impacts model performance. Among the most widely used, we find the Kullback-Leibler (KL) divergence, originally introduced in kinetic…

Mathematical Physics · Physics 2025-07-16 Gennaro Auricchio , Giovanni Brigati , Paolo Giudici , Giuseppe Toscani

Knowing if a model will generalize to data 'in the wild' is crucial for safe deployment. To this end, we study model disagreement notions that consider the full predictive distribution - specifically disagreement based on Hellinger…

Machine Learning · Computer Science 2023-12-14 Mona Schirmer , Dan Zhang , Eric Nalisnick

The ability to identify reliably a positive or negative partial correlation between the expression levels of two genes is influenced by the number $p$ of genes, the number $n$ of analyzed samples, and the statistical properties of the…

Statistics Theory · Mathematics 2013-09-24 Maya Shevlyakova , Stephan Morgenthaler

We discuss the finite sample theoretical properties of online predictions in non-stationary time series under model misspecification. To analyze the theoretical predictive properties of statistical methods under this setting, we first…

Statistics Theory · Mathematics 2023-06-21 Kōsaku Takanashi , Kenichiro McAlinn

We derive a closed-form solution for the Kullback-Leibler divergence between two Fr\'echet extreme-value distributions. The resulting expression is rather simple and involves the Euler-Mascheroni constant.

Statistics Theory · Mathematics 2023-03-28 Jean-Christophe Pain

Model averaging is a useful and robust method for dealing with model uncertainty in statistical analysis. Often, it is useful to consider data subset selection at the same time, in which model selection criteria are used to compare models…

Methodology · Statistics 2023-10-26 Ethan T. Neil , Jacob W. Sitison

We give an overview of several aspects arising in the statistical analysis of extreme risks with actuarial applications in view. In particular it is demonstrated that empirical process theory is a very powerful tool, both for the asymptotic…

Methodology · Statistics 2015-03-19 Holger Drees

Different dependence scenarios can arise in multivariate extremes, entailing careful selection of an appropriate class of models. In bivariate extremes, the variables are either asymptotically dependent or are asymptotically independent.…

Methodology · Statistics 2015-10-30 Jennifer Wadsworth , Jonathan Tawn , Anthony Davison , Daniel Elton

We study the extremes for a class of a symmetric stable random fields with long range dependence. We prove functional extremal theorems both in the space of sup measures and in the space of cadlag functions of several variables. The limits…

Probability · Mathematics 2018-10-17 Zaoli Chen , Gennady Samorodnitsky

We propose a vector generalized additive modeling framework for taking into account the effect of covariates on angular density functions in a multivariate extreme value context. The proposed methods are tailored for settings where the…

Methodology · Statistics 2017-11-28 Linda Mhalla , Miguel de Carvalho , Valérie Chavez-Demoulin

Generative models have achieved remarkable success across a range of applications, yet their evaluation still lacks principled uncertainty quantification. In this paper, we develop a method for comparing how close different generative…

Machine Learning · Statistics 2025-10-24 Zijun Gao , Yan Sun , Han Su

Recently, continual learning has received a lot of attention. One of the significant problems is the occurrence of \emph{concept drift}, which consists of changing probabilistic characteristics of the incoming data. In the case of the…

Machine Learning · Computer Science 2022-10-11 Sebastián Basterrech , Michal Woźniak

We apply the concept of distance covariance for testing independence of two long-range dependent time series. As test statistic we propose a linear combination of empirical distance cross-covariances. We derive the asymptotic distribution…

Statistics Theory · Mathematics 2026-01-28 Annika Betken , Herold Dehling

In many practical applications, evaluating the joint impact of combinations of environmental variables is important for risk management and structural design analysis. When such variables are considered simultaneously, non-stationarity can…

Applications · Statistics 2024-04-23 C. J. R. Murphy-Barltrop , J. L. Wadsworth

We derive independence tests by means of dependence measures thresholding in a semiparametric context. Precisely, estimates of phi-mutual informations, associated to phi-divergences between a joint distribution and the product distribution…

Statistics Theory · Mathematics 2015-08-20 Amor Keziou , Philippe Regnault

This study tackles the efficient estimation of Kullback-Leibler (KL) Divergence in Dirichlet Mixture Models (DMM), crucial for clustering compositional data. Despite the significance of DMMs, obtaining an analytically tractable solution for…

Machine Learning · Statistics 2024-03-20 Samyajoy Pal , Christian Heumann

We develop hypothesis testing for active information -the averaged quantity in the Kullback-Liebler divergence. To our knowledge, this is the first paper to derive exact probabilities of type-I errors for hypothesis testing in the area.

Statistics Theory · Mathematics 2021-11-16 Daniel Andrés Díaz-Pachón , Juan Pablo Sáenz , J. Sunil Rao

This paper studies alpha testing in a high-dimensional conditional time-varying factor model with temporally dependent observations. Both factor loadings and alpha processes are allowed to vary smoothly over time, and the cross-sectional…

Methodology · Statistics 2026-04-16 Long Feng , Huifang Ma , Zhaojun Wang

We study the problem of closeness testing for continuous distributions and its implications for causal discovery. Specifically, we analyze the sample complexity of distinguishing whether two multidimensional continuous distributions are…

Machine Learning · Computer Science 2025-03-11 Fateme Jamshidi , Sina Akbari , Negar Kiyavash