English
Related papers

Related papers: Estimating a difference between Kullback-Leibler r…

200 papers

This paper introduces link functions for transforming one probability distribution to another such that the Kullback-Leibler and R\'enyi divergences between the two distributions are symmetric. Two general classes of link models are…

Machine Learning · Statistics 2020-08-12 Majid Asadi , Karthik Devarajan , Nader Ebrahimi , Ehsan Soofi , Lauren Spirko-Burns

We introduce a generalized information criterion that contains other well-known information criteria, such as Bayesian information Criterion (BIC) and Akaike information criterion (AIC), as special cases. Furthermore, the proposed spectral…

Methodology · Statistics 2023-08-21 L. Martino , R. San Millan-Castillo , E. Morgado

We study concentration inequalities for the Kullback--Leibler (KL) divergence between the empirical distribution and the true distribution. Applying a recursion technique, we improve over the method of types bound uniformly in all regimes…

Information Theory · Computer Science 2019-10-22 Jay Mardia , Jiantao Jiao , Ervin Tánczos , Robert D. Nowak , Tsachy Weissman

We study the parameters identification of a dynamic model of a population living in a given host environment governed by a logistic law. We use a statistic Kullback-Leibler type method to derive the algorithm for estimating the parameters…

Dynamical Systems · Mathematics 2024-10-08 Messaoud Souilah , Imene Sabira Soualah

Machine learning systems show significant promise for forecasting patient adverse events via risk scores. However, these risk scores implicitly encode assumptions about future interventions that the patient is likely to receive, based on…

Information criteria such as Akaike's (AIC) and Bayes' (BIC) are widely used for model selection in physics and beyond, quantifying the tradeoff between model complexity and goodness-of-fit to enforce parsimony. However, their derivation…

Dynamical Systems · Mathematics 2025-11-20 Kumar Utkarsh , Daniel M. Abrams

Akaike's information criterion (AIC) is a measure of the quality of a statistical model for a given set of data. We can determine the best statistical model for a particular data set by the minimization of the AIC. Since we need to evaluate…

Optimization and Control · Mathematics 2019-11-21 Keiji Kimura , Hayato Waki

The ability to compute the exact divergence between two high-dimensional distributions is useful in many applications but doing so naively is intractable. Computing the alpha-beta divergence -- a family of divergences that includes the…

Machine Learning · Computer Science 2023-10-17 Loong Kuan Lee , Geoffrey I. Webb , Daniel F. Schmidt , Nico Piatkowski

The problem of estimating the Kullback-Leibler divergence $D(P\|Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the distributions can scale to infinity. The estimation is…

Information Theory · Computer Science 2018-02-22 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

This work presents an upper-bound to value that the Kullback-Leibler (KL) divergence can reach for a class of probability distributions called quantum distributions (QD). The aim is to find a distribution $U$ which maximizes the KL…

Machine Learning · Computer Science 2020-12-11 Vincenzo Bonnici

For prediction models developed on clustered data that do not account for cluster heterogeneity in model parameterization, it is crucial to use cluster-based validation to assess model generalizability on unseen clusters. This paper…

Methodology · Statistics 2025-06-23 Jiaxing Qiu , Douglas E. Lake , Pavel Chernyavskiy , Teague R. Henry

In segmented regression, when the regression function is continuous at the change-points that are the boundaries of the segments, it is also called joinpoint regression, and the analysis package developed by \cite{KimFFM00} has become a…

Methodology · Statistics 2025-06-11 Kazuki Nakajima , Yoshiyuki Ninomiya

Estimating the Kullback--Leibler (KL) divergence between language models has many applications, e.g., reinforcement learning from human feedback (RLHF), interpretability, and knowledge distillation. However, computing the exact KL…

Computation and Language · Computer Science 2025-10-28 Afra Amini , Tim Vieira , Ryan Cotterell

Robust model-fitting to spectroscopic transitions is a requirement across many fields of science. The corrected Akaike and Bayesian information criteria (AICc and BIC) are most frequently used to select the optimal number of fitting…

Instrumentation and Methods for Astrophysics · Physics 2020-11-25 John K. Webb , Chung-Chi Lee , Robert F. Carswell , Dinko Milaković

Recently, a method called the Mutual Information Neural Estimator (MINE) that uses neural networks has been proposed to estimate mutual information and more generally the Kullback-Leibler (KL) divergence between two distributions. The…

Machine Learning · Computer Science 2019-08-20 Kartik Ahuja

As the popularity of hierarchical point forecast reconciliation methods increases, there is a growing interest in probabilistic forecast reconciliation. Many studies have utilized machine learning or deep learning techniques to implement…

Artificial Intelligence · Computer Science 2023-11-22 Guanyu Zhang , Feng Li , Yanfei Kang

In statistical learning, models are classified as regular or singular depending on whether the mapping from parameters to probability distributions is injective. Most models with hierarchical structures or latent variables are singular, for…

Machine Learning · Statistics 2025-11-26 Naoki Hayashi , Takuro Kutsuna , Sawa Takamuku

Classical confidence intervals after best subset selection are widely implemented in statistical software and are routinely used to guide practitioners in scientific fields to conclude significance. However, there are increasing concerns in…

Methodology · Statistics 2023-11-27 Huiming Lin , Meng Li

Indirect comparisons have been increasingly used to compare data from different sources such as clinical trials and observational data in, e.g., a disease registry. To adjust for population differences between data sources,…

Methodology · Statistics 2021-07-27 Jixian Wang

The aim of this paper is to introduce new statistical criterions for estimation, suitable for inference in models with common continuous support. This proposal is in the direct line of a renewed interest for divergence based inference tools…

Statistics Theory · Mathematics 2015-03-19 Michel Broniatowski , Aida Toma , Igor Vajda
‹ Prev 1 4 5 6 7 8 10 Next ›