English
Related papers

Related papers: Improving the autodependogram using the Kulback-Le…

200 papers

Functional data describe a wide range of processes, such as growth curves and spectral absorption. In this study, we analyze air pollution data from the In-service Aircraft for a Global Observing System, focusing on the spatial interactions…

Methodology · Statistics 2024-11-14 Rita Fici , Gianluca Sottile , Luigi Augugliaro , Ernst-Jan Camiel Wit

Parametric portfolio policies may experience estimation risk. I develop a generalized Bayesian framework that updates priors, delivering a posterior distribution over characteristic tilts and out-of-sample returns that is the unique…

Portfolio Management · Quantitative Finance 2026-03-10 Christopher G. Lamoureux

In this paper, we discuss a property of the Kullback--Leibler divergence measured between two models of the family of the location-scale distributions. We show that, if model $M_1$ and model $M_2$ are represented by location-scale…

Statistics Theory · Mathematics 2016-04-08 Cristiano Villa

Distributed lag models (DLMs) express the cumulative and delayed dependence between pairs of time-indexed response and explanatory variables. In practical application, users of DLMs examine the estimated influence of a series of lagged…

Applications · Statistics 2018-01-23 Alastair Rushworth

Categorical variables are of uttermost importance in biomedical research. When two of them are considered, it is often the case that one wants to test whether or not they are statistically dependent. We show weaknesses of classical methods…

Estimation of the conditional independence graph (CIG) of high-dimensional multivariate Gaussian time series from multi-attribute data is considered. Existing methods for graph estimation for such data are based on single-attribute models…

Machine Learning · Statistics 2025-12-09 Jitendra K. Tugnait

This paper proposes a geometric estimator of dependency between a pair of multivariate samples. The proposed estimator of dependency is based on a randomly permuted geometric graph (the minimal spanning tree) over the two multivariate…

Machine Learning · Computer Science 2019-10-02 Salimeh Yasaei Sekeh , Alfred O. Hero

We address the question of estimating Kullback-Leibler losses rather than squared losses in recovery problems where the noise is distributed within the exponential family. Inspired by Stein unbiased risk estimator (SURE), we exhibit…

Applications · Statistics 2017-08-22 Charles-Alban Deledalle

The Kullback-Leibler (KL) divergence is frequently used in data science. For discrete distributions on large state spaces, approximations of probability vectors may result in a few small negative entries, rendering the KL divergence…

Directed possibly cyclic graphs have been proposed by Didelez (2000) and Nodelmann et al. (2002) in order to represent the dynamic dependencies among stochastic processes. These dependencies are based on a generalization of…

Artificial Intelligence · Computer Science 2012-07-02 Vanessa Didelez

In this paper, we focus on the problem of statistical dependence estimation using characteristic functions. We propose a statistical dependence measure, based on the maximum-norm of the difference between joint and product-marginal…

Machine Learning · Computer Science 2022-08-18 Povilas Daniušis , Shubham Juneja , Lukas Kuzma , Virginijus Marcinkevičius

We propose a family of association measures for two-way contingency tables whose latent distribution can be assumed to be bivariate normal. When this assumption holds, the power-divergence measuring departure from independence can be…

Methodology · Statistics 2026-04-16 Wataru Urasaki

This archiving article consists of several short reports on the discussions between the two authors over the past two years at Oxford and Madrid, and their work carried out during that period on the upper bound of the Kullback-Leibler…

Information Theory · Computer Science 2019-11-20 Min Chen , Mateu Sbert

A directed acyclic graph (DAG) provides valuable prior knowledge that is often discarded in regression tasks in machine learning. We show that the independences arising from the presence of collider structures in DAGs provide meaningful…

Machine Learning · Statistics 2023-06-22 Shahine Bouabid , Jake Fawkes , Dino Sejdinovic

Frequentist conditions for asymptotic suitability of Bayesian procedures focus on lower bounds for prior mass in Kullback-Leibler neighbourhoods of the data distribution. The goal of this paper is to investigate the flexibility in criteria…

Statistics Theory · Mathematics 2018-03-19 B. J. K. Kleijn , Y. Y. Zhao

Adiabatic quantum computing is a powerful framework for state preparation, while its evolution time often scales quadratically in the inverse Hamiltonian spectral gap, leading to sub-optimal computational complexity. In this work, we…

Quantum Physics · Physics 2025-12-16 Xi Guo , Dong An

Approximate distributions for sum and difference of linearly correlated $\chi^{2}$ distributed random variables are derived. It is shown that they can be reduced to conveniently parametrized gamma and Variance-Gamma distributions,…

Methodology · Statistics 2019-06-25 Alberto Ferrari

We consider the problem of inferring the conditional independence graph (CIG) of a high-dimensional stationary multivariate Gaussian time series. In a time series graph, each component of the vector series is represented by distinct node,…

Machine Learning · Statistics 2022-05-03 Jitendra K Tugnait

A prescription is presented for a new and practical correlation coefficient, $\phi_K$, based on several refinements to Pearson's hypothesis test of independence of two variables. The combined features of $\phi_K$ form an advantage over…

Methodology · Statistics 2019-03-12 M. Baak , R. Koopman , H. Snoek , S. Klous

Undirected graphs are often used to describe high dimensional distributions. Under sparsity conditions, the graph can be estimated using $\ell_1$-penalization methods. We propose and study the following method. We combine a multiple…

Machine Learning · Statistics 2012-01-11 Shuheng Zhou , Philipp Rutimann , Min Xu , Peter Buhlmann