English
Related papers

Related papers: An information theoretic approach to statistical d…

200 papers

In this article, we study tests of independence for data with arbitrary distributions in the non-serial case, i.e., for independent and identically distributed random vectors, as well as in the serial case, i.e., for time series. These…

Methodology · Statistics 2023-06-13 Bouchra R. Nasri , Bruno N. Remillard

A method for estimating the Shannon differential entropy of multidimensional random variables using independent samples is described. The method is based on decomposing the distribution into a product of the marginal distributions and the…

Statistical Mechanics · Physics 2020-04-22 Gil Ariel , Yoram Louzoun

Copulas are a powerful tool for modeling multivariate distributions as they allow to separately estimate the univariate marginal distributions and the joint dependency structure. However, known parametric copulas offer limited flexibility…

Machine Learning · Statistics 2021-11-11 Tim Janke , Mohamed Ghanmi , Florian Steinke

In this paper, we obtain general representations for the joint distributions and copulas of arbitrary dependent random variables absolutely continuous with respect to the product of given one-dimensional marginal distributions. The…

Statistics Theory · Mathematics 2016-08-16 Victor H. de la Peña , Rustam Ibragimov , Shaturgun Sharakhmetov

Information theory provides ideas for conceptualising information and measuring relationships between objects. It has found wide application in the sciences, but economics and finance have made surprisingly little use of it. We show that…

Statistical Finance · Quantitative Finance 2013-05-02 Galen Sher , Pedro Vitoria

Model selection is an important activity in modern data analysis and the conventional Bayesian approach to this problem involves calculation of marginal likelihoods for different models, together with diagnostics which examine specific…

Computation · Statistics 2008-10-31 David J. Nott , Robert J. Kohn , Mark Fielding

Analysing dependent risks is an important task for insurance companies. A dependency is reflected in the fact that information about one random variable provides information about the likely distribution of values of another random…

Applications · Statistics 2021-03-22 Sen Hu , Adrian O'Hagan

We introduce novel information-theoretic measures termed the multivariate cumulative copula fractional inaccuracy measure and the multivariate survival copula fractional inaccuracy measure, constructed respectively from multivariate copulas…

Statistics Theory · Mathematics 2025-06-25 Aman Pandey , Chanchal Kundu

Several collective risk models have recently been proposed by relaxing the widely used but controversial assumption of independence between claim frequency and severity. Approaches include the bivariate copula model, random effect model,…

Applications · Statistics 2019-06-11 Rosy Oh , Jae Youn Ahn , Woojoo Lee

This article proposes a space-efficient approximation to empirical tail dependence coefficients of an indefinite bivariate stream of data. The approximation, which has stream-length invariant error bounds, utilises recent work on the…

Computation · Statistics 2019-09-17 Alastair Gregory , Kaushik Jana

Dependence modeling of multivariate count data has garnered significant attention in recent years. Multivariate elliptical copulas are typically preferred in statistical literature to analyze dependence between repeated measurements of…

Methodology · Statistics 2025-01-22 Subhajit Chattopadhyay

We consider dynamic versions of the mutual information of lifetime distributions, with focus on past lifetimes, residual lifetimes and mixed lifetimes evaluated at different instants. This allows to study multicomponent systems, by…

Probability · Mathematics 2016-05-10 Jafar Ahmadi , Antonio Di Crescenzo , Maria Longobardi

The quantitative analysis of financial time series often reveals two distinct features that standard Gaussian frameworks fail to capture: heavy-tailed marginal distributions and the phenomenon of extreme co-movements.While extreme value…

Statistics Theory · Mathematics 2026-05-14 Debanjana Datta , Diganta Mukherjee

We present a joint copula-based model for insurance claims and sizes. It uses bivariate copulae to accommodate for the dependence between these quantities. We derive the general distribution of the policy loss without the restrictive…

Statistics Theory · Mathematics 2012-09-25 Nicole Kraemer , Eike C. Brechmann , Daniel Silvestrini , Claudia Czado

Thanks to their ability to capture complex dependence structures, copulas are frequently used to glue random variables into a joint model with arbitrary marginal distributions. More recently, they have been applied to solve statistical…

Methodology · Statistics 2022-08-22 Thomas Nagler , Thibault Vatter

Estimating mutual information (MI) is a fundamental task in data science and machine learning. Existing estimators mainly rely on either highly flexible models (e.g., neural networks), which require large amounts of data, or overly…

Machine Learning · Computer Science 2025-10-27 Yanzhi Chen , Zijing Ou , Adrian Weller , Michael U. Gutmann

Statistical independence and conditional independence are two fundamental concepts in statistics and machine learning. Copula Entropy is a mathematical concept defined by Ma and Sun for multivariate statistical independence measuring and…

Computation · Statistics 2021-03-30 Jian Ma

Copulas are essential tools in statistics and probability theory, enabling the study of the dependence structure between random variables independently of their marginal distributions. Among the various types of copulas, Ratio-Type Copulas…

Statistics Theory · Mathematics 2025-05-21 Ziad Adwan , Nicola Sottocornola

Copula models are flexible tools to represent complex structures of dependence for multivariate random variables. According to Sklar's theorem (Sklar, 1959), any d-dimensional absolutely continuous density can be uniquely represented as the…

Methodology · Statistics 2021-03-05 Clara Grazian , Luciana Dalla Valle , Brunero Liseo

Copula is a powerful tool to model multivariate data. We propose the modelling of intraday financial returns of multiple assets through copula. The problem originates due to the asynchronous nature of intraday financial data. We propose a…

Statistical Finance · Quantitative Finance 2024-05-29 Arnab Chakrabarti , Rituparna Sen