English
Related papers

Related papers: copent: Estimating Copula Entropy and Transfer Ent…

200 papers

Constraint-based causal discovery methods leverage conditional independence tests to infer causal relationships in a wide variety of applications. Just as the majority of machine learning methods, existing work focuses on studying…

Machine Learning · Statistics 2024-05-27 Siyuan Guo , Viktor Tóth , Bernhard Schölkopf , Ferenc Huszár

In an introductory tutorial, we illustrated building cohort state-transition models (cSTMs) in R, where the state transitions probabilities were constant over time. However, in practice, many cSTMs require transitions, rewards, or both to…

Causal discovery is to learn cause-effect relationships among variables given observational data and is important for many applications. Existing causal discovery methods assume data sufficiency, which may not be the case in many real world…

Machine Learning · Computer Science 2022-06-20 Zijun Cui , Naiyu Yin , Yuru Wang , Qiang Ji

The empirical copula process plays a central role in the asymptotic analysis of many statistical procedures which are based on copulas or ranks. Among other applications, results regarding its weak convergence can be used to develop…

Statistics Theory · Mathematics 2014-11-24 Axel Bücher , Betina Berghaus , Stanislav Volgushev

In this article, a copula-based method for mixed regression models is proposed, where the conditional distribution of the response variable, given covariates, is modelled by a parametric family of continuous or discrete distributions, and…

Methodology · Statistics 2025-01-13 Pavel Krupskii , Bouchra R Nasri , Bruno N Remillard

We propose utilizing entropy as a diagnostic tool to distinguish between constant and dynamical dark energy models. Entropy, a measure of the system's disorder or information content, captures the complexity and evolution of the universe.…

General Relativity and Quantum Cosmology · Physics 2025-07-16 Tanisha Joshi

Conditional-independence-based discovery uses statistical tests to identify a graphical model that represents the independence structure of variables in a dataset. These tests, however, can be unreliable, and algorithms are sensitive to…

Machine Learning · Computer Science 2026-04-21 Philipp M. Faller , Dominik Janzing

Motivated by modern data forms such as images and multi-view data, the multi-attribute graphical model aims to explore the conditional independence structure among vectors. Under the Gaussian assumption, the conditional independence between…

Machine Learning · Statistics 2024-04-11 Qi Zhang , Bing Li , Lingzhou Xue

Deheuvels [J. Multivariate Anal. 11 (1981) 102--113] and Genest and R\'{e}millard [Test 13 (2004) 335--369] have shown that powerful rank tests of multivariate independence can be based on combinations of asymptotically independent…

Statistics Theory · Mathematics 2009-09-29 Christian Genest , Jean-François Quessy , Bruno Rémillard

Estimation of mutual information between random variables has become crucial in a range of fields, from physics to neuroscience to finance. Estimating information accurately over a wide range of conditions relies on the development of…

Methodology · Statistics 2018-11-14 Houman Safaai , Arno Onken , Christopher D. Harvey , Stefano Panzeri

Classical and more recent tests for detecting distributional changes in multivariate time series often lack power against alternatives that involve changes in the cross-sectional dependence structure. To be able to detect such changes…

Statistics Theory · Mathematics 2014-09-16 Axel Bücher , Ivan Kojadinovic , Tom Rohmer , Johan Segers

Multi-instance data, in which each object (bag) contains a collection of instances, are widespread in machine learning, computer vision, bioinformatics, signal processing, and social sciences. We present a maximum entropy (ME) framework for…

Machine Learning · Computer Science 2016-03-15 Behrouz Behmardi , Forrest Briggs , Xiaoli Z. Fern , Raviv Raich

Methods that infer causal dependence from observational data are central to many areas of science, including medicine, economics, and the social sciences. A variety of theoretical properties of these methods have been proven, but empirical…

Methodology · Statistics 2021-07-08 Amanda Gentzel , Purva Pruthi , David Jensen

We introduce a new test procedure of independence in the framework of parametric copulas with unknown marginals. The method is based essentially on the dual representation of $\chi^2$-divergence on signed finite measures. The asymptotic…

Statistics Theory · Mathematics 2019-03-15 Salim Bouzebda , Amor Keziou

Transfer entropy measures directed information flow in time series, and it has become a fundamental quantity in applications spanning neuroscience, finance, and complex systems analysis. However, existing estimation methods suffer from the…

Machine Learning · Computer Science 2026-04-10 Simon Pedro Galeano Munoz , Mustapha Bounoua , Giulio Franzese , Pietro Michiardi , Maurizio Filippone

We derive a functional for the entropy contributed by any microscopic degrees of freedom as arising from their measurable pair correlations. Applicable both in and out of equilibrium, this functional yields the maximum entropy which a…

Statistical Mechanics · Physics 2023-02-17 Benjamin Sorkin , Joshua Ricouvier , Haim Diamant , Gil Ariel

This paper proposes different methods to consistently detect multiple breaks in copula-based dependence measures, mainly focusing on Spearman's $\rho$. The leading model is a factor copula model due to its usefulness for analyzing data in…

Methodology · Statistics 2022-06-13 Marvin Borsch , Alexander Mayer , Dominik Wied

Healthcare data often come from multiple sites in which the correlations between confounding variables can vary widely. If deep learning models exploit these unstable correlations, they might fail catastrophically in unseen sites. Although…

Machine Learning · Computer Science 2023-10-25 Minh Nguyen , Alan Q. Wang , Heejong Kim , Mert R. Sabuncu

We propose a new class of extreme-value copulas which are extreme-value limits of conditional normal models. Conditional normal models are generalizations of conditional independence models, where the dependence among observed variables is…

Methodology · Statistics 2021-02-16 Pavel Krupskii , Marc G. Genton

Measuring a strength of dependence of random variables is an important problem in statistical practice. In this paper, we propose a new function valued measure of dependence of two random variables. It allows one to study and visualize…

Methodology · Statistics 2014-05-12 Teresa Ledwina