English
Related papers

Related papers: Copula Entropy: Theory and Applications

200 papers

Copulas are powerful statistical tools for capturing dependencies across data dimensions. Applying Copulas involves estimating independent marginals, a straightforward task, followed by the much more challenging task of determining a single…

Machine Learning · Computer Science 2024-05-29 Flavio Figueiredo , José Geraldo Fernandes , Jackson Silva , Renato M. Assunção

Copulas have now become ubiquitous statistical tools for describing, analysing and modelling dependence between random variables. Sklar's theorem, "the fundamental theorem of copulas", makes a clear distinction between the continuous case…

Methodology · Statistics 2019-02-12 Gery Geenens

A quantitative first-principles description of complex substitutional materials like alloys is challenging due to the vast number of configurations and the high computational cost of solving the quantum-mechanical problem. Therefore,…

Materials Science · Physics 2025-06-24 Adrian Stroth , Claudia Draxl , Santiago Rigamonti

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest…

Machine Learning · Computer Science 2025-09-23 Spencer Compton , Kristjan Greenewald , Dmitriy Katz , Murat Kocaoglu

The thermodynamic definition of entropy can be extended to nonequilibrium systems based on its relation to information. To apply this definition in practice requires access to the physical system's microstates, which may be prohibitively…

Statistical Mechanics · Physics 2020-08-21 Gil Ariel , Haim Diamant

In this work we investigate generalized theories of gravity in the so-called configurational entropy (CE) context. We show, by means of this information-theoretical measure, that a stricter bound on the parameter of $f(R,T)$ brane models…

High Energy Physics - Theory · Physics 2016-03-23 R. A. C. Correa , P. H. R. S. Moraes

This paper introduces a nonparametric copula-based index for detecting the strength and monotonicity structure of linear and nonlinear statistical dependence between pairs of random variables or stochastic signals. Our index, termed Copula…

Machine Learning · Statistics 2020-02-25 Kiran Karra , Lamine Mili

A framework named Copula Component Analysis (CCA) for blind source separation is proposed as a generalization of Independent Component Analysis (ICA). It differs from ICA which assumes independence of sources that the underlying components…

Information Retrieval · Computer Science 2007-05-23 Jian Ma , Zengqi Sun

Copula modeling has gained much attention in many fields recently with the advantage of separating dependence structure from marginal distributions. In real data, however, serious ties are often present in one or multiple margins, which…

Methodology · Statistics 2022-12-15 Yan Li , Yang Li , Yichen Qin , Jun Yan

Multi-instance data, in which each object (bag) contains a collection of instances, are widespread in machine learning, computer vision, bioinformatics, signal processing, and social sciences. We present a maximum entropy (ME) framework for…

Machine Learning · Computer Science 2016-03-15 Behrouz Behmardi , Forrest Briggs , Xiaoli Z. Fern , Raviv Raich

Understanding the way in which random entities interact is of key interest in numerous scientific fields. This can range from a full characterization of the joint distribution to single scalar summary statistics. In this work we identify a…

Statistics Theory · Mathematics 2016-11-22 Yaniv Tenzer , Gal Elidan

We translate the problem of calculating the entropy of a set of binary configurations/signals into a sequence of supervised classification tasks. Subsequently, one can use virtually any machine learning classification algorithm for…

Statistical Mechanics · Physics 2019-10-25 Romuald A. Janik

Regression analysis is one of the most popularly used statistical technique which only measures the direct effect of independent variables on dependent variable. Path analysis looks for both direct and indirect effects of independent…

Methodology · Statistics 2024-06-26 Alam Ali , Ashok Kumar Pathak , Mohd Arshad , Ayyub Sheikhi

Inference of causality is central in nonlinear time series analysis and science in general. A popular approach to infer causality between two processes is to measure the information flow between them in terms of transfer entropy. Using…

Chaotic Dynamics · Physics 2015-04-16 Jie Sun , Erik M. Bollt

Inferring the directionality of interactions between cellular processes is a major challenge in systems biology. Time-lagged correlations allow to discriminate between alternative models, but they still rely on assumed underlying…

Quantitative Methods · Quantitative Biology 2017-11-15 Sourabh Lahiri , Philippe Nghe , Sander J. Tans , Martin Luc Rosinberg , David Lacoste

This paper introduces an innovative method for constructing copula models capable of describing arbitrary non-monotone dependence structures. The proposed method enables the creation of such copulas in parametric form, thus allowing the…

Methodology · Statistics 2024-03-26 Manfred Marvin Marchione , Fabio Baione

Critical decisions frequently rely on high-dimensional output from complex computer simulation models that show intricate cross-variable, spatial and temporal dependence structures, with weather and climate predictions being key examples.…

Methodology · Statistics 2013-12-24 Roman Schefzik , Thordis L. Thorarinsdottir , Tilmann Gneiting

We reformulate and reframe a series of increasingly complex parametric statistical topics into a framework of response-vs-covariate (Re-Co) dynamics that is described without any explicit functional structures. Then we resolve these topics'…

Methodology · Statistics 2022-10-12 Ting-Li Chen , Hsieh Fushing , Elizabeth P. Chou

During the last two decades, concentration inequalities have been the subject of exciting developments in various areas, including convex geometry, functional analysis, statistical physics, high-dimensional statistics, pure and applied…

Information Theory · Computer Science 2015-02-26 Maxim Raginsky , Igal Sason

Verification and validation of fully automated vehicles is linked to an almost intractable challenge of reflecting the real world with all its interactions in a virtual environment. Influential stochastic parameters need to be extracted…

Applications · Statistics 2022-11-22 Katrin Lotto , Thomas Nagler , Mladjan Radic