English
Related papers

Related papers: Bayesian Kernelised Test of (In)dependence with Mi…

200 papers

Context dependence is central to the description of complexity. Keying on the pairwise definition of "set complexity" we use an information theory approach to formulate general measures of systems complexity. We examine the properties of…

Information Theory · Computer Science 2013-08-21 David J. Galas , Nikita A. Sakhanenko , Alexander Skupin , Tomasz Ignac

This paper presents an approximate method for performing Bayesian inference in models with conditional independence over a decentralized network of learning agents. The method first employs variational inference on each individual learning…

Machine Learning · Computer Science 2014-06-13 Trevor Campbell , Jonathan P. How

Intersectionality is a framework that analyzes how interlocking systems of power and oppression affect individuals along overlapping dimensions including race, gender, sexual orientation, class, and disability. Intersectionality theory…

Machine Learning · Computer Science 2019-09-11 James Foulds , Rashidul Islam , Kamrun Keya , Shimei Pan

This paper introduces Kernel-based Information Criterion (KIC) for model selection in regression analysis. The novel kernel-based complexity measure in KIC efficiently computes the interdependency between parameters of the model using a…

Machine Learning · Statistics 2014-12-16 Somayeh Danafar , Kenji Fukumizu , Faustino Gomez

We present a non-parametric Bayesian latent variable model capable of learning dependency structures across dimensions in a multivariate setting. Our approach is based on flexible Gaussian process priors for the generative mappings and…

Machine Learning · Statistics 2018-07-16 Andrew R. Lawrence , Carl Henrik Ek , Neill D. F. Campbell

Nonparametric and nonlinear measures of statistical dependence between pairs of random variables are important tools in modern data analysis. In particular the emergence of large data sets can now support the relaxation of linearity…

Methodology · Statistics 2016-05-13 Sarah Filippi , Chris Holmes

Likelihood-free approaches are appealing for performing inference on complex dependence models, either because it is not possible to formulate a likelihood function, or its evaluation is very computationally costly. This is the case for…

Methodology · Statistics 2025-12-08 Lídia M. André , Jennifer L. Wadsworth , Raphaël Huser

We demonstrate how to test for conditional independence of two variables with categorical data using Poisson log-linear models. The size of the conditioning set of variables can vary from 0 (simple independence) up to many variables. We…

Methodology · Statistics 2017-06-08 Michail Tsagris

Speech signals encode emotional, linguistic, and pathological information within a shared acoustic channel; however, disentanglement is typically assessed indirectly through downstream task performance. We introduce an information-theoretic…

Sound · Computer Science 2026-02-25 Bipasha Kashyap , Björn W. Schuller , Pubudu N. Pathirana

In this paper, we address the problem of testing independence between two high-dimensional random vectors. Our approach involves a series of max-sum tests based on three well-known classes of rank-based correlations. These correlation…

Methodology · Statistics 2024-04-04 Hongfei Wang , Binghui Liu , Long Feng

Experimentally observed networks of interacting dynamical systems are inferred from recorded multivariate time series by evaluating a statistical measure of dependence, usually the cross-correlation coefficient, or mutual information. These…

Data Analysis, Statistics and Probability · Physics 2017-07-03 Milan Palus

Bayesian paradigm takes advantage of well fitting complicated survival models and feasible computing in survival analysis owing to the superiority in tackling the complex censoring scheme, compared with the frequentist paradigm. In this…

Methodology · Statistics 2021-09-10 Chong Zhong , Zhihua Ma , Junshan Shen , Catherine Liu

A new test of independence between random elements is presented in this article. The test is based on a functional of the Cram\'{e}r-von Mises type, which is applied to a $U$-process that is defined from the recurrence rates. Theorems of…

Statistics Theory · Mathematics 2019-08-12 Juan Kalemkerian , Diego Fernández

Recognizing, quantifying and visualizing associations between two variables is increasingly important. This paper investigates how a new function-valued measure of dependence, the quantile dependence function, can be used to construct tests…

Methodology · Statistics 2019-04-16 Ćmiel Bogdan , Ledwina Teresa

A test is adaptive when its sequence and number of questions is dynamically tuned on the basis of the estimated skills of the taker. Graphical models, such as Bayesian networks, are used for adaptive tests as they allow to model the…

Artificial Intelligence · Computer Science 2021-09-29 Alessandro Antonucci , Francesca Mangili , Claudio Bonesana , Giorgia Adorni

The multiscale Fisher's independence test (MULTIFIT hereafter) proposed by Gorsky & Ma (2022) is a novel method to test independence between two random vectors. By its design, this test is particularly useful in detecting local dependence.…

Statistics Theory · Mathematics 2022-04-27 Duyeol Lee , Helal El-Zaatari , Michael R. Kosorok , Xinyi Li , Kai Zhang

Testing hypothesis of independence between two random elements on a joint alphabet is a fundamental exercise in statistics. Pearson's chi-squared test is an effective test for such a situation when the contingency table is relatively small.…

Statistics Theory · Mathematics 2025-03-19 Jialin Zhang , Zhiyi Zhang

Identifying dependency in multivariate data is a common inference task that arises in numerous applications. However, existing nonparametric independence tests typically require computation that scales at least quadratically with the sample…

Methodology · Statistics 2021-07-08 Shai Gorsky , Li Ma

A new method to measure nonlinear dependence between two variables is described using mutual information to analyze the separate linear and nonlinear components of dependence. This technique, which gives an exact value for the proportion of…

Information Theory · Computer Science 2015-12-17 Reginald D. Smith

We treat the problem of testing independence between m continuous variables when m can be larger than the available sample size n. We consider three types of test statistics that are constructed as sums or sums of squares of pairwise rank…

Statistics Theory · Mathematics 2016-12-05 Dennis Leung , Mathias Drton