English
Related papers

Related papers: Learning general conditional independence structur…

200 papers

Learning a distribution conditional on a set of discrete-valued features is a commonly encountered task. This becomes more challenging with a high-dimensional feature set when there is the possibility of interaction between the features. In…

Machine Learning · Statistics 2013-05-01 David C. Kessler , Jack Taylor , David B. Dunson

A graphical model is a statistical model that is associated to a graph whose nodes correspond to variables of interest. The edges of the graph reflect allowed conditional dependencies among the variables. Graphical models admit…

Methodology · Statistics 2016-06-09 Mathias Drton , Marloes H. Maathuis

It is well known that non-parametric methods suffer from the "curse of dimensionality". We propose here a new estimation method for a multivariate distribution, using sub-sampling and ranks, which seems not to suffer from this "curse". We…

Statistics Theory · Mathematics 2013-11-08 Collet Jérôme

We study the problem of causal structure learning with essentially no assumptions on the functional relationships and noise. We develop DAG-FOCI, a computationally fast algorithm for this setting that is based on the FOCI variable selection…

Statistics Theory · Mathematics 2022-03-21 Mona Azadkia , Armeen Taeb , Peter Bühlmann

Constraint-based (CB) learning is a formalism for learning a causal network with a database D by performing a series of conditional-independence tests to infer structural information. This paper considers a new test of independence that…

Artificial Intelligence · Computer Science 2012-12-12 Denver Dash , Marek J. Druzdzel

This paper addresses unsupervised representation learning on tabular data containing multiple views generated by distinct sources of measurement. Traditional methods, which tackle this problem using the multi-view framework, are constrained…

Machine Learning · Computer Science 2023-06-01 Tennison Liu , Jeroen Berrevoets , Zhaozhi Qian , Mihaela van der Schaar

Determinantal point process have recently been used as models in machine learning and this has raised questions regarding the characterizations of conditional independence. In this paper we investigate characterizations of conditional…

Probability · Mathematics 2014-07-01 Tvrtko Tadić

This paper considers learning of the graphical structure of a $p$-dimensional random vector $X \in R^p$ using both parametric and non-parametric methods. Unlike the previous works which observe $x$ directly, we consider the indirect…

Machine Learning · Statistics 2022-05-10 Hang Zhang , Afshin Abdi , Faramarz Fekri

We present the Probabilistic Context Neighborhood model designed for two-dimensional lattices as a variation of a Markov Random Field assuming discrete values. In this model, the neighborhood structure has a fixed geometry but a variable…

Methodology · Statistics 2024-01-31 Debora F. Magalhaes , Aline M. Piroutek , Denise Duarte , Caio Alves

Real-world data generation often involves certain geometries (e.g., graphs) that induce instance-level interdependence. This characteristic makes the generalization of learning models more difficult due to the intricate interdependent…

Machine Learning · Computer Science 2024-06-10 Qitian Wu , Fan Nie , Chenxiao Yang , Junchi Yan

Dependency knowledge of the form "x is independent of y once z is known" invariably obeys the four graphoid axioms, examples include probabilistic and database dependencies. Often, such knowledge can be represented efficiently with…

Artificial Intelligence · Computer Science 2013-04-10 Tom S. Verma , Judea Pearl

We consider the problem of structure learning for Gaifman models and learn relational features that can be used to derive feature representations from a knowledge base. These relational features are first-order rules that are then partially…

Machine Learning · Computer Science 2020-01-17 Devendra Singh Dhami , Siwen Yan , Gautam Kunapuli , Sriraam Natarajan

We introduce the Conditional Independence Regression CovariancE (CIRCE), a measure of conditional independence for multivariate continuous-valued variables. CIRCE applies as a regularizer in settings where we wish to learn neural features…

Machine Learning · Computer Science 2023-12-20 Roman Pogodin , Namrata Deka , Yazhe Li , Danica J. Sutherland , Victor Veitch , Arthur Gretton

In this contribution we deal with the problem of learning an undirected graph which encodes the conditional dependence relationship between variables of a complex system, given a set of observations of this system. This is a very central…

Methodology · Statistics 2019-07-26 Daniela De Canditiis , Armando Guardasole

A graph neural network transforms features in each vertex's neighborhood into a vector representation of the vertex. Afterward, each vertex's representation is used independently for predicting its label. This standard pipeline implicitly…

Machine Learning · Computer Science 2020-06-18 Junteng Jia , Austin R. Benson

We propose a new conditional dependence measure and a statistical test for conditional independence. The measure is based on the difference between analytic kernel embeddings of two well-suited distributions evaluated at a finite set of…

Machine Learning · Statistics 2022-06-17 Meyer Scetbon , Laurent Meunier , Yaniv Romano

In broad applications, it is routinely of interest to assess whether there is evidence in the data to refute the assumption of conditional independence of $Y$ and $X$ conditionally on $Z$. Such tests are well developed in parametric models…

Methodology · Statistics 2015-03-25 Tsuyoshi Kunihama , David B. Dunson

Probabilistic dependency graphs (PDGs) are a flexible class of probabilistic graphical models, subsuming Bayesian Networks and Factor Graphs. They can also capture inconsistent beliefs, and provide a way of measuring the degree of this…

Data Structures and Algorithms · Computer Science 2023-11-10 Oliver E. Richardson , Joseph Y. Halpern , Christopher De Sa

The ability to remove unwanted dependencies from data is crucial in various domains, including fairness, robust learning, and privacy protection. In this work, we propose an encoder-based approach that learns a representation independent of…

Machine Learning · Computer Science 2026-03-05 Kathleen Anderson , Thomas Martinetz

Statisticians and quantitative neuroscientists have actively promoted the use of independence relationships for investigating brain networks, genomic networks, and other measurement technologies. Estimation of these graphs depends on two…

Methodology · Statistics 2014-10-15 Fang Han , Huitong Qiu , Han Liu , Brian Caffo