English
Related papers

Related papers: Nonlinear Causal Discovery via Kernel Anchor Regre…

200 papers

In this paper we introduce a kernel-based measure for detecting differences between two conditional distributions. Using the `kernel trick' and nearest-neighbor graphs, we propose a consistent estimate of this measure which can be computed…

Methodology · Statistics 2024-08-30 Anirban Chatterjee , Ziang Niu , Bhaswar B. Bhattacharya

In this paper, we propose a variable selection method for general nonparametric kernel-based estimation. The proposed method consists of two-stage estimation: (1) construct a consistent estimator of the target function, (2) approximate the…

Machine Learning · Statistics 2018-12-05 Kota Matsui , Wataru Kumagai , Kenta Kanamori , Mitsuaki Nishikimi , Takafumi Kanamori

The discovery of causal relationships in a set of random variables is a fundamental objective of science and has also recently been argued as being an essential component towards real machine intelligence. One class of causal discovery…

Machine Learning · Statistics 2024-02-01 Tim Tse , Zhitang Chen , Shengyu Zhu , Yue Liu

The machine learning community has recently devoted much attention to the problem of inferring causal relationships from statistical data. Most of this work has focused on uncovering connections among scalar random variables. We generalize…

Machine Learning · Statistics 2012-07-10 Doris Entner , Patrik O. Hoyer

Most causal discovery algorithms find causal structure among a set of observed variables. Learning the causal structure among latent variables remains an important open problem, particularly when using high-dimensional data. In this paper,…

Machine Learning · Computer Science 2020-09-09 Jonathan D. Young , Bryan Andrews , Gregory F. Cooper , Xinghua Lu

Constraint-based structure learning algorithms infer the causal structure of multivariate systems from observational data by determining an equivalent class of causal structures compatible with the conditional independencies in the data.…

Machine Learning · Statistics 2019-05-22 Daniel Chicharro , Stefano Panzeri , Ilya Shpitser

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

We derive a set of causal deep neural networks whose architectures are a consequence of tensor (multilinear) factor analysis, a framework that facilitates causal inference. Forward causal questions are addressed with a neural network…

Machine Learning · Computer Science 2025-06-17 M. Alex O. Vasilescu

Empirical observation of high dimensional phenomena, such as the double descent behaviour, has attracted a lot of interest in understanding classical techniques such as kernel methods, and their implications to explain generalization…

Canonical correlation analysis is a technique to extract common features from a pair of multivariate data. In complex situations, however, it does not extract useful features because of its linearity. On the other hand, kernel method used…

Machine Learning · Computer Science 2007-05-23 Shotaro Akaho

The goal of Causal Discovery is to find automated search methods for learning causal structures from observational data. In some cases all variables of the interested causal mechanism are measured, and the task is to predict the effects one…

Machine Learning · Statistics 2024-01-11 Shuyan Wang

We consider the problem of high-dimensional non-linear variable selection for supervised learning. Our approach is based on performing linear selection among exponentially many appropriately defined positive definite kernels that…

Machine Learning · Computer Science 2009-09-08 Francis Bach

While most classical approaches to Granger causality detection repose upon linear time series assumptions, many interactions in neuroscience and economics applications are nonlinear. We develop an approach to nonlinear Granger causality…

Machine Learning · Statistics 2018-06-26 Alex Tank , Ian Cover , Nicholas J. Foti , Ali Shojaie , Emily B. Fox

Faithful evaluation of language model capabilities is crucial for deriving actionable insights that can inform model development. However, rigorous causal evaluations in this domain face significant methodological challenges, including…

Machine Learning · Computer Science 2025-06-13 Jikai Jin , Vasilis Syrgkanis , Sham Kakade , Hanlin Zhang

I introduce a novel algorithm and accompanying Python library, named mlcausality, designed for the identification of nonlinear Granger causal relationships. This novel algorithm uses a flexible plug-in architecture that enables researchers…

Machine Learning · Statistics 2023-09-13 Wojciech "Victor" Fulmyk

We introduce an algorithm which, in the context of nonlinear regression on vector-valued explanatory variables, chooses those combinations of vector components that provide best prediction. The algorithm devotes particular attention to…

Methodology · Statistics 2014-02-03 Frédéric Ferraty , Peter Hall

This paper considers an extension of the linear non-Gaussian acyclic model (LiNGAM) that determines the causal order among variables from a dataset when the variables are expressed by a set of linear equations, including noise. In…

Machine Learning · Computer Science 2021-08-17 Joe Suzuki , Yusuke Inaoka

Healthcare artificial intelligence systems often degrade in performance when deployed across institutions, with documented performance drops and perpetuation of discriminatory patterns embedded in data. This brittleness comes, in part, from…

Machine Learning · Computer Science 2026-03-30 Munib Mesinovic , Max Buhlan , Tingting Zhu

Nonlinear causal discovery from observational data imposes strict identifiability assumptions on the formulation of structural equations utilized in the data generating process. The evaluation of structure learning methods under assumption…

Machine Learning · Statistics 2024-12-17 Georg Velev , Stefan Lessmann

We introduce a novel approach to estimation problems in settings with missing data. Our proposal -- the Correlation-Assisted Missing data (CAM) estimator -- works by exploiting the relationship between the observations with missing features…

Methodology · Statistics 2020-03-02 Timothy I. Cannings , Yingying Fan