English
Related papers

Related papers: Predictive Coding beyond Correlations

200 papers

Causal inference from observational data plays critical role in many applications in trustworthy machine learning. While sound and complete algorithms exist to compute causal effects, many of them assume access to conditional likelihoods,…

Machine Learning · Computer Science 2024-11-04 Md Musfiqur Rahman , Matt Jordan , Murat Kocaoglu

We establish conditions under which latent causal graphs are nonparametrically identifiable and can be reconstructed from unknown interventions in the latent space. Our primary focus is the identification of the latent structure in…

Machine Learning · Statistics 2023-11-06 Yibo Jiang , Bryon Aragam

Graphical models can represent a multivariate distribution in a convenient and accessible form as a graph. Causal models can be viewed as a special class of graphical models that not only represent the distribution of the observed system…

Methodology · Statistics 2017-06-29 Christina Heinze-Deml , Marloes H. Maathuis , Nicolai Meinshausen

A predictive model makes outcome predictions based on some given features, i.e., it estimates the conditional probability of the outcome given a feature vector. In general, a predictive model cannot estimate the causal effect of a feature…

Machine Learning · Computer Science 2023-04-11 Jiuyong Li , Lin Liu , Ziqi Xu , Ha Xuan Tran , Thuc Duy Le , Jixue Liu

Deep learning has revolutionized the field of artificial intelligence. Based on the statistical correlations uncovered by deep learning-based methods, computer vision has contributed to tremendous growth in areas like autonomous driving and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Kexuan Zhang , Qiyu Sun , Chaoqiang Zhao , Yang Tang

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest…

Machine Learning · Computer Science 2025-09-23 Spencer Compton , Kristjan Greenewald , Dmitriy Katz , Murat Kocaoglu

Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Olivier J. Hénaff , Aravind Srinivas , Jeffrey De Fauw , Ali Razavi , Carl Doersch , S. M. Ali Eslami , Aaron van den Oord

A large amount of recent research has the far-reaching goal of finding training methods for deep neural networks that can serve as alternatives to backpropagation (BP). A prominent example is predictive coding (PC), which is a…

Machine Learning · Computer Science 2022-11-08 Luca Pinchetti , Tommaso Salvatori , Yordan Yordanov , Beren Millidge , Yuhang Song , Thomas Lukasiewicz

The paper reviews methods that seek to draw causal inference from observational data and demonstrates how they can be applied to empirical problems in engineering research. It presents a framework for causal identification based on the…

Applications · Statistics 2022-11-28 Daniel J Graham

Causal inference is a science with multi-disciplinary evolution and applications. On the one hand, it measures effects of treatments in observational data based on experimental designs and rigorous statistical inference to draw causal…

Methodology · Statistics 2022-09-05 Jingying Zeng , Run Wang

Causal reasoning has been an indispensable capability for humans and other intelligent animals to interact with the physical world. In this work, we propose to endow an artificial agent with the capability of causal reasoning for completing…

Machine Learning · Computer Science 2019-10-07 Suraj Nair , Yuke Zhu , Silvio Savarese , Li Fei-Fei

This paper introduces a new framework for recovering causal graphs from observational data, leveraging the observation that the distribution of an effect, conditioned on its causes, remains invariant to changes in the prior distribution of…

Machine Learning · Computer Science 2026-02-04 Nang Hung Nguyen , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang , Masashi Sugiyama

Causal discovery is a fundamental problem with applications spanning various areas in science and engineering. It is well understood that solely using observational data, one can only orient the causal graph up to its Markov equivalence…

Machine Learning · Computer Science 2024-10-29 Zihan Zhou , Muhammad Qasim Elahi , Murat Kocaoglu

Causal discovery, the task of inferring causal structure from data, has the potential to uncover mechanistic insights from biological experiments, especially those involving perturbations. However, causal discovery algorithms over larger…

Machine Learning · Computer Science 2025-04-01 Menghua Wu , Yujia Bao , Regina Barzilay , Tommi Jaakkola

Defeasible reasoning is the mode of reasoning where conclusions can be overturned by taking into account new evidence. A commonly used method in cognitive science and logic literature is to handcraft argumentation supporting inference…

Computation and Language · Computer Science 2021-06-01 Aman Madaan , Dheeraj Rajagopal , Niket Tandon , Yiming Yang , Eduard Hovy

The backpropagation of error algorithm used to train deep neural networks has been fundamental to the successes of deep learning. However, it requires sequential backward updates and non-local computations, which make it challenging to…

Neural and Evolutionary Computing · Computer Science 2022-02-22 Beren Millidge , Tommaso Salvatori , Yuhang Song , Rafal Bogacz , Thomas Lukasiewicz

Predictive coding is an influential model of cortical neural activity. It proposes that perceptual beliefs are furnished by sequentially minimising "prediction errors" - the differences between predicted and observed data. Implicit in this…

Neurons and Cognition · Quantitative Biology 2022-04-07 Alexander Tschantz , Beren Millidge , Anil K Seth , Christopher L Buckley

Although the widespread use of AI systems in today's world is growing, many current AI systems are found vulnerable due to hidden bias and missing information, especially in the most commonly used forecasting system. In this work, we…

Machine Learning · Computer Science 2024-07-30 Zhixuan Chu , Hui Ding , Guang Zeng , Shiyu Wang , Yiming Li

We introduce computational causal inference as an interdisciplinary field across causal inference, algorithms design and numerical computing. The field aims to develop software specializing in causal inference that can analyze massive…

Computation · Statistics 2020-07-22 Jeffrey C. Wong

Causal identification is at the core of the causal inference literature, where complete algorithms have been proposed to identify causal queries of interest. The validity of these algorithms hinges on the restrictive assumption of having…

Machine Learning · Computer Science 2023-10-30 Sina Akbari , Fateme Jamshidi , Ehsan Mokhtarian , Matthew J. Vowels , Jalal Etesami , Negar Kiyavash