English
Related papers

Related papers: Predictive Coding beyond Correlations

200 papers

We provide explicit, finite-sample guarantees for learning causal representations from data with a sublinear number of environments. Causal representation learning seeks to provide a rigourous foundation for the general representation…

Machine Learning · Statistics 2026-03-30 Inbeom Lee , Tongtong Jin , Bryon Aragam

Causal inference is a critical research topic across many domains, such as statistics, computer science, education, public policy and economics, for decades. Nowadays, estimating causal effect from observational data has become an appealing…

Methodology · Statistics 2020-02-10 Liuyi Yao , Zhixuan Chu , Sheng Li , Yaliang Li , Jing Gao , Aidong Zhang

Causal models communicate our assumptions about causes and effects in real-world phe- nomena. Often the interest lies in the identification of the effect of an action which means deriving an expression from the observed probability…

Machine Learning · Statistics 2018-06-20 Santtu Tikka , Juha Karvanen

There is a growing concern about typically opaque decision-making with high-performance machine learning algorithms. Providing an explanation of the reasoning process in domain-specific terms can be crucial for adoption in risk-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Aditya Chattopadhyay , Stewart Slocum , Benjamin D. Haeffele , Rene Vidal , Donald Geman

Training with backpropagation (BP) in standard deep learning consists of two main steps: a forward pass that maps a data point to its prediction, and a backward pass that propagates the error of this prediction back through the network.…

Machine Learning · Computer Science 2022-10-13 Tommaso Salvatori , Luca Pinchetti , Beren Millidge , Yuhang Song , Tianyi Bao , Rafal Bogacz , Thomas Lukasiewicz

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Identifying variables responsible for changes to a biological system enables applications in drug target discovery and cell engineering. Given a pair of observational and interventional datasets, the goal is to isolate the subset of…

Machine Learning · Computer Science 2025-06-02 Menghua Wu , Umesh Padia , Sean H. Murphy , Regina Barzilay , Tommi Jaakkola

Causality is receiving increasing attention by the artificial intelligence and machine learning communities. This paper gives an example of modelling a recommender system problem using causal graphs. Specifically, we approached the causal…

Information Retrieval · Computer Science 2024-09-17 Emanuele Cavenaghi , Fabio Stella , Markus Zanker

In complex inferential tasks like question answering, machine learning models must confront two challenges: the need to implement a compositional reasoning process, and, in many applications, the need for this reasoning process to be…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Ronghang Hu , Jacob Andreas , Trevor Darrell , Kate Saenko

The paper introduces a generalization for known probabilistic models such as log-linear and graphical models, called here multiplicative models. These models, that express probabilities via product of parameters are shown to capture…

Artificial Intelligence · Computer Science 2012-06-18 Ydo Wexler , Christopher Meek

There is growing interest in the study of causal methods in the Earth sciences. However, most applications have focused on causal discovery, i.e. inferring the causal relationships and causal structure from data. This paper instead examines…

Atmospheric and Oceanic Physics · Physics 2021-05-04 Adam Massmann , Pierre Gentine , Jakob Runge

Our evolution as a species made a huge step forward when we understood the relationships between causes and effects. These associations may be trivial for some events, but they are not in complex scenarios. To rigorously prove that some…

Mathematical Software · Computer Science 2021-07-13 Martí Pedemonte , Jordi Vitrià , Álvaro Parafita

We consider the problem of learning the functions computing children from parents in a Structural Causal Model once the underlying causal graph has been identified. This is in some sense the second step after causal discovery. Taking a…

Machine Learning · Statistics 2017-07-03 Paul K. Rubenstein , Ilya Tolstikhin , Philipp Hennig , Bernhard Schoelkopf

Understanding causal mechanisms across different populations is essential for designing effective public health interventions. Recently, difference graphs have been introduced as a tool to visually represent causal variations between two…

Artificial Intelligence · Computer Science 2025-02-18 Charles K. Assaad

Causal inference in cue combination is to decide whether the cues have a single cause or multiple causes. Although the Bayesian causal inference model explains the problem of causal inference in cue combination successfully, how causal…

Neural and Evolutionary Computing · Computer Science 2015-09-04 Zhaofei Yu , Feng Chen , Jianwu Dong , Qionghai Dai

Backpropagation of error (backprop) is a powerful algorithm for training machine learning architectures through end-to-end differentiation. However, backprop is often criticised for lacking biological plausibility. Recently, it has been…

Machine Learning · Computer Science 2020-10-07 Beren Millidge , Alexander Tschantz , Christopher L. Buckley

Causal inference is central to many areas of artificial intelligence, including complex reasoning, planning, knowledge-base construction, robotics, explanation, and fairness. An active community of researchers develops and enhances…

Artificial Intelligence · Computer Science 2019-11-05 Amanda Gentzel , Dan Garant , David Jensen

This tutorial provides a concise introduction to modern causal modeling by integrating potential outcomes and graphical methods. We motivate causal questions such as counterfactual reasoning under interventions and define binary treatments…

Methodology · Statistics 2025-06-27 Gauranga Kumar Baishya

Causal inference can be formalized as Bayesian inference that combines a prior distribution over causal models and likelihoods that account for both observations and interventions. We show that it is possible to implement this approach…

Artificial Intelligence · Computer Science 2019-11-01 Sam Witty , Alexander Lew , David Jensen , Vikash Mansinghka

Predictive coding networks are neuroscience-inspired models with roots in both Bayesian statistics and neuroscience. Training such models, however, is quite inefficient and unstable. In this work, we show how by simply changing the temporal…

Neural and Evolutionary Computing · Computer Science 2024-02-08 Tommaso Salvatori , Yuhang Song , Yordan Yordanov , Beren Millidge , Zhenghua Xu , Lei Sha , Cornelius Emde , Rafal Bogacz , Thomas Lukasiewicz