English
Related papers

Related papers: Inducing Causal Structure for Interpretable Neural…

200 papers

We are in the middle of a remarkable rise in the use and capability of artificial intelligence. Much of this growth has been fueled by the success of deep learning architectures: models that map from observables to outputs via multiple…

Applications · Statistics 2017-01-02 Jason Hartford , Greg Lewis , Kevin Leyton-Brown , Matt Taddy

Recent work has shown success in incorporating pre-trained models like BERT to improve NLP systems. However, existing pre-trained models lack of causal knowledge which prevents today's NLP systems from thinking like humans. In this paper,…

Computation and Language · Computer Science 2021-08-10 Zhongyang Li , Xiao Ding , Kuo Liao , Bing Qin , Ting Liu

We present a novel attention mechanism: Causal Attention (CATT), to remove the ever-elusive confounding effect in existing attention-based vision-language models. This effect causes harmful bias that misleads the attention module to focus…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Xu Yang , Hanwang Zhang , Guojun Qi , Jianfei Cai

Massive data collection holds the promise of a better understanding of complex phenomena and, ultimately, better decisions. Representation learning has become a key driver of deep learning applications, as it allows learning latent spaces…

Machine Learning · Computer Science 2025-11-10 Caroline Uhler , Jiaqi Zhang

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

Learning transferable knowledge across similar but different settings is a fundamental component of generalized intelligence. In this paper, we approach the transfer learning challenge from a causal theory perspective. Our agent is endowed…

Machine Learning · Computer Science 2019-11-27 Mark Edmonds , Xiaojian Ma , Siyuan Qi , Yixin Zhu , Hongjing Lu , Song-Chun Zhu

Several methods exist to infer causal networks from massive volumes of observational data. However, almost all existing methods require a considerable length of time series data to capture cause and effect relationships. In contrast,…

Machine Learning · Statistics 2016-12-22 Abbas Shojaee , Isuru Ranasinghe , Alireza Ani

Causality knowledge is vital to building robust AI systems. Deep learning models often perform poorly on tasks that require causal reasoning, which is often derived using some form of commonsense knowledge not immediately available in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Aman Chadha , Vinija Jain

In this study, we address causal inference when only observational data and a valid causal ordering from the causal graph are available. We introduce a set of flow models that can recover component-wise, invertible transformation of…

Machine Learning · Computer Science 2024-12-16 Minh Khoa Le , Kien Do , Truyen Tran

We describe basic ideas underlying research to build and understand artificially intelligent systems: from symbolic approaches via statistical learning to interventional models relying on concepts of causality. Some of the hard open…

Artificial Intelligence · Computer Science 2022-04-04 Bernhard Schölkopf , Julius von Kügelgen

Causal effect estimation under networked interference is an important but challenging problem. Available parametric methods are limited in their model space, while previous semiparametric methods, e.g., leveraging neural networks to fit…

Machine Learning · Computer Science 2025-02-27 Weilin Chen , Ruichu Cai , Zeqin Yang , Jie Qiao , Yuguang Yan , Zijian Li , Zhifeng Hao

Learning causal representations from observational and interventional data in the absence of known ground-truth graph structures necessitates implicit latent causal representation learning. Implicit learning of causal mechanisms typically…

Machine Learning · Computer Science 2024-08-19 Shayan Shirahmad Gale Bagi , Zahra Gharaee , Oliver Schulte , Mark Crowley

We study causal representation learning, the task of inferring latent causal variables and their causal relations from high-dimensional mixtures of the variables. Prior work relies on weak supervision, in the form of counterfactual pre- and…

The task of inferring high-level causal variables from low-level observations, commonly referred to as causal representation learning, is fundamentally underconstrained. As such, recent works to address this problem focus on various…

Machine Learning · Statistics 2024-03-26 Simon Bing , Urmi Ninad , Jonas Wahl , Jakob Runge

Causal inference has gained much popularity in recent years, with interests ranging from academic, to industrial, to educational, and all in between. Concurrently, the study and usage of neural networks has also grown profoundly (albeit at…

Machine Learning · Statistics 2024-05-07 Demetrios Papakostas , Andrew Herren , P. Richard Hahn , Francisco Castillo

Data-driven societal event forecasting methods exploit relevant historical information to predict future events. These methods rely on historical labeled data and cannot accurately predict events when data are limited or of poor quality.…

Machine Learning · Computer Science 2021-12-13 Songgaojun Deng , Huzefa Rangwala , Yue Ning

Causal inference is capable of estimating the treatment effect (i.e., the causal effect of treatment on the outcome) to benefit the decision making in various domains. One fundamental challenge in this research is that the treatment…

Machine Learning · Computer Science 2021-12-28 Qian Li , Zhichao Wang , Shaowu Liu , Gang Li , Guandong Xu

We provide a new flexible framework for inference with the instrumental variable model. Rather than using linear specifications, functions characterizing the effects of instruments and other explanatory variables are estimated using machine…

Machine Learning · Statistics 2021-02-03 Robert E. McCulloch , Rodney A. Sparapani , Brent R. Logan , Purushottam W. Laud

Consider learning an imitation policy on the basis of demonstrated behavior from multiple environments, with an eye towards deployment in an unseen environment. Since the observable features from each setting may be different, directly…

Machine Learning · Statistics 2023-11-06 Ioana Bica , Daniel Jarrett , Mihaela van der Schaar

Causal knowledge is vital for effective reasoning in science, as causal relations, unlike correlations, allow one to reason about the outcomes of interventions. Algorithms that can discover causal relations from observational data are based…

Machine Learning · Statistics 2019-11-12 Anish Dhir , Ciarán M. Lee