English
Related papers

Related papers: Structural Causal Bottleneck Models

200 papers

Existing Score-Based Models (SBMs) can be categorized into constrained SBMs (CSBMs) or unconstrained SBMs (USBMs) according to their parameterization approaches. CSBMs model probability density functions as Boltzmann distributions, and…

Machine Learning · Computer Science 2023-06-06 Chen-Hao Chao , Wei-Fang Sun , Bo-Wun Cheng , Chun-Yi Lee

We formulate a general framework for building structural causal models (SCMs) with deep learning components. The proposed approach employs normalising flows and variational inference to enable tractable inference of exogenous noise…

Machine Learning · Statistics 2020-10-26 Nick Pawlowski , Daniel C. Castro , Ben Glocker

Structural causal models (SCMs) are a powerful tool for understanding the complex causal relationships that underlie many real-world systems. As these systems grow in size, the number of variables and complexity of interactions between them…

Artificial Intelligence · Computer Science 2023-10-13 Moritz Willig , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

This paper provides a comprehensive review of deep structural causal models (DSCMs), particularly focusing on their ability to answer counterfactual queries using observational data within known causal structures. It delves into the…

Machine Learning · Statistics 2025-02-04 Audrey Poinsot , Alessandro Leite , Nicolas Chesneau , Michèle Sébag , Marc Schoenauer

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Causal inference from observational data following the restricted structural causal model (SCM) framework hinges largely on the asymmetry between cause and effect from the data generating mechanisms, such as non-Gaussianity or nonlinearity.…

Methodology · Statistics 2021-09-06 Kang Du , Yu Xiang

We introduce a new formulation of structural causal models for extremes, called the extremal structural causal model (eSCM). Unlike conventional structural causal models, where randomness is governed by a probability distribution, eSCMs use…

Statistics Theory · Mathematics 2026-05-27 Shuyang Bai , Fei Fang , Tiandong Wang

Concept Bottleneck Models (CBMs) aim for ante-hoc interpretability by learning a bottleneck layer that predicts interpretable concepts before the decision. State-of-the-art approaches typically select which concepts to learn via human…

Machine Learning · Computer Science 2026-03-10 Antonio De Santis , Schrasing Tong , Marco Brambilla , Lalana Kagal

Graphical models can represent a multivariate distribution in a convenient and accessible form as a graph. Causal models can be viewed as a special class of graphical models that not only represent the distribution of the observed system…

Methodology · Statistics 2017-06-29 Christina Heinze-Deml , Marloes H. Maathuis , Nicolai Meinshausen

Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a human-understandable concept layer. However, most previous studies focused on static scenarios where the data and…

Machine Learning · Computer Science 2026-01-05 Hongbin Lin , Chenyang Ren , Juangui Xu , Zhengyu Hu , Cheng-Long Wang , Yao Shu , Hui Xiong , Jingfeng Zhang , Di Wang , Lijie Hu

Recent advances in artificial intelligence reveal the limits of purely predictive systems and call for a shift toward causal and collaborative reasoning. Drawing inspiration from the revolution of Grothendieck in mathematics, we introduce…

Artificial Intelligence · Computer Science 2025-06-02 Gabriele D'Acunto , Claudio Battiloro

Concept bottleneck models (CBMs) are interpretable neural networks that first predict labels for human-interpretable concepts relevant to the prediction task, and then predict the final label based on the concept label predictions. We…

Machine Learning · Computer Science 2023-04-28 Kushal Chauhan , Rishabh Tiwari , Jan Freyberg , Pradeep Shenoy , Krishnamurthy Dvijotham

As a representative of public transportation, the fundamental issue of managing bike-sharing systems is bike flow prediction. Recent methods overemphasize the spatio-temporal correlations in the data, ignoring the effects of contextual…

Machine Learning · Computer Science 2023-01-20 Pan Deng , Yu Zhao , Junting Liu , Xiaofeng Jia , Mulan Wang

Causal inference from observational data following the restricted structural causal models (SCM) framework hinges largely on the asymmetry between cause and effect from the data generating mechanisms, such as non-Gaussianity or…

Machine Learning · Computer Science 2024-05-30 Kang Du , Yu Xiang

Structural causal models (SCMs) are widely used in various disciplines to represent causal relationships among variables in complex systems. Unfortunately, the underlying causal structure is often unknown, and estimating it from data…

Machine Learning · Computer Science 2024-01-17 Tianyu Chen , Kevin Bello , Bryon Aragam , Pradeep Ravikumar

Concept Bottleneck Models (CBMs) map the inputs onto a set of interpretable concepts (``the bottleneck'') and use the concepts to make predictions. A concept bottleneck enhances interpretability since it can be investigated to understand…

Machine Learning · Computer Science 2023-02-03 Mert Yuksekgonul , Maggie Wang , James Zou

Concept Bottleneck Models (CBMs) provide explicit interpretations for deep neural networks through concepts and allow intervention with concepts to adjust final predictions. Existing CBMs assume concepts are conditionally independent given…

Machine Learning · Computer Science 2026-05-04 Haotian Xu , Tsui-Wei Weng , Lam M. Nguyen , Tengfei Ma

Deep learning representations are often difficult to interpret, which can hinder their deployment in sensitive applications. Concept Bottleneck Models (CBMs) have emerged as a promising approach to mitigate this issue by learning…

Machine Learning · Computer Science 2026-01-30 Antonio Almudévar , José Miguel Hernández-Lobato , Alfonso Ortega

Causal structure learning refers to a process of identifying causal structures from observational data, and it can have multiple applications in biomedicine and health care. This paper provides a practical review and tutorial on scalable…

Machine Learning · Computer Science 2023-01-20 Pulakesh Upadhyaya , Kai Zhang , Can Li , Xiaoqian Jiang , Yejin Kim

Causal Structure Learning (CSL), also referred to as causal discovery, amounts to extracting causal relations among variables in data. CSL enables the estimation of causal effects from observational data alone, avoiding the need to perform…

Machine Learning · Computer Science 2025-02-12 Fabrizio Russo , Francesca Toni