English
Related papers

Related papers: Unifying Causal Inference and Reinforcement Learni…

200 papers

In-context learning for tabular data sets strong predictive standards in observational settings; it however primarily relies on correlational structure, which becomes unreliable under distribution shift or intervention. While established…

Machine Learning · Computer Science 2026-05-22 Sascha Xu , Sarah Mameche , Jilles Vreeken

Inferring causal structure poses a combinatorial search problem that typically involves evaluating structures with a score or independence test. The resulting search is costly, and designing suitable scores or tests that capture prior…

Machine Learning · Computer Science 2022-12-16 Lars Lorch , Scott Sussex , Jonas Rothfuss , Andreas Krause , Bernhard Schölkopf

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

Efficiently navigating complex environments requires agents to internalize the underlying logic of their world, yet standard world modelling methods often struggle with sample inefficiency, lack of transparency, and poor scalability. We…

Artificial Intelligence · Computer Science 2026-02-20 Enrique Crespo-Fernandez , Oliver Ray , Telmo de Menezes e Silva Filho , Peter Flach

We consider multi-class classification where the predictor has a hierarchical structure that allows for a very large number of labels both at train and test time. The predictive power of such models can heavily depend on the structure of…

Machine Learning · Statistics 2017-03-06 Yacine Jernite , Anna Choromanska , David Sontag

Performance predictors have emerged as a promising method to accelerate the evaluation stage of neural architecture search (NAS). These predictors estimate the performance of unseen architectures by learning from the correlation between a…

Machine Learning · Computer Science 2025-06-05 Han Ji , Yuqi Feng , Jiahao Fan , Yanan Sun

Fascinating and puzzling phenomena, such as landmark vector cells, splitter cells, and event-specific representations to name a few, are regularly discovered in the hippocampus. Without a unifying principle that can explain these divergent…

Neurons and Cognition · Quantitative Biology 2022-12-06 Rajkumar Vasudeva Raju , J. Swaroop Guntupalli , Guangyao Zhou , Miguel Lázaro-Gredilla , Dileep George

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization.…

Machine Learning · Computer Science 2020-06-16 Khurram Javed , Martha White , Yoshua Bengio

We focus on causal discovery in the presence of measurement error in linear systems where the mixing matrix, i.e., the matrix indicating the independent exogenous noise terms pertaining to the observed variables, is identified up to…

Machine Learning · Computer Science 2022-11-09 Yuqin Yang , AmirEmad Ghassami , Mohamed Nafea , Negar Kiyavash , Kun Zhang , Ilya Shpitser

Despite recent progress in reinforcement learning (RL), RL algorithms for exploration still remain an active area of research. Existing methods often focus on state-based metrics, which do not consider the underlying causal structures of…

In this paper we present a comprehensive view of prominent causal discovery algorithms, categorized into two main categories (1) assuming acyclic and no latent variables, and (2) allowing both cycles and latent variables, along with…

Artificial Intelligence · Computer Science 2017-09-13 Karamjit Singh , Garima Gupta , Vartika Tewari , Gautam Shroff

Why do reinforcement learning (RL) policies fail or succeed? This is a challenging question due to the complex, high-dimensional nature of agent-environment interactions. In this work, we take a causal perspective on explaining the behavior…

Machine Learning · Statistics 2025-07-22 Armin Kekić , Jan Schneider , Dieter Büchler , Bernhard Schölkopf , Michel Besserve

The design of materials structure for optimizing functional properties and potentially, the discovery of novel behaviors is a keystone problem in materials science. In many cases microstructural models underpinning materials functionality…

Materials Science · Physics 2022-02-23 Rama K. Vasudevan , Erick Orozco , Sergei V. Kalinin

As a key component to intuitive cognition and reasoning solutions in human intelligence, causal knowledge provides great potential for reinforcement learning (RL) agents' interpretability towards decision-making by helping reduce the…

Machine Learning · Computer Science 2025-04-25 Ruichu Cai , Siyang Huang , Jie Qiao , Wei Chen , Yan Zeng , Keli Zhang , Fuchun Sun , Yang Yu , Zhifeng Hao

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

Machine Learning · Computer Science 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

One of the main obstacles for developing flexible AI systems is the split between data-based learners and model-based solvers. Solvers such as classical planners are very flexible and can deal with a variety of problem instances and goals…

Artificial Intelligence · Computer Science 2020-02-21 Blai Bonet , Hector Geffner

Discovering causal structure among a set of variables is a fundamental problem in many empirical sciences. Traditional score-based casual discovery methods rely on various local heuristics to search for a Directed Acyclic Graph (DAG)…

Machine Learning · Computer Science 2020-06-09 Shengyu Zhu , Ignavier Ng , Zhitang Chen

Most causal discovery algorithms find causal structure among a set of observed variables. Learning the causal structure among latent variables remains an important open problem, particularly when using high-dimensional data. In this paper,…

Machine Learning · Computer Science 2020-09-09 Jonathan D. Young , Bryan Andrews , Gregory F. Cooper , Xinghua Lu

Learning high-level causal representations together with a causal model from unstructured low-level data such as pixels is impossible from observational data alone. We prove under mild assumptions that this representation is however…

Machine Learning · Statistics 2022-10-12 Johann Brehmer , Pim de Haan , Phillip Lippe , Taco Cohen