English
Related papers

Related papers: Continual learning and refinement of causal models…

200 papers

Most of the works on planning and learning, e.g., planning by (model based) reinforcement learning, are based on two main assumptions: (i) the set of states of the planning domain is fixed; (ii) the mapping between the observations from the…

Artificial Intelligence · Computer Science 2018-11-27 Luciano Serafini , Paolo Traverso

The effectiveness of model training heavily relies on the quality of available training resources. However, budget constraints often impose limitations on data collection efforts. To tackle this challenge, we introduce causal exploration in…

Machine Learning · Computer Science 2024-07-31 Yupei Yang , Biwei Huang , Shikui Tu , Lei Xu

Recently, model-based agents have achieved better performance than model-free ones using the same computational budget and training time in single-agent environments. However, due to the complexity of multi-agent systems, it is tough to…

Multiagent Systems · Computer Science 2022-12-08 Zhiwei Xu , Dapeng Li , Bin Zhang , Yuan Zhan , Yunpeng Bai , Guoliang Fan

A generative recurrent neural network is quickly trained in an unsupervised manner to model popular reinforcement learning environments through compressed spatio-temporal representations. The world model's extracted features are fed into…

Machine Learning · Computer Science 2018-09-07 David Ha , Jürgen Schmidhuber

State abstraction is an effective technique for planning in robotics environments with continuous states and actions, long task horizons, and sparse feedback. In object-oriented environments, predicates are a particularly useful form of…

Robotics · Computer Science 2023-06-21 Amber Li , Tom Silver

For a given causal question, it is important to efficiently decide which causal inference method to use for a given dataset. This is challenging because causal methods typically rely on complex and difficult-to-verify assumptions, and…

Machine Learning · Computer Science 2023-11-09 Shantanu Gupta , Cheng Zhang , Agrin Hilmkil

Efficient planning in continuous state and action spaces is fundamentally hard, even when the transition model is deterministic and known. One way to alleviate this challenge is to perform bilevel planning with abstractions, where a…

Artificial Intelligence · Computer Science 2025-05-28 Tom Silver , Rohan Chitnis , Nishanth Kumar , Willie McClinton , Tomas Lozano-Perez , Leslie Pack Kaelbling , Joshua Tenenbaum

In complex inferential tasks like question answering, machine learning models must confront two challenges: the need to implement a compositional reasoning process, and, in many applications, the need for this reasoning process to be…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Ronghang Hu , Jacob Andreas , Trevor Darrell , Kate Saenko

Visual representation learning is ubiquitous in various real-world applications, including visual comprehension, video understanding, multi-modal analysis, human-computer interaction, and urban computing. Due to the emergence of huge…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Yang Liu , Yushen Wei , Hong Yan , Guanbin Li , Liang Lin

One of the several obstacles in the widespread use of AI systems is the lack of requirements of interpretability that can enable a layperson to ensure the safe and reliable behavior of such systems. We extend the analysis of an agent…

Artificial Intelligence · Computer Science 2021-08-24 Pulkit Verma , Siddharth Srivastava

Recent years have seen a surge of interest in learning high-level causal representations from low-level image pairs under interventions. Yet, existing efforts are largely limited to simple synthetic settings that are far away from…

Machine Learning · Computer Science 2023-04-04 Yuejiang Liu , Alexandre Alahi , Chris Russell , Max Horn , Dominik Zietlow , Bernhard Schölkopf , Francesco Locatello

World models enable agents to anticipate the effects of their actions by internalizing environment dynamics. In enterprise systems, however, these dynamics are often defined by tenant-specific business logic that varies across deployments…

Situationally-aware artificial agents operating with competence in natural environments face several challenges: spatial awareness, object affordance detection, dynamic changes and unpredictability. A critical challenge is the agent's…

Robotics · Computer Science 2025-07-29 Mihai Pomarlan , Stefano De Giorgis , Rachel Ringe , Maria M. Hedblom , Nikolaos Tsiogkas

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

The interpretation of spatial references is highly contextual, requiring joint inference over both language and the environment. We consider the task of spatial reasoning in a simulated environment, where an agent can act and receive…

Computation and Language · Computer Science 2017-11-15 Michael Janner , Karthik Narasimhan , Regina Barzilay

The rapid evolution of artificial intelligence has led to expectations of transformative impact on science, yet current systems remain fundamentally limited in enabling genuine scientific discovery. This perspective contends that progress…

Artificial Intelligence · Computer Science 2025-12-16 Karthik Duraisamy

As a key component to intuitive cognition and reasoning solutions in human intelligence, causal knowledge provides great potential for reinforcement learning (RL) agents' interpretability towards decision-making by helping reduce the…

Machine Learning · Computer Science 2025-04-25 Ruichu Cai , Siyang Huang , Jie Qiao , Wei Chen , Yan Zeng , Keli Zhang , Fuchun Sun , Yang Yu , Zhifeng Hao

To what extent can a neural network systematically reason over symbolic facts? Evidence suggests that large pre-trained language models (LMs) acquire some reasoning capacity, but this ability is difficult to control. Recently, it has been…

Computation and Language · Computer Science 2020-11-17 Alon Talmor , Oyvind Tafjord , Peter Clark , Yoav Goldberg , Jonathan Berant

To build intelligent machine learning systems, there are two broad approaches. One approach is to build inherently interpretable models, as endeavored by the growing field of causal representation learning. The other approach is to build…

Machine Learning · Computer Science 2024-12-10 Goutham Rajendran , Simon Buchholz , Bryon Aragam , Bernhard Schölkopf , Pradeep Ravikumar

Modern deep learning models excel at pattern recognition but remain fundamentally limited by their reliance on spurious correlations, leading to poor generalization and a demand for massive datasets. We argue that a key ingredient for…

Machine Learning · Computer Science 2025-09-17 Mohamed Zayaan S