English
Related papers

Related papers: CausalWorld: A Robotic Manipulation Benchmark for …

200 papers

Learning causal relationships from time series data is an important but challenging problem. Existing synthetic datasets often contain hidden artifacts that can be exploited by causal discovery methods, reducing their usefulness for…

Machine Learning · Computer Science 2026-03-23 Xiaoyu He , Petr Ryšavý , Jakub Mareček

We present a novel task that measures how people generalize objects' causal powers based on observing a single (Experiment 1) or a few (Experiment 2) causal interactions between object pairs. We propose a computational modeling framework…

Artificial Intelligence · Computer Science 2021-11-25 Bonan Zhao , Christopher G. Lucas , Neil R. Bramley

Causal Machine Learning (CausalML) is an umbrella term for machine learning methods that formalize the data-generation process as a structural causal model (SCM). This perspective enables us to reason about the effects of changes to this…

Machine Learning · Computer Science 2026-05-28 Jean Kaddour , Aengus Lynch , Qi Liu , Matt J. Kusner , Ricardo Silva

One of the grand challenges of reinforcement learning is the ability to generalize to new tasks. However, general agents require a set of rich, diverse tasks to train on. Designing a `foundation environment' for such tasks is tricky -- the…

Artificial Intelligence · Computer Science 2023-10-17 Kevin Frans , Phillip Isola

Today's robots attempt to learn new tasks by imitating human examples. These robots watch the human complete the task, and then try to match the actions taken by the human expert. However, this standard approach to visual imitation learning…

Reinforcement learning (RL) has demonstrated remarkable potential in robotic manipulation but faces challenges in sample inefficiency and lack of interpretability, limiting its applicability in real world scenarios. Enabling the agent to…

Robotics · Computer Science 2025-05-16 Xinrui Wang , Yan Jin

We present BulletArm, a novel benchmark and learning-environment for robotic manipulation. BulletArm is designed around two key principles: reproducibility and extensibility. We aim to encourage more direct comparisons between robotic…

Robotics · Computer Science 2022-10-19 Dian Wang , Colin Kohler , Xupeng Zhu , Mingxi Jia , Robert Platt

Designing effective task sequences is crucial for curriculum reinforcement learning (CRL), where agents must gradually acquire skills by training on intermediate tasks. A key challenge in CRL is to identify tasks that promote exploration,…

Machine Learning · Computer Science 2025-07-08 Geonwoo Cho , Jaegyun Im , Doyoon Kim , Sundong Kim

Causality has the potential to truly transform the way we solve a large number of real-world problems. Yet, so far, its potential largely remains to be unlocked as causality often requires crucial assumptions which cannot be tested in…

Machine Learning · Computer Science 2024-02-15 Jeroen Berrevoets , Krzysztof Kacprzyk , Zhaozhi Qian , Mihaela van der Schaar

Reinforcement learning (RL) is used in various robotic applications. RL enables agents to learn tasks autonomously by interacting with the environment. The more critical the tasks are, the higher the demand for the robustness of the RL…

Machine Learning · Computer Science 2023-06-06 Tom He , Jasmina Gajcin , Ivana Dusparic

Learning accurate models of the physical world is required for a lot of robotic manipulation tasks. However, during manipulation, robots are expected to interact with unknown workpieces so that building predictive models which can…

Machine Learning · Computer Science 2020-11-03 Wenyu Zhang , Skyler Seto , Devesh K. Jha

General intelligence requires quick adaption across tasks. While existing reinforcement learning (RL) methods have made progress in generalization, they typically assume only distribution changes between source and target domains. In this…

Machine Learning · Computer Science 2025-03-07 Yupei Yang , Biwei Huang , Fan Feng , Xinyue Wang , Shikui Tu , Lei Xu

Large language model (LLM) agents-especially smaller, open-source models-often produce causally invalid or incoherent actions in collaborative tasks due to their reliance on surface-level correlations rather than grounded causal reasoning.…

Artificial Intelligence · Computer Science 2025-08-20 Minh Hoang Nguyen , Van Dai Do , Dung Nguyen , Thin Nguyen , Hung Le

We propose a causal reasoning framework for creative robot tool use where a suitable tool for a task is correctly identified for use beyond its primary objectives. The proposed framework first discovers the causal relationships between the…

Causal structure learning refers to a process of identifying causal structures from observational data, and it can have multiple applications in biomedicine and health care. This paper provides a practical review and tutorial on scalable…

Machine Learning · Computer Science 2023-01-20 Pulakesh Upadhyaya , Kai Zhang , Can Li , Xiaoqian Jiang , Yejin Kim

World models have been developed to support sample-efficient deep reinforcement learning agents. However, it remains challenging for world models to accurately replicate environments that are high-dimensional, non-stationary, and composed…

Machine Learning · Computer Science 2026-03-31 Yosuke Nishimoto , Takashi Matsubara

In the sequential decision making setting, an agent aims to achieve systematic generalization over a large, possibly infinite, set of environments. Such environments are modeled as discrete Markov decision processes with both states and…

Machine Learning · Computer Science 2023-03-31 Mirco Mutti , Riccardo De Santi , Emanuele Rossi , Juan Felipe Calderon , Michael Bronstein , Marcello Restelli

Developing the next generation of household robot helpers requires combining locomotion and interaction capabilities, which is generally referred to as mobile manipulation (MoMa). MoMa tasks are difficult due to the large action space of…

Robotics · Computer Science 2023-09-29 Jiaheng Hu , Peter Stone , Roberto Martín-Martín

A major challenge in research involving artificial intelligence (AI) is the development of algorithms that can find solutions to problems that can generalize to different environments and tasks. Unlike AI, humans are adept at finding…

Artificial Intelligence · Computer Science 2021-10-12 Semir Tatlidil , Yanqi Liu , Emily Sheetz , R. Iris Bahar , Steven Sloman

Despite impressive successes, deep reinforcement learning (RL) systems still fall short of human performance on generalization to new tasks and environments that differ from their training. As a benchmark tailored for studying RL…