English
Related papers

Related papers: Initial State Interventions for Deconfounded Imita…

200 papers

Imitation learning methods seek to learn from an expert either through behavioral cloning (BC) of the policy or inverse reinforcement learning (IRL) of the reward. Such methods enable agents to learn complex tasks from humans that are…

Machine Learning · Computer Science 2023-12-07 Joe Watson , Sandy H. Huang , Nicolas Heess

We aim to develop a fundamental understanding of modality collapse, a recently observed empirical phenomenon wherein models trained for multimodal fusion tend to rely only on a subset of the modalities, ignoring the rest. We show that…

Machine Learning · Computer Science 2025-08-18 Abhra Chaudhuri , Anjan Dutta , Tu Bui , Serban Georgescu

Machine unlearning requires removing the information of forgetting data while keeping the necessary information of remaining data. Despite recent advancements in this area, existing methodologies mainly focus on the effect of removing…

Machine Learning · Computer Science 2024-02-01 Shaofei Shen , Chenhao Zhang , Alina Bialkowski , Weitong Chen , Miao Xu

Learning efficiently a causal model of the environment is a key challenge of model-based RL agents operating in POMDPs. We consider here a scenario where the learning agent has the ability to collect online experiences through direct…

Machine Learning · Computer Science 2021-06-29 Maxime Gasse , Damien Grasset , Guillaume Gaudron , Pierre-Yves Oudeyer

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

Machine Learning · Computer Science 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

Consider an imitation learning problem that the imitator and the expert have different dynamics models. Most of the current imitation learning methods fail because they focus on imitating actions. We propose a novel state alignment-based…

Machine Learning · Computer Science 2019-11-26 Fangchen Liu , Zhan Ling , Tongzhou Mu , Hao Su

We study the problem of deriving policies, or rules, that when enacted on a complex system, cause a desired outcome. Absent the ability to perform controlled experiments, such rules have to be inferred from past observations of the system's…

Machine Learning · Computer Science 2020-09-09 Kailash Budhathoki , Mario Boley , Jilles Vreeken

Learning causal representations from observational and interventional data in the absence of known ground-truth graph structures necessitates implicit latent causal representation learning. Implicit learning of causal mechanisms typically…

Machine Learning · Computer Science 2024-08-19 Shayan Shirahmad Gale Bagi , Zahra Gharaee , Oliver Schulte , Mark Crowley

Given a large number of unlabeled face images, face grouping aims at clustering the images into individual identities present in the data. This task remains a challenging problem despite the remarkable capability of deep learning approaches…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Yue He , Kaidi Cao , Cheng Li , Chen Change Loy

Although achieving promising performance, recent analyses show that current generative large language models (LLMs) may still capture dataset biases and utilize them for generation, leading to poor generalizability and harmfulness of LLMs.…

Computation and Language · Computer Science 2024-09-02 Li Du , Zhouhao Sun , Xiao Ding , Yixuan Ma , Yang Zhao , Kaitao Qiu , Ting Liu , Bing Qin

Imitation learning enables agents to reuse and adapt the hard-won expertise of others, offering a solution to several key challenges in learning behavior. Although it is easy to observe behavior in the real-world, the underlying actions may…

Machine Learning · Computer Science 2021-07-09 Andrew Jaegle , Yury Sulsky , Arun Ahuja , Jake Bruce , Rob Fergus , Greg Wayne

We study offline imitation learning (IL) when part of the decision-relevant state is observed only through noisy measurements and the distribution may change between training and deployment. Such settings induce spurious state-action…

Machine Learning · Computer Science 2026-02-02 Shi Bo , AmirEmad Ghassami

Behavioral cloning, or more broadly, learning from demonstrations (LfD) is a priomising direction for robot policy learning in complex scenarios. Albeit being straightforward to implement and data-efficient, behavioral cloning has its own…

Robotics · Computer Science 2024-05-27 Carl Qi , Edward Sun , Harry Zhang

A common strategy in modern learning systems is to learn a representation that is useful for many tasks, a.k.a. representation learning. We study this strategy in the imitation learning setting for Markov decision processes (MDPs) where…

Machine Learning · Computer Science 2020-02-26 Sanjeev Arora , Simon S. Du , Sham Kakade , Yuping Luo , Nikunj Saunshi

Today's robots attempt to learn new tasks by imitating human examples. These robots watch the human complete the task, and then try to match the actions taken by the human expert. However, this standard approach to visual imitation learning…

The ability to learn and act in novel situations is still a prerogative of animate intelligence, as current machine learning methods mostly fail when moving beyond the standard i.i.d. setting. What is the reason for this discrepancy? Most…

Machine Learning · Computer Science 2018-12-04 Niki Kilbertus , Giambattista Parascandolo , Bernhard Schölkopf

Robots should be able to learn complex behaviors from human demonstrations. In practice, these human-provided datasets are inevitably imbalanced: i.e., the human demonstrates some subtasks more frequently than others. State-of-the-art…

Robotics · Computer Science 2026-01-06 Sagar Parekh , Heramb Nemlekar , Dylan P. Losey

Most algorithms in classical and contemporary machine learning focus on correlation-based dependence between features to drive performance. Although success has been observed in many relevant problems, these algorithms fail when the…

Machine Learning · Computer Science 2021-10-26 Moritz Willig , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

Unobserved confounding arises when an unmeasured feature influences both the treatment and the outcome, leading to biased causal effect estimates. This issue undermines observational studies in fields like economics, medicine, ecology or…

Machine Learning · Computer Science 2025-09-09 Alexander Merkov , David Rohde , Alexandre Gilotte , Benjamin Heymann

Confounding seriously impairs our ability to learn about causal relations from observational data. Confounding can be defined as a statistical association between two variables due to inputs from a common source (the confounder). For…

Methodology · Statistics 2018-05-17 Anders Ledberg
‹ Prev 1 4 5 6 7 8 10 Next ›