中文
相关论文

相关论文: Fighting Copycat Agents in Behavioral Cloning from…

200 篇论文

We consider the problem of imitation learning from a finite set of expert trajectories, without access to reinforcement signals. The classical approach of extracting the expert's reward function via inverse reinforcement learning, followed…

机器学习 · 计算机科学 2019-06-10 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

We examine the problem of transferring a policy learned in a source environment to a target environment with different dynamics, particularly in the case where it is critical to reduce the amount of interaction with the target environment…

人工智能 · 计算机科学 2021-01-26 Siddharth Desai , Ishan Durugkar , Haresh Karnan , Garrett Warnell , Josiah Hanna , Peter Stone

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

机器学习 · 计算机科学 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Training agents in multi-agent competitive games presents significant challenges due to their intricate nature. These challenges are exacerbated by dynamics influenced not only by the environment but also by opponents' strategies. Existing…

机器学习 · 计算机科学 2023-08-22 The Viet Bui , Tien Mai , Thanh Hong Nguyen

Imitation is a key component of human social behavior, and is widely used by both children and adults as a way to navigate uncertain or unfamiliar situations. But in an environment populated by multiple heterogeneous agents pursuing…

神经元与认知 · 定量生物学 2023-05-15 Max Taylor-Davies , Stephanie Droop , Christopher G. Lucas

Imitation learning offers a promising path for robots to learn general-purpose behaviors, but traditionally has exhibited limited scalability due to high data supervision requirements and brittle generalization. Inspired by recent advances…

机器学习 · 计算机科学 2022-11-16 Soroush Nasiriany , Tian Gao , Ajay Mandlekar , Yuke Zhu

We compare how well agents aggregate information in two repeated social learning environments. In the first setting agents have access to a public data set. In the second they have access to the same data, and also to the past actions of…

理论经济学 · 经济学 2026-05-20 Marina Agranov , Gabriel Lopez-Moctezuma , Philipp Strack , Omer Tamuz

Behavioral cloning has proven to be effective for learning sequential decision-making policies from expert demonstrations. However, behavioral cloning often suffers from the causal confusion problem where a policy relies on the noticeable…

机器学习 · 计算机科学 2021-10-28 Jongjin Park , Younggyo Seo , Chang Liu , Li Zhao , Tao Qin , Jinwoo Shin , Tie-Yan Liu

Recent research on vulnerabilities of deep reinforcement learning (RL) has shown that adversarial policies adopted by an adversary agent can influence a target RL agent (victim agent) to perform poorly in a multi-agent environment. In…

机器学习 · 计算机科学 2022-11-01 The Viet Bui , Tien Mai , Thanh H. Nguyen

Imitation learning enables agents to reuse and adapt the hard-won expertise of others, offering a solution to several key challenges in learning behavior. Although it is easy to observe behavior in the real-world, the underlying actions may…

机器学习 · 计算机科学 2021-07-09 Andrew Jaegle , Yury Sulsky , Arun Ahuja , Jake Bruce , Rob Fergus , Greg Wayne

Imitation learning, in which learning is performed by demonstration, has been studied and advanced for sequential decision-making tasks in which a reward function is not predefined. However, imitation learning methods still require numerous…

机器学习 · 计算机科学 2024-01-24 Dahuin Jung , Hyungyu Lee , Sungroh Yoon

We consider the problem of imitation learning under misspecification: settings where the learner is fundamentally unable to replicate expert behavior everywhere. This is often true in practice due to differences in observation space and…

机器学习 · 计算机科学 2025-04-03 Nicolas Espinosa-Dice , Sanjiban Choudhury , Wen Sun , Gokul Swamy

In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator. Recent methods…

机器学习 · 计算机科学 2021-04-02 Faraz Torabi , Garrett Warnell , Peter Stone

In many situations, communication between agents is a critical component of cooperative multi-agent systems, however, it can be difficult to learn or evolve. In this paper, we investigate a simple way in which the emergence of communication…

多智能体系统 · 计算机科学 2024-05-28 Dylan Cope , Peter McBurney

Imitation Learning is a sequential task where the learner tries to mimic an expert's action in order to achieve the best performance. Several algorithms have been proposed recently for this task. In this project, we aim at proposing a wide…

机器学习 · 统计学 2018-01-22 Alexandre Attia , Sharone Dayan

Recent Offline Reinforcement Learning methods have succeeded in learning high-performance policies from fixed datasets of experience. A particularly effective approach learns to first identify and then mimic optimal decision-making…

机器学习 · 计算机科学 2023-12-12 Jake Grigsby , Yanjun Qi

Imitation learning methods are used to infer a policy in a Markov decision process from a dataset of expert demonstrations by minimizing a divergence measure between the empirical state occupancy measures of the expert and the policy. The…

机器学习 · 计算机科学 2023-08-21 Ivan Ovinnikov , Joachim M. Buhmann

This paper presents a novel approach to imitation learning from observations, where an autoregressive mixture of experts model is deployed to fit the underlying policy. The parameters of the model are learned via a two-stage framework. By…

机器学习 · 计算机科学 2024-11-14 Renzi Wang , Flavia Sofia Acerbo , Tong Duy Son , Panagiotis Patrinos

Many existing imitation learning datasets are collected from multiple demonstrators, each with different expertise at different parts of the environment. Yet, standard imitation learning algorithms typically treat all demonstrators as…

机器学习 · 计算机科学 2022-06-14 Mark Beliaev , Andy Shih , Stefano Ermon , Dorsa Sadigh , Ramtin Pedarsani

Collaborative machine learning and related techniques such as federated learning allow multiple participants, each with his own training dataset, to build a joint model by training locally and periodically exchanging model updates. We…

密码学与安全 · 计算机科学 2018-11-02 Luca Melis , Congzheng Song , Emiliano De Cristofaro , Vitaly Shmatikov