中文
相关论文

相关论文: IL-SOAR : Imitation Learning with Soft Optimistic …

200 篇论文

Humans often acquire new skills through observation and imitation. For robotic agents, learning from the plethora of unlabeled video demonstration data available on the Internet necessitates imitating the expert without access to its…

机器人学 · 计算机科学 2024-02-08 Yuyang Liu , Weijun Dong , Yingdong Hu , Chuan Wen , Zhao-Heng Yin , Chongjie Zhang , Yang Gao

The Predictive Information is the mutual information between the past and the future, I(X_past; X_future). We hypothesize that capturing the predictive information is useful in RL, since the ability to model what will happen next is…

机器学习 · 计算机科学 2020-10-27 Kuang-Huei Lee , Ian Fischer , Anthony Liu , Yijie Guo , Honglak Lee , John Canny , Sergio Guadarrama

Lack of large, well-annotated emotional speech corpora continues to limit the performance and robustness of speech emotion recognition (SER), particularly as models grow more complex and the demand for multimodal systems increases. While…

声音 · 计算机科学 2026-02-13 Chung-Soo Ahn , Rajib Rana , Sunil Sivadas , Carlos Busso , Jagath C. Rajapakse

We introduce a new approach for speech pre-training named SPIRAL which works by learning denoising representation of perturbed data in a teacher-student framework. Specifically, given a speech utterance, we first feed the utterance to a…

音频与语音处理 · 电气工程与系统科学 2022-03-08 Wenyong Huang , Zhenhe Zhang , Yu Ting Yeung , Xin Jiang , Qun Liu

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

机器学习 · 计算机科学 2021-11-24 Lihua Zhang

Imitation learning is a primary approach to improve the efficiency of reinforcement learning by exploiting the expert demonstrations. However, in many real scenarios, obtaining expert demonstrations could be extremely expensive or even…

机器学习 · 计算机科学 2023-07-25 Kun-Peng Ning , Hu Xu , Kun Zhu , Sheng-Jun Huang

Hidden confounders that influence both states and actions can bias policy learning in reinforcement learning (RL), leading to suboptimal or non-generalizable behavior. Most RL algorithms ignore this issue, learning policies from…

机器学习 · 计算机科学 2025-06-09 Thanh Vinh Vo , Young Lee , Haozhe Ma , Chien Lu , Tze-Yun Leong

Imitation learning from demonstrations usually suffers from the confounding effects of unmeasured variables (i.e., unmeasured confounders) on the states and actions. If ignoring them, a biased estimation of the policy would be entailed. To…

机器学习 · 计算机科学 2025-07-24 Yan Zeng , Shenglan Nie , Feng Xie , Libo Huang , Peng Wu , Zhi Geng

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

机器人学 · 计算机科学 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

Imitation Learning (IL) is an effective learning paradigm exploiting the interactions between agents and environments. It does not require explicit reward signals and instead tries to recover desired policies using expert demonstrations. In…

机器学习 · 计算机科学 2021-12-14 Yang Liu , Yongzhe Chang , Shilei Jiang , Xueqian Wang , Bin Liang , Bo Yuan

Reusing previously trained models is critical in deep reinforcement learning to speed up training of new agents. However, it is unclear how to acquire new skills when objectives and constraints are in conflict with previously learned…

机器学习 · 计算机科学 2022-02-09 Jaime S. Ide , Daria Mićović , Michael J. Guarino , Kevin Alcedo , David Rosenbluth , Adrian P. Pope

This work presents a comprehensive analysis to regularize the Soft Actor-Critic (SAC) algorithm with automatic temperature adjustment. The the policy evaluation, the policy improvement and the temperature adjustment are reformulated,…

机器学习 · 计算机科学 2023-05-24 Ben You

ATARI is a suite of video games used by reinforcement learning (RL) researchers to test the effectiveness of the learning algorithm. Receiving only the raw pixels and the game score, the agent learns to develop sophisticated strategies,…

机器学习 · 计算机科学 2024-07-17 Le Zhang , Yong Gu , Xin Zhao , Yanshuo Zhang , Shu Zhao , Yifei Jin , Xinxin Wu

Machine learning (ML)-based planners have recently gained significant attention. They offer advantages over traditional optimization-based planning algorithms. These advantages include fewer manually selected parameters and faster…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Hui Zhou , Shaoshuai Shi , Hongsheng Li

Imitation learning is the process by which one agent tries to learn how to perform a certain task using information generated by another, often more-expert agent performing that same task. Conventionally, the imitator has access to both…

机器人学 · 计算机科学 2019-06-20 Faraz Torabi , Garrett Warnell , Peter Stone

Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In…

机器学习 · 计算机科学 2024-02-12 Nikunj Gupta , Somjit Nath , Samira Ebrahimi Kahou

Peer prediction mechanisms incentivize agents to truthfully report their signals even in the absence of verification by comparing agents' reports with those of their peers. In the detail-free multi-task setting, agents respond to multiple…

计算机科学与博弈论 · 计算机科学 2021-08-27 Grant Schoenebeck , Fang-Yi Yu

Topic modelling is fundamentally a soft clustering problem (of known objects -- documents, over unknown clusters -- topics). That is, the task is incorrectly posed. In particular, the topic models are unstable and incomplete. All this leads…

计算与语言 · 计算机科学 2024-09-27 Alex Gorbulev , Vasiliy Alekseev , Konstantin Vorontsov

Actor-Critic models are a class of model-free deep reinforcement learning (RL) algorithms that have demonstrated effectiveness across various robot learning tasks. While considerable research has focused on improving training stability and…

机器人学 · 计算机科学 2025-10-01 Hanlan Yang , Itamar Mishani , Luca Pivetti , Zachary Kingston , Maxim Likhachev

Imitation learning advances robot capabilities by enabling the acquisition of diverse behaviors from human demonstrations. However, large-scale datasets used for policy training often introduce substantial variability in quality, which can…

机器人学 · 计算机科学 2025-09-10 Yu Zhang , Yuqi Xie , Huihan Liu , Rutav Shah , Michael Wan , Linxi Fan , Yuke Zhu