中文
相关论文

相关论文: FRESH: Interactive Reward Shaping in High-Dimensio…

200 篇论文

We introduce an exploration bonus for deep reinforcement learning methods calculated using self-organising feature maps. Our method uses adaptive resonance theory (ART) providing online, unsupervised clustering to quantify the novelty of a…

机器学习 · 计算机科学 2023-02-09 Marius Lindegaard , Hjalmar Jacob Vinje , Odin Aleksander Severinsen

Vision-Language-Action (VLA) models have demonstrated significant potential in the field of embodied intelligence, enabling agents to follow human instructions to complete complex tasks in physical environments. Existing embodied agents are…

机器人学 · 计算机科学 2025-05-27 Junyang Shu , Zhiwei Lin , Yongtao Wang

Reinforcement learning (RL) has shown its strength in challenging sequential decision-making problems. The reward function in RL is crucial to the learning performance, as it serves as a measure of the task completion degree. In real-world…

机器学习 · 计算机科学 2024-02-13 Siyuan Li , Shijie Han , Yingnan Zhao , By Liang , Peng Liu

Batch offline data have been shown considerably beneficial for reinforcement learning. Their benefit is further amplified by upsampling with generative models. In this paper, we consider a novel opportunity where interaction with…

机器学习 · 计算机科学 2024-10-04 Shangzhe Li , Xinhua Zhang

This paper introduces a new method for inverse reinforcement learning in large-scale and high-dimensional state spaces. To avoid solving the computationally expensive reinforcement learning problems in reward learning, we propose a function…

机器学习 · 计算机科学 2017-08-15 Kun Li , Joel W. Burdick

Recent work in deep reinforcement learning has allowed algorithms to learn complex tasks such as Atari 2600 games just from the reward provided by the game, but these algorithms presently require millions of training steps in order to…

机器学习 · 计算机科学 2018-01-09 Benjamin Spector , Serge Belongie

In this work, we present a domain-independent approach for adaptive scaffolding in robotic explanation generation to guide tasks in human-robot interaction. We present a method for incorporating interdisciplinary research results into a…

人机交互 · 计算机科学 2025-10-28 André Groß , Birte Richter , Britta Wrede

Practising and honing skills forms a fundamental component of how humans learn, yet artificial agents are rarely specifically trained to perform them. Instead, they are usually trained end-to-end, with the hope being that useful skills will…

While using shaped rewards can be beneficial when solving sparse reward tasks, their successful application often requires careful engineering and is problem specific. For instance, in tasks where the agent must achieve some goal state,…

人工智能 · 计算机科学 2019-11-05 Alexander Trott , Stephan Zheng , Caiming Xiong , Richard Socher

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

机器人学 · 计算机科学 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

Imitation learning in a high-dimensional environment is challenging. Most inverse reinforcement learning (IRL) methods fail to outperform the demonstrator in such a high-dimensional environment, e.g., Atari domain. To address this…

机器学习 · 计算机科学 2020-09-14 Xingrui Yu , Yueming Lyu , Ivor W. Tsang

To perform robot manipulation tasks, a low-dimensional state of the environment typically needs to be estimated. However, designing a state estimator can sometimes be difficult, especially in environments with deformable objects. An…

机器人学 · 计算机科学 2019-07-16 Xingyu Lin , Harjatin Singh Baweja , David Held

Learning from feedback is an instrumental process for advancing the capabilities and safety of frontier models, yet its effectiveness is often constrained by cost and scalability. We present a pilot study that explores scaling reward models…

机器学习 · 计算机科学 2026-03-17 Jingxuan Fan , Yueying Li , Zhenting Qi , Dinghuai Zhang , Kianté Brantley , Sham M. Kakade , Hanlin Zhang

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

多智能体系统 · 计算机科学 2026-05-25 Elie Abboud , Oren Gal

Humans decompose novel complex tasks into simpler ones to exploit previously learned skills. Analogously, hierarchical reinforcement learning seeks to leverage lower-level policies for simple tasks to solve complex ones. However, because…

机器学习 · 计算机科学 2022-03-15 Ju-Seung Byun , Andrew Perrault

Online recommendation requires handling rapidly changing user preferences. Deep reinforcement learning (DRL) is gaining interest as an effective means of capturing users' dynamic interest during interactions with recommender systems.…

信息检索 · 计算机科学 2021-10-22 Xiaocong Chen , Lina Yao , Xianzhi Wang , Julian McAuley

Training agents using Reinforcement Learning in games with sparse rewards is a challenging problem, since large amounts of exploration are required to retrieve even the first reward. To tackle this problem, a common approach is to use…

机器学习 · 计算机科学 2020-10-09 Shengyi Huang , Santiago Ontañón

Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn…

人工智能 · 计算机科学 2023-10-11 Noah Shinn , Federico Cassano , Edward Berman , Ashwin Gopinath , Karthik Narasimhan , Shunyu Yao

Reinforcement Learning (RL) in various decision-making tasks of machine learning provides effective results with an agent learning from a stand-alone reward function. However, it presents unique challenges with large amounts of environment…

机器学习 · 计算机科学 2020-03-10 Neda Navidi

Providing reinforcement learning agents with informationally rich human knowledge can dramatically improve various aspects of learning. Prior work has developed different kinds of shaping methods that enable agents to learn efficiently in…

人机交互 · 计算机科学 2018-11-13 Chao Yu , Tianpei Yang , Wenxuan Zhu , Dongxu wang , Guangliang Li