English
Related papers

Related papers: Learning Reward for Robot Skills Using Large Langu…

200 papers

Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than…

Large Language Models (LLMs) are gaining popularity in the field of robotics. However, LLM-based robots are limited to simple, repetitive motions due to the poor integration between language models, robots, and the environment. This paper…

Meta-reinforcement learning (meta-RL) is a promising approach that enables the agent to learn new tasks quickly. However, most meta-RL algorithms show poor generalization in multi-task scenarios due to the insufficient task information…

Artificial Intelligence · Computer Science 2023-07-06 Xiangtong Yao , Zhenshan Bing , Genghang Zhuang , Kejia Chen , Hongkuan Zhou , Kai Huang , Alois Knoll

Reinforcement learning (RL) often encounters delayed and sparse feedback in real-world applications, even with only episodic rewards. Previous approaches have made some progress in reward redistribution for credit assignment but still face…

Machine Learning · Computer Science 2025-01-10 Yun Qu , Yuhang Jiang , Boyuan Wang , Yixiu Mao , Cheems Wang , Chang Liu , Xiangyang Ji

We introduce ReWiND, a framework for learning robot manipulation tasks solely from language instructions without per-task demonstrations. Standard reinforcement learning (RL) and imitation learning methods require expert supervision through…

Recent years have seen considerable advancements in multi-step reasoning with Large Language Models (LLMs). The previous studies have elucidated the merits of integrating feedback or search mechanisms during model inference to improve the…

Computation and Language · Computer Science 2023-10-17 Qianli Ma , Haotian Zhou , Tingkai Liu , Jianbo Yuan , Pengfei Liu , Yang You , Hongxia Yang

Recent works have shown that Large Language Models (LLMs) can be applied to ground natural language to a wide variety of robot skills. However, in practice, learning multi-task, language-conditioned robotic skills typically requires…

Robotics · Computer Science 2023-03-09 Oier Mees , Jessica Borja-Diaz , Wolfram Burgard

We introduce Large Language Model-Assisted Preference Prediction (LAPP), a novel framework for robot learning that enables efficient, customizable, and expressive behavior acquisition with minimum human effort. Unlike prior approaches that…

Robotics · Computer Science 2025-04-23 Pingcheng Jian , Xiao Wei , Yanbaihui Liu , Samuel A. Moore , Michael M. Zavlanos , Boyuan Chen

Learning from Demonstrations, particularly from biological experts like humans and animals, often encounters significant data acquisition challenges. While recent approaches leverage internet videos for learning, they require complex,…

Robotics · Computer Science 2024-10-15 Harsh Mahesheka , Zhixian Xie , Zhaoran Wang , Wanxin Jin

Reinforcement Learning from Human Feedback aligns the outputs of Large Language Models with human values and preferences. Central to this process is the reward model (RM), which translates human feedback into training signals for optimising…

Artificial Intelligence · Computer Science 2025-09-23 Zeyu Huang , Zihan Qiu , Zili Wang , Edoardo M. Ponti , Ivan Titov

We propose a large language model based reward decomposition framework for aligning dialogue agents using only a single session-level feedback signal. We leverage the reasoning capabilities of a frozen, pretrained large language model (LLM)…

Computation and Language · Computer Science 2026-02-12 Dong Won Lee , Hae Won Park , Cynthia Breazeal , Louis-Philippe Morency

Reinforcement learning from human feedback (RLHF) has become a key factor in aligning model behavior with users' goals. However, while humans integrate multiple strategies when making decisions, current RLHF approaches often simplify this…

Machine Learning · Computer Science 2025-06-19 Mingkang Wu , Devin White , Evelyn Rose , Vernon Lawhern , Nicholas R Waytowich , Yongcan Cao

In recent years, large pre-trained language models (LLMs) have demonstrated the ability to follow instructions and perform novel tasks from a few examples. The possibility to parameterise an LLM through such in-context examples widens their…

Machine Learning · Computer Science 2023-05-10 Imanol Schlag , Sainbayar Sukhbaatar , Asli Celikyilmaz , Wen-tau Yih , Jason Weston , Jürgen Schmidhuber , Xian Li

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

Prompt optimization improves the reasoning abilities of large language models (LLMs) without requiring parameter updates to the target model. Following heuristic-based "Think step by step" approaches, the field has evolved in two main…

Computation and Language · Computer Science 2025-07-25 Andreea Nica , Ivan Zakazov , Nicolas Mario Baldwin , Saibo Geng , Robert West

Model free reinforcement learning suffers from the high sampling complexity inherent to robotic manipulation or locomotion tasks. Most successful approaches typically use random sampling strategies which leads to slow policy convergence. In…

Robotics · Computer Science 2019-08-13 Miroslav Bogdanovic , Ludovic Righetti

Large language models (LLMs) have significantly advanced in various fields and intelligent agent applications. However, current LLMs that learn from human or external model supervision are costly and may face performance ceilings as task…

Computation and Language · Computer Science 2024-06-04 Zhengwei Tao , Ting-En Lin , Xiancai Chen , Hangyu Li , Yuchuan Wu , Yongbin Li , Zhi Jin , Fei Huang , Dacheng Tao , Jingren Zhou

Large reasoning models (LRMs) have recently shown promise in solving complex math problems when optimized with Reinforcement Learning (RL). But conventional approaches rely on outcome-only rewards that provide sparse feedback, resulting in…

Machine Learning · Computer Science 2025-08-01 Tao He , Rongchuan Mu , Lizi Liao , Yixin Cao , Ming Liu , Bing Qin

Although Multi-Agent Reinforcement Learning (MARL) is effective for complex multi-robot tasks, it suffers from low sample efficiency and requires iterative manual reward tuning. Large Language Models (LLMs) have shown promise in…

Robotics · Computer Science 2025-06-04 Guobin Zhu , Rui Zhou , Wenkang Ji , Shiyu Zhao

The field of artificial intelligence (AI) alignment aims to investigate whether AI technologies align with human interests and values and function in a safe and ethical manner. AI alignment is particularly relevant for large language models…

Human-Computer Interaction · Computer Science 2023-01-18 Thilo Hagendorff , Sarah Fabi