English
Related papers

Related papers: The End of Reward Engineering: How LLMs Are Redefi…

200 papers

Reward Machines (RMs) are an established mechanism in Reinforcement Learning (RL) to represent and learn sparse, temporally extended tasks with non-Markovian rewards. RMs rely on high-level information in the form of labels that are emitted…

Machine Learning · Computer Science 2026-03-04 Thomas Krug , Daniel Neider

As large language model (LLM) agents evolve from isolated tool users into coordinated teams, reinforcement learning (RL) must optimize not only individual actions but also how work is spawned, delegated, communicated, aggregated, and…

Computation and Language · Computer Science 2026-05-05 Chenchen Zhang

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing Large Language Models (LLMs), exemplified by the success of OpenAI's o-series. In RLVR, rewards are derived from verifiable signals-such…

We study the use of large language models (LLMs) for physics instrument design and compare their performance to reinforcement learning (RL). Using only prompting, LLMs are given task constraints and summaries of prior high-scoring designs…

Instrumentation and Detectors · Physics 2026-01-13 Sara Zoccheddu , Shah Rukh Qasim , Patrick Owen , Nicola Serra

Enabling a high-degree-of-freedom robot to learn specific skills is a challenging task due to the complexity of robotic dynamics. Reinforcement learning (RL) has emerged as a promising solution; however, addressing such problems requires…

Robotics · Computer Science 2025-05-06 Changxin Huang , Junyang Liang , Yanbin Chang , Jingzhao Xu , Jianqiang Li

Large vision-language models (LVLMs) often fail to align with human preferences, leading to issues like generating misleading content without proper visual context (also known as hallucination). A promising solution to this problem is using…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Chenglong Wang , Yang Gan , Yifu Huo , Yongyu Mu , Murun Yang , Qiaozhi He , Tong Xiao , Chunliang Zhang , Tongran Liu , Quan Du , Di Yang , Jingbo Zhu

Reinforcement Learning (RL) has demonstrated excellent decision-making potential in platoon coordination problems. However, due to the variability of coordination goals, the complexity of the decision problem, and the time-consumption of…

Machine Learning · Computer Science 2025-04-29 Dixiao Wei , Peng Yi , Jinlong Lei , Yiguang Hong , Yuchuan Du

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with…

Computation and Language · Computer Science 2025-06-27 Tianyi Men , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Reinforcement Learning with Verifiable Rewards (RLVR) has recently demonstrated notable success in enhancing the reasoning performance of large language models (LLMs), particularly on mathematics and programming tasks. Similar to how…

Artificial Intelligence · Computer Science 2025-11-25 Yang Yue , Zhiqi Chen , Rui Lu , Andrew Zhao , Zhaokai Wang , Yang Yue , Shiji Song , Gao Huang

LLM-based agents have made significant advancements in interactive environments, such as mobile operations and web browsing, and other domains beyond computer using. Current multi-agent systems universally excel in performance, compared to…

Computation and Language · Computer Science 2025-08-21 Zhitao He , Zijun Liu , Peng Li , Yi R. Fung , Ming Yan , Ji Zhang , Fei Huang , Yang Liu

Large language models (LLMs) have shown remarkable abilities in logical reasoning, in-context learning, and code generation. However, translating natural language instructions into effective robotic control policies remains a significant…

Machine Learning · Computer Science 2025-08-28 Utsav Singh , Pramit Bhattacharyya , Vinay P. Namboodiri

Reinforcement Learning from Verifiable Rewards (RLVR) has substantially enhanced the reasoning capabilities of large language models in abstract reasoning tasks. However, its application to Large Vision-Language Models (LVLMs) remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yuhang Han , Yuyang Wu , Zhengbo Jiao , Yiyu Wang , Xuyang Liu , Shaobo Wang , Hanlin Xu , Xuming Hu , Linfeng Zhang

LLMs are increasingly used to design reward functions based on human preferences in Reinforcement Learning (RL). We focus on LLM-designed rewards for Restless Multi-Armed Bandits, a framework for allocating limited resources among agents.…

Machine Learning · Computer Science 2025-10-22 Shresth Verma , Niclas Boehmer , Lingkai Kong , Milind Tambe

When designing reinforcement learning (RL) agents, a designer communicates the desired agent behavior through the definition of reward functions - numerical feedback given to the agent as reward or punishment for its actions. However,…

Artificial Intelligence · Computer Science 2025-11-05 Michel Ma , Takuma Seno , Kaushik Subramanian , Peter R. Wurman , Peter Stone , Craig Sherstan

Large Vision-Language Models (LVLMs) typically follow a two-stage training paradigm-pretraining and supervised fine-tuning. Recently, preference optimization, derived from the language domain, has emerged as an effective post-training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yufei Zhan , Yousong Zhu , Shurong Zheng , Hongyin Zhao , Fan Yang , Ming Tang , Jinqiao Wang

Recent work, spanning from autonomous vehicle coordination to in-space assembly, has shown the importance of learning collaborative behavior for enabling robots to achieve shared goals. A common approach for learning this cooperative…

Multiagent Systems · Computer Science 2025-02-25 Kartik Nagpal , Dayi Dong , Jean-Baptiste Bouvier , Negar Mehr

Recent advances demonstrate that reinforcement learning with verifiable rewards (RLVR) significantly enhances the reasoning capabilities of large language models (LLMs). However, standard RLVR faces challenges with reward sparsity, where…

Large vision-language models (LVLMs) perform outstandingly across various multimodal tasks. However, their ability to evaluate generated content remains limited, and training vision-language reward models (VLRMs) with preference data is…

Computation and Language · Computer Science 2025-05-23 Chen-An Li , Tzu-Han Lin , Yun-Nung Chen , Hung-yi Lee

Bus holding control is a widely-adopted strategy for maintaining stability and improving the operational efficiency of bus systems. Traditional model-based methods often face challenges with the low accuracy of bus state prediction and…

Artificial Intelligence · Computer Science 2025-04-15 Jiajie Yu , Yuhong Wang , Wei Ma

In Reinforcement Learning (RL), it is commonly assumed that an immediate reward signal is generated for each action taken by the agent, helping the agent maximize cumulative rewards to obtain the optimal policy. However, in many real-world…

Machine Learning · Computer Science 2024-10-29 Yuting Tang , Xin-Qiang Cai , Yao-Xiang Ding , Qiyu Wu , Guoqing Liu , Masashi Sugiyama