中文
相关论文

相关论文: Local Look-Ahead Guidance via Verifier-in-the-Loop…

200 篇论文

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a promising framework for improving reasoning abilities in Large Language Models (LLMs). However, policy optimized with binary verification prone to overlook…

机器学习 · 计算机科学 2025-10-14 Jinghao Zhang , Naishan Zheng , Ruilin Li , Dongzhou Cheng , Zheming Liang , Feng Zhao , Jiaqi Wang

The kind of closed-loop verification likely to be required for autonomous vehicle (AV) safety testing is beyond the reach of traditional test methodologies and discrete verification. Validation puts the autonomous vehicle system to the test…

机器学习 · 计算机科学 2020-05-29 Hyun Jae Cho , Madhur Behl

We study a theory of reinforcement learning (RL) in which the learner receives binary feedback only once at the end of an episode. While this is an extreme test case for theory, it is also arguably more representative of real-world…

机器学习 · 计算机科学 2022-08-23 Niladri S. Chatterji , Aldo Pacchiano , Peter L. Bartlett , Michael I. Jordan

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a core paradigm for enhancing the reasoning capabilities of Large Language Models (LLMs). To address the lack of verification signals at test time, prior studies…

计算与语言 · 计算机科学 2025-10-17 Wenkai Yang , Weijie Liu , Ruobing Xie , Yiju Guo , Lulu Wu , Saiyong Yang , Yankai Lin

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

机器学习 · 计算机科学 2024-10-22 Nadav Merlis

Reinforcement learning with verifiable rewards (RLVR) succeeds in reasoning tasks (e.g., math and code) by checking the final verifiable answer (i.e., a verifiable dot signal). However, extending this paradigm to open-ended generation is…

计算与语言 · 计算机科学 2026-01-27 Yuxin Jiang , Yufei Wang , Qiyuan Zhang , Xingshan Zeng , Liangyou Li , Jierun Chen , Chaofan Tao , Haoli Bai , Lifeng Shang

Human-in-the-loop (HiL) reinforcement learning is gaining traction in domains with large action and state spaces, and sparse rewards by allowing the agent to take advice from HiL. Beyond advice accommodation, a sequential decision-making…

人工智能 · 计算机科学 2022-10-10 Mudit Verma , Ayush Kharkwal , Subbarao Kambhampati

Reinforcement learning (RL) problems are fundamental in online decision-making and have been instrumental in finding an optimal policy for Markov decision processes (MDPs). Function approximations are usually deployed to handle large or…

机器学习 · 计算机科学 2025-05-20 Jiashuo Jiang , Yiming Zong , Yinyu Ye

Motivated by the challenge presented by non-Markovian objectives in reinforcement learning (RL), we present a novel framework to track and represent the progress of autonomous agents through complex, multi-stage tasks. Given a specification…

机器学习 · 计算机科学 2026-04-21 Noel Brindise , Cedric Langbort , Melkior Ornik

Reinforcement learning (RL), with its ability to explore and optimize policies in complex, dynamic decision-making tasks, has emerged as a promising approach to addressing motion planning (MoP) challenges in autonomous driving (AD). Despite…

机器学习 · 计算机科学 2025-04-01 Zhuoren Li , Guizhe Jin , Ran Yu , Zhiwen Chen , Nan Li , Wei Han , Lu Xiong , Bo Leng , Jia Hu , Ilya Kolmanovsky , Dimitar Filev

Training large language models (LLMs) for complex reasoning via Reinforcement Learning with Verifiable Rewards (RLVR) is effective but limited by reliance on costly, domain-specific supervision. We explore Reinforcement Learning from…

机器学习 · 计算机科学 2026-05-19 Xuandong Zhao , Zhewei Kang , Aosong Feng , Sergey Levine , Dawn Song

Despite significant progress, Vision-Language Models (VLMs) still struggle with complex visual reasoning, where multi-step dependencies cause early errors to cascade through the reasoning chain. Existing post-training paradigms are limited:…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Yanbei Jiang , Chao Lei , Yihao Ding , Krista Ehinger , Jey Han Lau

Recent neural theorem provers use reinforcement learning with verifiable rewards (RLVR), where proof assistants provide binary correctness signals. While verifiable rewards are cheap and scalable without reward hacking issues, they suffer…

人工智能 · 计算机科学 2026-05-12 Zeynel A. Uluşan , Burak S. Akbudak , Can S. Erer , Gözde Gül Şahin

Reinforcement learning (RL) depends critically on the choice of reward functions used to capture the de- sired behavior and constraints of a robot. Usually, these are handcrafted by a expert designer and represent heuristics for relatively…

人工智能 · 计算机科学 2017-03-03 Xiao Li , Cristian-Ioan Vasile , Calin Belta

Reasoning in Large Language Models (LLMs) has recently shown strong potential in enhancing generative recommendation through deep understanding of complex user preference. Existing approaches follow a {reason-then-recommend} paradigm, where…

We introduce Large Language Model-Assisted Preference Prediction (LAPP), a novel framework for robot learning that enables efficient, customizable, and expressive behavior acquisition with minimum human effort. Unlike prior approaches that…

机器人学 · 计算机科学 2025-04-23 Pingcheng Jian , Xiao Wei , Yanbaihui Liu , Samuel A. Moore , Michael M. Zavlanos , Boyuan Chen

Training robust and generalizable reward models for human visual preferences is essential for aligning text-to-image and text-to-video generative models with human intent. However, current reward models often fail to generalize, and…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Alexander Gambashidze , Li Pengyi , Matvey Skripkin , Andrey Galichin , Anton Gusarov , Konstantin Sobolev , Andrey Kuznetsov , Ivan Oseledets

We present a rigorous, human-in-the-loop evaluation framework for assessing the performance of AI agents on the task of Air Traffic Control, grounded in a regulator-certified simulator-based curriculum used for training and testing…

From a first-principles perspective, it may seem odd that the strongest results in foundation model fine-tuning (FT) are achieved via a relatively complex, two-stage training procedure. Specifically, one first trains a reward model (RM) on…

机器学习 · 计算机科学 2025-10-20 Gokul Swamy , Sanjiban Choudhury , Wen Sun , Zhiwei Steven Wu , J. Andrew Bagnell

Fact-checking is a crucial task as it ensures the prevention of misinformation. However, manual fact-checking cannot keep up with the rate at which false information is generated and disseminated online. Automated fact-checking by machines…

人工智能 · 计算机科学 2023-10-12 Gustav Nikopensius , Mohit Mayank , Orchid Chetia Phukan , Rajesh Sharma