中文
相关论文

相关论文: When (and How) to Trust the Expert: Diagnosing Que…

200 篇论文

Inverse Reinforcement Learning (IRL) techniques deal with the problem of deducing a reward function that explains the behavior of an expert agent who is assumed to act optimally in an underlying unknown task. In several problems of…

机器学习 · 计算机科学 2024-01-09 Riccardo Poiani , Gabriele Curti , Alberto Maria Metelli , Marcello Restelli

Episodic training, where an agent's environment is reset after every success or failure, is the de facto standard when training embodied reinforcement learning (RL) agents. The underlying assumption that the environment can be easily reset…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Zichen Zhang , Luca Weihs

In this paper, we study the use of robust model independent bounded extremum seeking (ES) feedback control to improve the robustness of deep reinforcement learning (DRL) controllers for a class of nonlinear time-varying systems. DRL has the…

机器学习 · 计算机科学 2026-03-11 Shaifalee Saxena , Alan Williams , Rafael Fierro , Alexander Scheinker

Large language models increasingly fail in a way that scalar accuracy cannot diagnose: they produce a sound reasoning trace and then abandon it under social pressure or an authoritative hint. We argue that this is a control failure, not a…

人工智能 · 计算机科学 2026-04-09 Edward Y. Chang

Recent advances in reinforcement learning (RL) have substantially improved the training of large-scale language models, leading to significant gains in generation quality and reasoning ability. However, most existing research focuses on…

机器学习 · 计算机科学 2026-01-13 Di Zhang , Xun Wu , Shaohan Huang , Lingjie Jiang , Yaru Hao , Li Dong , Zewen Chi , Zhifang Sui , Furu Wei

Iterative self-correction is increasingly deployed in agentic LLM systems, yet whether repeated refinement improves or degrades performance remains inconsistent across models. We recast self-correction as a closed-loop feedback-control…

人工智能 · 计算机科学 2026-05-05 Aofan Liu , Jingxiang Meng

Deep reinforcement learning (DRL) has seen several successful applications to process control. Common methods rely on a deep neural network structure to model the controller or process. With increasingly complicated control structures, the…

Test-time reinforcement learning generates multiple candidate answers via repeated rollouts and performs online updates using pseudo-labels constructed by majority voting. To reduce overhead and improve exploration, prior work introduces…

机器学习 · 计算机科学 2026-05-28 Chu Zhao , Enneng Yang , Yuting Liu , Jianzhe Zhao , Guibing Guo

End-to-end autonomous driving is typically built upon imitation learning (IL), yet its performance is constrained by the quality of human demonstrations. To overcome this limitation, recent methods incorporate reinforcement learning (RL)…

机器人学 · 计算机科学 2026-04-13 Zhexi Lian , Haoran Wang , Xuerun Yan , Weimeng Lin , Xianhong Zhang , Yongyu Chen , Jia Hu

Mixture-of-Experts (MoE) models have emerged as a dominant paradigm for efficient LLM scaling, yet adapting them to non-English downstream tasks remains challenging. Existing fine-tuning approaches treat MoE models as monolithic learners,…

计算与语言 · 计算机科学 2026-05-28 Guanzhi Deng , Kuan Wu , Haibo Wang , Shing Yin Wong , Sichun Luo , Linqi Song

We consider the problem of imitation learning from a finite set of expert trajectories, without access to reinforcement signals. The classical approach of extracting the expert's reward function via inverse reinforcement learning, followed…

机器学习 · 计算机科学 2019-06-10 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

Large Language Models (LLMs) have shown tremendous potential as agents, excelling at tasks that require multiple rounds of reasoning and interactions. Rejection Sampling Fine-Tuning (RFT) has emerged as an effective method for finetuning…

人工智能 · 计算机科学 2025-04-22 Li-Cheng Lan , Andrew Bai , Minhao Cheng , Cho-Jui Hsieh , Tianyi Zhou

Reinforcement learning (RL) is a machine learning approach that trains agents to maximize cumulative rewards through interactions with environments. The integration of RL with deep learning has recently resulted in impressive achievements…

神经与进化计算 · 计算机科学 2023-08-31 Hui Bai , Ran Cheng , Yaochu Jin

In this paper, we consider a transfer Reinforcement Learning (RL) problem in continuous state and action spaces, under unobserved contextual information. For example, the context can represent the mental view of the world that an expert…

机器学习 · 计算机科学 2021-06-08 Chenyu Liu , Yan Zhang , Yi Shen , Michael M. Zavlanos

Model-based reinforcement learning (RL) is anticipated to exhibit higher sample efficiency compared to model-free RL by utilizing a virtual environment model. However, it is challenging to obtain sufficiently accurate representations of the…

人工智能 · 计算机科学 2026-01-19 Zihao Sheng , Zilin Huang , Sikai Chen

Reinforcement learning from human feedback (RLHF) replaces hard-to-specify rewards with pairwise trajectory preferences, yet regret-oriented theory often assumes that preference labels are generated consistently from a single ground-truth…

机器学习 · 计算机科学 2026-04-03 Ming Shi , Yingbin Liang , Ness B. Shroff , Ananthram Swami

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

人工智能 · 计算机科学 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

In this work, we consider the complex control problem of making a monopod reach a target with a jump. The monopod can jump in any direction and the terrain underneath its foot can be uneven. This is a template of a much larger class of…

机器人学 · 计算机科学 2024-08-06 Riccardo Bussola , Michele Focchi , Andrea Del Prete , Daniele Fontanelli , Luigi Palopoli

Weakly supervised learning aims to reduce the cost of labeling data by using expert-designed labeling rules. However, existing methods require experts to design effective rules in a single shot, which is difficult in the absence of proper…

计算与语言 · 计算机科学 2024-09-10 Giannis Karamanolakis , Daniel Hsu , Luis Gravano

Reinforcement learning (RL) has equipped LLM agents with a strong ability to solve complex tasks. However, existing RL methods normally use a \emph{single} policy network, causing \emph{simplicity bias} where simple tasks occupy most…

人工智能 · 计算机科学 2026-05-20 Shengtian Yang , Yu Li , Shuo He , Yewen Li , Qingpeng Cai , Peng Jiang , Lei Feng