中文
相关论文

相关论文: Bringing Value Models Back: Generative Critics for…

200 篇论文

This paper proposes a novel approach for Asset-Liability Management (ALM) by employing continuous-time Reinforcement Learning (RL) with a linear-quadratic (LQ) formulation that incorporates both interim and terminal objectives. We develop a…

机器学习 · 计算机科学 2025-09-30 Yilie Huang

The conventional paradigm of using large language models (LLMs) for natural language generation (NLG) evaluation relies on pre-defined task definitions and evaluation criteria, positioning LLMs as "passive critics" that strictly follow…

计算与语言 · 计算机科学 2025-02-18 Shuying Xu , Junjie Hu , Ming Jiang

Automatic math correction aims to check students' solutions to mathematical problems via artificial intelligence technologies. Most existing studies focus on judging the final answer at the problem level, while they ignore detailed feedback…

计算与语言 · 计算机科学 2025-03-25 Junsong Li , Jie Zhou , Yutao Yang , Bihao Zhan , Qianjun Pan , Yuyang Ding , Qin Chen , Jiang Bo , Xin Lin , Liang He

Faithfully personalizing large language models (LLMs) to align with individual user preferences is a critical but challenging task. While supervised fine-tuning (SFT) quickly reaches a performance plateau, standard reinforcement learning…

计算与语言 · 计算机科学 2025-10-22 Chenghao Zhu , Meiling Tao , Tiannan Wang , Dongyi Ding , Yuchen Eleanor Jiang , Wangchunshu Zhou

Learning to evaluate and improve policies is a core problem of Reinforcement Learning (RL). Traditional RL algorithms learn a value function defined for a single policy. A recently explored competitive alternative is to learn a single value…

机器学习 · 计算机科学 2022-07-05 Francesco Faccio , Aditya Ramesh , Vincent Herrmann , Jean Harb , Jürgen Schmidhuber

Large language models (LLMs) have demonstrated a remarkable ability to serve as general-purpose tools for various language-based tasks. Recent works have demonstrated that the efficacy of such models can be improved through iterative dialog…

计算与语言 · 计算机科学 2025-03-07 Andrew Estornell , Jean-Francois Ton , Yuanshun Yao , Yang Liu

Outstanding claim liabilities are revised repeatedly as claims develop, yet most modern reserving models are trained as one-shot predictors and typically learn only from settled claims. We formulate individual claims reserving as a…

风险管理 · 定量金融 2026-01-13 Benjamin Avanzi , Ronald Richman , Bernard Wong , Mario Wüthrich , Yagebu Xie

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

机器学习 · 计算机科学 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

Reinforcement learning (RL) is a powerful tool for solving complex decision-making problems, but its lack of transparency and interpretability has been a major challenge in domains where decisions have significant real-world consequences.…

人工智能 · 计算机科学 2023-09-12 Muzhe Guo , Feixu Yu , Tian Lan , Fang Jin

We propose Adversarially Trained Actor Critic (ATAC), a new model-free algorithm for offline reinforcement learning (RL) under insufficient data coverage, based on the concept of relative pessimism. ATAC is designed as a two-player…

机器学习 · 计算机科学 2022-07-07 Ching-An Cheng , Tengyang Xie , Nan Jiang , Alekh Agarwal

The advent of large pre-trained language models in the domain of Code Synthesis has shown remarkable performance on various benchmarks, treating the problem of Code Generation in a fashion similar to Natural Language Generation, trained…

The Credit Assignment Problem (CAP) refers to the longstanding challenge of Reinforcement Learning (RL) agents to associate actions with their long-term consequences. Solving the CAP is a crucial step towards the successful deployment of RL…

While Large Language Models (LLMs) excel at algorithmic code generation, they struggle with front-end development, where correctness is judged on rendered pixels and interaction. We present ReLook, an agentic, vision-grounded reinforcement…

机器学习 · 计算机科学 2025-10-14 Yuhang Li , Chenchen Zhang , Ruilin Lv , Ao Liu , Ken Deng , Yuanxing Zhang , Jiaheng Liu , Wiggin Zhou , Bo Zhou

Reinforcement learning (RL) has emerged as a powerful tool for tackling control problems, but its practical application is often hindered by the complexity arising from intricate reward functions with multiple terms. The reward hypothesis…

机器学习 · 计算机科学 2025-02-11 Kilian Freitag , Kristian Ceder , Rita Laezza , Knut Åkesson , Morteza Haghir Chehreghani

The actor-critic (AC) framework has achieved strong empirical success in off-policy reinforcement learning but suffers from the "moving target" problem, where the evaluated policy changes continually. Functional critics, or…

机器学习 · 计算机科学 2026-02-10 Qinxun Bai , Yuxuan Han , Wei Xu , Zhengyuan Zhou

Achieving robust performance is crucial when applying deep reinforcement learning (RL) in safety critical systems. Some of the state of the art approaches try to address the problem with adversarial agents, but these agents often require…

机器学习 · 计算机科学 2022-02-18 Yeeho Song , Jeff Schneider

Recent advancements in offline reinforcement learning (RL) have underscored the capabilities of Return-Conditioned Supervised Learning (RCSL), a paradigm that learns the action distribution based on target returns for each state in a…

机器学习 · 计算机科学 2023-12-22 Yuanfu Wang , Chao Yang , Ying Wen , Yu Liu , Yu Qiao

Standard deep reinforcement learning algorithms use a shared representation for the policy and value function, especially when training directly from images. However, we argue that more information is needed to accurately estimate the value…

机器学习 · 计算机科学 2021-06-16 Roberta Raileanu , Rob Fergus

Reinforcement Learning (RL) significantly enhances the reasoning abilities of large language models (LLMs), yet applying it to multi-turn agentic tasks remains challenging due to the long-horizon nature of interactions and the stochasticity…

人工智能 · 计算机科学 2026-04-03 Jingyue Gao , Yanjiang Guo , Xiaoshuai Chen , Jianyu Chen

Recent advances in reinforcement learning (RL) have led to a growing interest in applying RL to classical planning domains or applying classical planning methods to some complex RL domains. However, the long-horizon goal-based problems…