中文
相关论文

相关论文: ERFSL: An Efficient Reward Function Searcher via L…

200 篇论文

Reinforcement Learning (RL) heavily relies on the careful design of the reward function. However, accurately assigning rewards to each state-action pair in Long-Term Reinforcement Learning (LTRL) tasks remains a significant challenge. As a…

机器学习 · 计算机科学 2025-06-03 Qi Ju , Falin Hei , Zhemei Fang , Yunfeng Luo

Existing large language models (LLMs) driven search agents typically rely on prompt engineering to decouple the user queries into search plans, limiting their effectiveness in complex scenarios requiring reasoning. Furthermore, they suffer…

信息检索 · 计算机科学 2025-05-27 Jinzheng Li , Sibo Ju , Yanzhou Su , Hongguang Li , Yiqing Shen

Extrinsic rewards can effectively guide reinforcement learning (RL) agents in specific tasks. However, extrinsic rewards frequently fall short in complex environments due to the significant human effort needed for their design and…

机器学习 · 计算机科学 2025-04-28 Mingqi Yuan , Roger Creus Castanyer , Bo Li , Xin Jin , Wenjun Zeng , Glen Berseth

Personalized retrieval-augmented generation (RAG) aims to produce user-tailored responses by incorporating retrieved user profiles alongside the input query. Existing methods primarily focus on improving retrieval and rely on large language…

信息检索 · 计算机科学 2025-08-12 Kepu Zhang , Teng Shi , Weijie Yu , Jun Xu

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

LLMs confront inherent limitations in terms of its knowledge, memory, and action. The retrieval augmentation stands as a vital mechanism to address these limitations, which brings in useful information from external sources to augment the…

信息检索 · 计算机科学 2026-01-06 Peitian Zhang , Shitao Xiao , Zheng Liu , Zhicheng Dou , Jian-Yun Nie

Existing Large Reasoning Models (LRMs) have shown the potential of reinforcement learning (RL) to enhance the complex reasoning capabilities of Large Language Models~(LLMs). While they achieve remarkable performance on challenging tasks…

人工智能 · 计算机科学 2025-03-19 Huatong Song , Jinhao Jiang , Yingqian Min , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

计算与语言 · 计算机科学 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Large language model alignment via reinforcement learning depends critically on reward function quality. However, static, domain-specific reward models are often costly to train and exhibit poor generalization in out-of-distribution…

计算与语言 · 计算机科学 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Bosi Wen , Yidong Wang , Yu Luo , Hongning Wang , Minlie Huang

Reward Models (RMs) are crucial to aligning large language models (LLMs), but the degree to which an RM specialized to one task (e.g. writing) generalizes to new tasks (e.g. math) is often not known a priori, often making using only one…

计算与语言 · 计算机科学 2025-10-23 Duy Nguyen , Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal

Fine-tuning foundation models has emerged as a powerful approach for generating objects with specific desired properties. Reinforcement learning (RL) provides an effective framework for this purpose, enabling models to generate outputs that…

机器学习 · 计算机科学 2025-11-04 Pouya M. Ghari , Simone Sciabola , Ye Wang

We investigate the potential of large language models (LLMs) to serve as efficient simulators for agentic search tasks in reinforcement learning (RL), thereby reducing dependence on costly interactions with external search engines. To this…

This paper explores multiple optimization methods to improve the performance of rating-based reinforcement learning (RbRL). RbRL, a method based on the idea of human ratings, has been developed to infer reward functions in reward-free…

机器学习 · 计算机科学 2025-01-15 Evelyn Rose , Devin White , Mingkang Wu , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

Most of the traditional Applicant Tracking Systems (ATS) depend on strict matching using keywords, where candidates that are highly qualified are many times disqualified because of minor semantic differences. In this article, the two-stage…

We present elsciRL, an open-source Python library to facilitate the application of language solutions on reinforcement learning problems. We demonstrate the potential of our software by extending the Language Adapter with Self-Completing…

人工智能 · 计算机科学 2025-07-14 Philip Osborne , Danilo S. Carvalho , André Freitas

Effective decision-making in Large Language Models (LLMs) is essential for handling intricate tasks. However, existing approaches prioritize performance but often overlook the balance between effectiveness and computational cost. To address…

计算与语言 · 计算机科学 2025-06-03 Jiawei Gu , Shangsong Liang

Reinforcement learning is a promising approach for learning control policies for robot tasks. However, specifying complex tasks (e.g., with multiple objectives and safety constraints) can be challenging, since the user must design a reward…

机器学习 · 计算机科学 2020-10-30 Kishor Jothimurugan , Rajeev Alur , Osbert Bastani

Evaluating large language models (LLMs) in diverse and challenging scenarios is essential to align them with human preferences. To mitigate the prohibitive costs associated with human evaluations, utilizing a powerful LLM as a judge has…

计算与语言 · 计算机科学 2025-03-10 Tianjun Wei , Wei Wen , Ruizhi Qiao , Xing Sun , Jianghong Ma

Reinforcement Learning from Verifiable Rewards (RLVR) has driven recent progress in code large language models by leveraging execution-based feedback from unit tests, but its scalability is fundamentally constrained by the availability and…

机器学习 · 计算机科学 2026-05-19 Xiao Zhu , Xinyu Zhou , Boyu Zhu , Hanxu Hu , Mingzhe Du , Haotian Zhang , Huiming Wang , Zhijiang Guo

Large language models (LLMs) have demonstrated exciting progress in acquiring diverse new capabilities through in-context learning, ranging from logical reasoning to code-writing. Robotics researchers have also explored using LLMs to…