English
Related papers

Related papers: Amortized Reasoning Tree Search: Decoupling Propos…

200 papers

Deep Reinforcement Learning (RL) is remarkably effective in addressing sequential resource allocation problems in domains such as healthcare, public policy, and resource management. However, deep RL policies often lack transparency and…

Machine Learning · Computer Science 2025-02-18 Mauricio Tec , Guojun Xiong , Haichuan Wang , Francesca Dominici , Milind Tambe

Large Language Models (LLMs) are typically trained to reflect a relatively uniform set of values, which limits their applicability to tasks that require understanding of nuanced human perspectives. Recent research has underscored the…

Computation and Language · Computer Science 2025-10-07 Yunfan Zhang , Kathleen McKeown , Smaranda Muresan

Despite their remarkable capabilities, large language models often struggle with tasks requiring complex reasoning and planning. While existing approaches like Chain-of-Thought prompting and tree search techniques show promise, they are…

Machine Learning · Computer Science 2025-02-12 Yang Li

Large Language Models (LLMs) have shown great potential in the biomedical domain with the advancement of retrieval-augmented generation (RAG). However, existing retrieval-augmented approaches face challenges in addressing diverse queries…

Computation and Language · Computer Science 2024-10-17 Minda Hu , Licheng Zong , Hongru Wang , Jingyan Zhou , Jingjing Li , Yichen Gao , Kam-Fai Wong , Yu Li , Irwin King

Reinforcement learning with verifiable rewards (RLVR) has achieved remarkable success in logical reasoning tasks, yet whether large language model (LLM) alignment requires fundamentally different approaches remains unclear. Given the…

Artificial Intelligence · Computer Science 2026-03-12 Zhaowei Zhang , Xiaohan Liu , Xuekai Zhu , Junchao Huang , Ceyao Zhang , Zhiyuan Feng , Yaodong Yang , Xiaoyuan Yi , Xing Xie

Reinforcement learning with verifiable rewards (RLVR) has shown great promise in enhancing the reasoning abilities of large reasoning models (LRMs). However, it suffers from a critical issue: entropy collapse and premature convergence.…

Machine Learning · Computer Science 2025-09-30 Yuxian Jiang , Yafu Li , Guanxu Chen , Dongrui Liu , Yu Cheng , Jing Shao

Retrieval-Augmented Generation (RAG) integrates external knowledge with Large Language Models (LLMs) to enhance factual correctness and mitigate hallucination. However, dense retrievers often become the bottleneck of RAG systems due to…

Computation and Language · Computer Science 2025-10-27 Yuan Li , Qi Luo , Xiaonan Li , Bufan Li , Qinyuan Cheng , Bo Wang , Yining Zheng , Yuxin Wang , Zhangyue Yin , Xipeng Qiu

Large language model-empowered agentic recommender systems (ARS) reformulate recommendation as a multi-turn interaction between a recommender agent and a user agent, enabling iterative preference elicitation and refinement beyond…

Information Retrieval · Computer Science 2026-04-21 Zongwei Wang , Min Gao , Hongzhi Yin , Junliang Yu , Tong Chen , Quoc Viet Hung Nguyen , Shazia Sadiq , Tianrui Li

Reinforcement Learning with Verifiable Rewards (RLVR) has become a central approach for improving the reasoning ability of large language models. Recent work studies RLVR through token entropy, arguing that high-entropy tokens drive…

Machine Learning · Computer Science 2025-12-02 Xinzhu Chen , Xuesheng Li , Zhongxiang Sun , Weijie Yu

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

Artificial Intelligence · Computer Science 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

The complex reasoning ability of Large Language Models (LLMs) poses a critical bottleneck for their practical applications. Test-time expansion methods such as Tree-of-Thought (ToT) and Graph-of-Thought (GoT) enhance reasoning by…

Computation and Language · Computer Science 2025-12-01 Yujiao Yang , Jing Lian , Linhui Li

Large language models (LLMs) are increasingly deployed in decision-making tasks, where not only accuracy but also reliable confidence estimates are essential. Well-calibrated confidence enables downstream systems to decide when to trust a…

Machine Learning · Computer Science 2026-01-21 Duygu Nur Yaldiz , Evangelia Spiliopoulou , Zheng Qi , Siddharth Varia , Srikanth Doss , Nikolaos Pappas

Large reasoning models (LRMs) exhibit unprecedented capabilities in solving complex problems through Chain-of-Thought (CoT) reasoning. However, recent studies reveal that their final answers often contradict their own reasoning traces. We…

Artificial Intelligence · Computer Science 2026-03-03 Yuhui Wang , Changjiang Li , Guangke Chen , Jiacheng Liang , Ting Wang

Online matching problems arise in many complex systems, from cloud services and online marketplaces to organ exchange networks, where timely, principled decisions are critical for maintaining high system performance. Traditional heuristics…

Machine Learning · Statistics 2025-10-09 Chiara Mignacco , Matthieu Jonckheere , Gilles Stoltz

Reinforcement learning with verifiable rewards (RLVR) has emerged as the leading approach for enhancing reasoning capabilities in large language models. However, it faces a fundamental compute and memory asymmetry: rollout generation is…

Machine Learning · Computer Science 2026-04-23 Yixuan Even Xu , Yash Savani , Fei Fang , J. Zico Kolter

Selective retrieval aims to make retrieval-augmented generation (RAG) more efficient and reliable by skipping retrieval when an LLM's parametric knowledge suffices. Despite promising results, existing methods are constrained by a binary…

Computation and Language · Computer Science 2026-01-07 Di Wu , Jia-Chen Gu , Kai-Wei Chang , Nanyun Peng

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for enhancing reasoning in Large Language Models (LLMs). However, existing reward formulations typically treat exploration and consolidation as a…

Machine Learning · Computer Science 2026-05-15 Wenze Lin , Zhen Yang , Xitai Jiang , Xiaoteng Ma , Gao Huang

Large language models (LLMs) achieve strong performance by generating long chains of thought, but longer traces always introduce redundant or ineffective reasoning steps. One typical behavior is that they often perform unnecessary…

Computation and Language · Computer Science 2026-01-13 Jinyi Han , Zixiang Di , Zishang Jiang , Ying Liao , Jiaqing Liang , Yongqi Wang , Yanghua Xiao

Deep search agents have proven effective in enhancing LLMs by retrieving external knowledge during multi-step reasoning. However, existing methods often generate a single query for retrieval at each reasoning step, limiting information…

Artificial Intelligence · Computer Science 2026-05-14 Jiabei Liu , Wenyu Mao , Junfei Tan , Chunxu Shen , Lingling Yi , Jiancan Wu , Xiang Wang

Reinforcement Learning with Rubric Rewards (RLRR) is a framework that extends conventional reinforcement learning from human feedback (RLHF) and verifiable rewards (RLVR) by replacing scalar preference signals with structured,…

Machine Learning · Computer Science 2026-05-08 Guangchen Lan , Lian Xiong , Xin Zhou , Hejie Cui , Yuwei Zhang , Mao Li , Zhenyu Shi , Besnik Fetahu , Lihong Li , Xian Li