English
Related papers

Related papers: StepWiser: Stepwise Generative Judges for Wiser Re…

200 papers

Step-by-step reasoning is widely used to enhance the reasoning ability of large language models (LLMs) in complex problems. Evaluating the quality of reasoning traces is crucial for understanding and improving LLM reasoning. However,…

Computation and Language · Computer Science 2025-09-23 Jinu Lee , Julia Hockenmaier

Generating accurate step-by-step reasoning is essential for Large Language Models (LLMs) to address complex problems and enhance robustness and interpretability. Despite the flux of research on developing advanced reasoning approaches,…

Computation and Language · Computer Science 2024-08-13 Shibo Hao , Yi Gu , Haotian Luo , Tianyang Liu , Xiyan Shao , Xinyuan Wang , Shuhua Xie , Haodi Ma , Adithya Samavedhi , Qiyue Gao , Zhen Wang , Zhiting Hu

Step-by-step verifiers -- also known as process reward models (PRMs) -- are a key ingredient for test-time scaling. PRMs require step-level supervision, making them expensive to train. This work aims to build data-efficient PRMs as…

Machine Learning · Computer Science 2025-12-09 Muhammad Khalifa , Rishabh Agarwal , Lajanugen Logeswaran , Jaekyeom Kim , Hao Peng , Moontae Lee , Honglak Lee , Lu Wang

Existing reinforcement learning strategies based on outcome supervision have proven effective in enhancing the performance of large language models(LLMs) for code generation. While reinforcement learning based on process supervision has…

Software Engineering · Computer Science 2025-02-05 Yufan Ye , Ting Zhang , Wenbin Jiang , Hua Huang

Despite their powerful text generation capabilities, large language models (LLMs) still struggle to effectively utilize external tools to solve complex tasks, a challenge known as tool learning. Existing methods primarily rely on supervised…

Computation and Language · Computer Science 2025-08-19 Yuanqing Yu , Zhefan Wang , Weizhi Ma , Shuai Wang , Chuhan Wu , Zhiqiang Guo , Min Zhang

Sequential recommendation aims to predict a user's next action in large-scale recommender systems. While traditional methods often suffer from insufficient information interaction, recent generative recommendation models partially address…

Information Retrieval · Computer Science 2026-02-10 Haibo Xing , Hao Deng , Yucheng Mao , Lingyu Mu , Jinxin Hu , Yi Xu , Hao Zhang , Jiahao Wang , Shizhun Wang , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Large Language Models (LLMs) have shown promising capabilities for solving Operations Research (OR) problems. While reinforcement learning serves as a powerful paradigm for LLM training on OR problems, existing works generally face two key…

Artificial Intelligence · Computer Science 2025-10-03 Chenyu Zhou , Tianyi Xu , Jianghao Lin , Dongdong Ge

Language models (LMs) have recently shown remarkable performance on reasoning tasks by explicitly generating intermediate inferences, e.g., chain-of-thought prompting. However, these intermediate inference steps may be inappropriate…

Computation and Language · Computer Science 2024-02-06 Debjit Paul , Mete Ismayilzada , Maxime Peyrard , Beatriz Borges , Antoine Bosselut , Robert West , Boi Faltings

Training language models to produce both correct answers and sound reasoning remains an open challenge. Reinforcement learning with verifiable rewards typically optimizes only final outcomes, which can lead to a failure mode where task…

Computation and Language · Computer Science 2026-05-14 Kyuyoung Kim , Kevin Wang , Yunfei Xie , Peiyang Xu , Peiyao Sheng , Chen Wei , Zhangyang Wang , Jinwoo Shin , Pramod Viswanath , Sewoong Oh

Reinforcement Learning with Verifiable Rewards (RLVR) is widely used to improve reasoning in large language models, but rewards only final-answer correctness with no supervision over intermediate steps. Rubric-based methods such as Rubrics…

Large language models (LLMs) are probabilistic in nature and perform more reliably when augmented with external information. As complex queries often require multi-step reasoning over the retrieved information, with no clear or…

Information Retrieval · Computer Science 2026-04-10 Roxana Petcu , Evangelos Kanoulas , Maarten de Rijke

Large language models can perform various reasoning tasks by using chain-of-thought prompting, which guides them to find answers through step-by-step demonstrations. However, the quality of the prompts depends on the demonstrations given to…

Computation and Language · Computer Science 2023-02-02 Zhihong Shao , Yeyun Gong , Yelong Shen , Minlie Huang , Nan Duan , Weizhu Chen

As large language models have evolved, it has become crucial to distinguish between process supervision and outcome supervision -- two key reinforcement learning approaches to complex reasoning tasks. While process supervision offers…

Machine Learning · Computer Science 2025-03-28 Zeyu Jia , Alexander Rakhlin , Tengyang Xie

Large language models excel on static benchmarks, but their ability as self-learning agents in dynamic environments remains unclear. We evaluate three prompting strategies: self-reflection, heuristic mutation, and planning across dynamic…

Artificial Intelligence · Computer Science 2025-08-12 Annie Wong , Thomas Bäck , Aske Plaat , Niki van Stein , Anna V. Kononova

Generative retrieval (GR) models encode a corpus within model parameters and generate relevant document identifiers directly for a given query. While this paradigm shows promise in retrieval tasks, existing GR models struggle with complex…

Information Retrieval · Computer Science 2026-03-16 Steven Dong , Yubao Tang , Maarten de Rijke

Equipping agents with the capacity to justify made decisions using supporting evidence represents a cornerstone of accountable decision-making. Furthermore, ensuring that justifications are in line with human expectations and societal norms…

Machine Learning · Computer Science 2024-02-27 Aleksa Sukovic , Goran Radanovic

Emotional support conversations require more than fluent responses. Supporters need to understand the seeker's situation and emotions, adopt an appropriate strategy, and respond in a natural, human-like manner. Despite advances in large…

Computation and Language · Computer Science 2026-04-10 Yunxiao Wang , Meng Liu , Kaiyu Jiang , Bin Wen , Fan Yang , Tingting Gao , Lizi Liao

Recent work has shown that asking language models to generate reasoning steps improves performance on many reasoning tasks. When moving beyond prompting, this raises the question of how we should supervise such models: outcome-based…

Chain-of-Thought reasoning significantly improves the performance of large language models on complex tasks, but incurs high inference latency due to long generation traces. Step-level speculative reasoning aims to mitigate this cost, yet…

Computation and Language · Computer Science 2026-02-24 Siran Liu , Cyril Y. He

Few-shot learning is a challenging task that requires language models to generalize from limited examples. Large language models like GPT-3 and PaLM have made impressive progress in this area, but they still face difficulties in reasoning…

Computation and Language · Computer Science 2023-05-25 Yifei Li , Zeqi Lin , Shizhuo Zhang , Qiang Fu , Bei Chen , Jian-Guang Lou , Weizhu Chen