English
Related papers

Related papers: Verifiable Reasoning for LLM-based Generative Reco…

200 papers

We introduce our Leanabell-Prover-V2, a 7B large language models (LLMs) that can produce formal theorem proofs in Lean 4, with verifier-integrated Long Chain-of-Thoughts (CoT). Following our previous work Leanabell-Prover-V1, we continual…

Artificial Intelligence · Computer Science 2025-07-14 Xingguang Ji , Yahui Liu , Qi Wang , Jingyuan Zhang , Yang Yue , Rui Shi , Chenxi Sun , Fuzheng Zhang , Guorui Zhou , Kun Gai

As large language models (LLMs) are increasingly applied to scientific reasoning, the complexity of answer formats and the diversity of equivalent expressions make answer verification a critical yet challenging task. Existing verification…

Artificial Intelligence · Computer Science 2025-09-30 Shenghe Zheng , Chenyu Huang , Fangchen Yu , Junchi Yao , Jingqi Ye , Tao Chen , Yun Luo , Ning Ding , LEI BAI , Ganqu Cui , Peng Ye

Answer verification is crucial not only for evaluating large language models (LLMs) by matching their unstructured outputs against standard answers, but also serves as the reward model to guide LLM optimization. Most evaluation frameworks…

Computation and Language · Computer Science 2025-08-06 Shudong Liu , Hongwei Liu , Junnan Liu , Linchen Xiao , Songyang Gao , Chengqi Lyu , Yuzhe Gu , Wenwei Zhang , Derek F. Wong , Songyang Zhang , Kai Chen

Large Language Models (LLMs) have shown impressive potential in generating Verilog codes, but ensuring functional correctness remains a challenge. Existing approaches often rely on self-consistency or simulation feedback to select the best…

Hardware Architecture · Computer Science 2025-11-05 Zhuorui Zhao , Bing Li , Grace Li Zhang , Ulf Schlichtmann

Time series is a pervasive data type across various application domains, rendering the reasonable solving of diverse time series tasks a long-standing goal. Recent advances in large language models (LLMs), especially their reasoning…

Artificial Intelligence · Computer Science 2026-05-08 Jiahui Zhou , Dan Li , Boxin Li , Xiao Zhang , Erli Meng , Lin Li , Zhuomin Chen , Jian Lou , See-Kiong Ng

Reinforcement learning with verifiable rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). Unlike traditional RL approaches, RLVR leverages rule-based feedback to guide…

Computation and Language · Computer Science 2025-08-19 Jia Deng , Jie Chen , Zhipeng Chen , Daixuan Cheng , Fei Bai , Beichen Zhang , Yinqian Min , Yanzipeng Gao , Wayne Xin Zhao , Ji-Rong Wen

Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on…

Information Retrieval · Computer Science 2024-12-12 Xubin Ren , Wei Wei , Lianghao Xia , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang

Generative recommendation based on Large Language Models (LLMs) have transformed the traditional ranking-based recommendation style into a text-to-text generation paradigm. However, in contrast to standard NLP tasks that inherently operate…

Information Retrieval · Computer Science 2024-05-20 Juntao Tan , Shuyuan Xu , Wenyue Hua , Yingqiang Ge , Zelong Li , Yongfeng Zhang

Reinforcement learning from verifiable rewards (RLVR) has recently been extended from text-only LLMs to vision-language models (VLMs) to elicit long-chain multimodal reasoning. However, RLVR-trained VLMs still exhibit two persistent failure…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hoang Anh Just , Yifei Fan , Handong Zhao , Jiuxiang Gu , Ruiyi Zhang , Simon Jenni , Kushal Kafle , Ruoxi Jia , Jing Shi

The extensive world knowledge and powerful reasoning capabilities of large language models (LLMs) have attracted significant attention in recommendation systems (RS). Specifically, The chain of thought (CoT) has been shown to improve the…

Information Retrieval · Computer Science 2025-08-22 Yu Xia , Rui Zhong , Zeyu Song , Wei Yang , Junchen Wan , Qingpeng Cai , Chi Lu , Peng Jiang

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

We introduce Generative Universal Verifier, a novel concept and plugin designed for next-generation multimodal reasoning in vision-language models and unified multimodal models, providing the fundamental capability of reflection and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xinchen Zhang , Xiaoying Zhang , Youbin Wu , Yanbin Cao , Renrui Zhang , Ruihang Chu , Ling Yang , Yujiu Yang

Trustworthy verifiers are essential for the success of reinforcement learning with verifiable reward (RLVR), which is the core methodology behind various large reasoning models such as DeepSeek-R1. In complex domains like mathematical…

Machine Learning · Computer Science 2025-10-08 Yuzhen Huang , Weihao Zeng , Xingshan Zeng , Qi Zhu , Junxian He

Despite the strong reasoning ability of large language models~(LLMs), they are prone to errors and hallucinations. As a result, how to check their outputs effectively and efficiently has become a critical problem in their applications.…

Artificial Intelligence · Computer Science 2025-10-29 Jiayu Liu , Wei Dai , Zhenya Huang , Ning Miao , Enhong Chen

Recent advancements in test time compute, particularly through the use of verifier models, have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). This generator-verifier approach closely resembles the…

Machine Learning · Computer Science 2024-10-11 Jianing Qi , Hao Tang , Zhigang Zhu

Large language models (LLMs) exhibit remarkable capabilities but often produce inaccurate responses, as they rely solely on their embedded knowledge. Retrieval-Augmented Generation (RAG) enhances LLMs by incorporating an external…

Computation and Language · Computer Science 2024-09-25 Nitin Aravind Birur , Tanay Baswa , Divyanshu Kumar , Jatan Loya , Sahil Agarwal , Prashanth Harshangi

Building generalist embodied agents capable of solving complex real-world tasks remains a fundamental challenge in AI. Multimodal Large Language Models (MLLMs) have significantly advanced the reasoning capabilities of such agents through…

Artificial Intelligence · Computer Science 2026-05-14 Nishad Singhi , Christian Bialas , Snehal Jauhri , Vignesh Prasad , Georgia Chalvatzaki , Marcus Rohrbach , Anna Rohrbach

As multimodal large language models (MLLMs) frequently exhibit errors in complex video reasoning scenarios, correcting these errors is critical for uncovering their weaknesses and improving performance. However, existing benchmarks lack…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Xusen Hei , Jiali Chen , Jinyu Yang , Mengchen Zhao , Yi Cai

Reinforcement Learning from Verifiable Rewards (RLVR) on chain-of-thought reasoning has become a standard part of language model post-training recipes. A common assumption is that the reasoning chains trained through RLVR reliably represent…

Computation and Language · Computer Science 2026-04-27 Qinan Yu , Alexa Tartaglini , Peter Hase , Carlos Guestrin , Christopher Potts

Ensuring the reliability of Large Language Models (LLMs) in complex reasoning tasks remains a formidable challenge, particularly in scenarios that demand precise mathematical calculations and knowledge-intensive open-domain generation. In…

Machine Learning · Computer Science 2025-05-27 Ali Razghandi , Seyed Mohammad Hadi Hosseini , Mahdieh Soleymani Baghshah