English
Related papers

Related papers: Reinforced Informativeness Optimization for Long-F…

200 papers

Visual quality assessment (VQA) is increasingly shifting from scalar score prediction toward interpretable quality understanding -- a paradigm that demands \textit{fine-grained spatiotemporal perception} and \textit{auxiliary contextual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Linhan Cao , Wei Sun , Weixia Zhang , Xiangyang Zhu , Kaiwei Zhang , Jun Jia , Dandan Zhu , Guangtao Zhai , Xiongkuo Min

Search agents powered by Large Language Models (LLMs) have demonstrated significant potential in tackling knowledge-intensive tasks. Reinforcement learning (RL) has emerged as a powerful paradigm for training these agents to perform…

Computation and Language · Computer Science 2026-05-11 Shiyu Li , Yang Tang , Yifan Wang , Peiming Li , Xi Chen

Existing large language models (LLMs) face challenges of following complex instructions, especially when multiple constraints are present and organized in paralleling, chaining, and branching structures. One intuitive solution, namely…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yulei Qin , Gang Li , Zongyi Li , Zihan Xu , Yuchen Shi , Zhekai Lin , Xiao Cui , Ke Li , Xing Sun

Large Language Models (LLMs) augmented with retrieval mechanisms have demonstrated significant potential in fact-checking tasks by integrating external knowledge. However, their reliability decreases when confronted with conflicting…

Computation and Language · Computer Science 2025-05-26 Ziyu Ge , Yuhao Wu , Daniel Wai Kit Chin , Roy Ka-Wei Lee , Rui Cao

Input errors in question-answering (QA) systems often lead to incorrect responses. Large language models (LLMs) struggle with this task, frequently failing to interpret user intent (misinterpretation) or unnecessarily altering the original…

Computation and Language · Computer Science 2025-11-06 Longpeng Qiu , Ting Li , Shuai Mao , Nan Yang , Xiaohui Yan

Recent work on reinforcement learning with verifiable rewards (RLVR) has shown that large language models (LLMs) can be substantially improved using outcome-level verification signals, such as unit tests for code or exact-match checks for…

Computation and Language · Computer Science 2026-01-27 Massimiliano Pronesti , Anya Belz , Yufang Hou

Retrieval-Augmented Generation (RAG) has emerged as a widely adopted approach for enhancing LLMs in scenarios that demand extensive factual knowledge. However, current RAG evaluations concentrate primarily on correctness, which may not…

Computation and Language · Computer Science 2026-03-23 Vinh Nguyen , Cuong Dang , Jiahao Zhang , Hoa Tran , Minh Tran , Trinh Chau , Thai Le , Lu Cheng , Suhang Wang

Reinforcement Learning from Verifiable Rewards (RLVR) significantly enhances large language models (LLMs) reasoning but severely suffers from calibration degeneration, where models become excessively over-confident in incorrect answers.…

Machine Learning · Computer Science 2026-05-28 Zhengzhao Ma , Xueru Wen , Boxi Cao , Yaojie Lu , Hongyu Lin , Jinglin Yang , Min He , Xianpei Han , Le Sun

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the…

Information Retrieval · Computer Science 2025-08-26 Leqian Li , Dianxi Shi , Jialu Zhou , Xinyu Wei , Mingyue Yang , Songchang Jin , Shaowu Yang

Retrieval-Augmented Generation (RAG) is an advanced technique designed to address the challenges of Artificial Intelligence-Generated Content (AIGC). By integrating context retrieval into content generation, RAG provides reliable and…

DeepSeek-R1 has demonstrated remarkable effectiveness in incentivizing reasoning and generalization capabilities of large language models (LLMs) through reinforcement learning. Nevertheless, the potential of reasoning-induced computation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tianhe Wu , Jian Zou , Jie Liang , Lei Zhang , Kede Ma

RAG systems are increasingly deployed in high-stakes domains where users expect outputs to be consistent across semantically equivalent queries. However, existing systems often exhibit significant inconsistencies due to variability in both…

Computation and Language · Computer Science 2025-10-07 Faisal Hamman , Chenyang Zhu , Anoop Kumar , Xujun Peng , Sanghamitra Dutta , Daben Liu , Alfy Samuel

Reinforcement Learning with Verifiable Rewards (RLVR) is a promising approach for enhancing agentic deep search. However, its application is often hindered by low \textbf{Reward Density} in deep search scenarios, where agents expend…

Computation and Language · Computer Science 2025-10-31 Kun Luo , Hongjin Qian , Zheng Liu , Ziyi Xia , Shitao Xiao , Siqi Bao , Jun Zhao , Kang Liu

Reinforcement learning (RL) plays a central role in improving the reasoning and alignment of large language models, yet its efficiency critically depends on how training data are selected. Existing online selection strategies predominantly…

Machine Learning · Computer Science 2026-03-03 Xinyu Zhou , Boyu Zhu , Haotian Zhang , Huiming Wang , Zhijiang Guo

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

Computation and Language · Computer Science 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Recently, Retrieval Augmented Generation (RAG) has shifted focus to multi-retrieval approaches to tackle complex tasks such as multi-hop question answering. However, these systems struggle to decide when to stop searching once enough…

Information Retrieval · Computer Science 2026-04-23 Gabriel Iturra-Bocaz , Petra Galuscakova

Large language models (LLMs) continue to struggle with knowledge-intensive questions that require up-to-date information and multi-hop reasoning. Augmenting LLMs with hybrid external knowledge, such as unstructured text and structured…

Machine Learning · Computer Science 2026-02-12 Junhong Lin , Bing Zhang , Song Wang , Ziyan Liu , Dan Gutfreund , Julian Shun , Yada Zhu

Although the Retrieval-Augmented Generation (RAG) paradigms can use external knowledge to enhance and ground the outputs of Large Language Models (LLMs) to mitigate generative hallucinations and static knowledge base problems, they still…

Computation and Language · Computer Science 2024-05-24 Diji Yang , Jinmeng Rao , Kezhen Chen , Xiaoyuan Guo , Yawen Zhang , Jie Yang , Yi Zhang

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

Computation and Language · Computer Science 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang

Multilingual retrieval-augmented generation (MRAG) requires models to effectively acquire and integrate beneficial external knowledge from multilingual collections. However, most existing studies employ a unitive process where queries of…

Computation and Language · Computer Science 2026-04-23 Rui Qi , Fengran Mo , Yufeng Chen , Xue Zhang , Shuo Wang , Hongliang Li , Jinan Xu , Meng Jiang , Jian-Yun Nie , Kaiyu Huang