English
Related papers

Related papers: Optimizing Agentic Reasoning with Retrieval via Sy…

200 papers

Effective exploration is critical for reinforcement learning agents in environments with sparse rewards or high-dimensional state-action spaces. Recent works based on state-visitation counts, curiosity and entropy-maximization generate…

Machine Learning · Computer Science 2022-09-13 Bang You , Jingming Xie , Youping Chen , Jan Peters , Oleg Arenz

Masked Diffusion Models (MDMs) enable flexible decoding orders, yet existing samplers remain largely greedy, selecting locally certain tokens without accounting for their downstream effects. We show that this myopia can increase cumulative…

Computation and Language · Computer Science 2026-05-25 Kaisen Yang , Jayden Teoh , Kaicheng Yang , Yitong Zhang , Alex Lamb

This paper presents first successful steps in designing search agents that learn meta-strategies for iterative query refinement in information-seeking tasks. Our approach uses machine reading to guide the selection of refinement terms from…

Reinforcement learning with verifiable rewards (RLVR) has proven effective in eliciting complex reasoning in large language models (LLMs). However, standard RLVR training often leads to excessively verbose processes (in reasoning tasks) and…

Artificial Intelligence · Computer Science 2025-10-01 Gang Li , Yulei Qin , Xiaoyu Tan , Dingkang Yang , Yuchen Shi , Zihan Xu , Xiang Li , Xing Sun , Ke Li

Query expansion is widely used in Information Retrieval (IR) to improve search outcomes by supplementing initial queries with richer information. While recent Large Language Model (LLM) based methods generate pseudo-relevant content and…

Information Retrieval · Computer Science 2025-08-15 Wonduk Seo , Hyunjin An , Seunghyun Lee

The integration of Large Language Models (LLMs) into healthcare is constrained by knowledge limitations, hallucinations, and a disconnect from Evidence-Based Medicine (EBM). While Retrieval-Augmented Generation (RAG) offers a solution,…

Computation and Language · Computer Science 2026-02-03 Qiaoyu Zheng , Yuze Sun , Chaoyi Wu , Weike Zhao , Pengcheng Qiu , Yongguo Yu , Kun Sun , Jian Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie

The advent of large language models (LLMs) has transformed information access and reasoning through open-ended natural language interaction. However, LLMs remain limited by static knowledge, factual hallucinations, and the inability to…

Artificial Intelligence · Computer Science 2025-10-29 Minhua Lin , Zongyu Wu , Zhichao Xu , Hui Liu , Xianfeng Tang , Qi He , Charu Aggarwal , Hui Liu , Xiang Zhang , Suhang Wang

Large Language Models (LLMs) are powerful but prone to hallucinations due to static knowledge. Retrieval-Augmented Generation (RAG) helps by injecting external information, but current methods often are costly, generalize poorly, or ignore…

Computation and Language · Computer Science 2025-05-23 Huatong Song , Jinhao Jiang , Wenqing Tian , Zhipeng Chen , Yuhuan Wu , Jiahao Zhao , Yingqian Min , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

We introduce GenAgent, unifying visual understanding and generation through an agentic multimodal model. Unlike unified models that face expensive training costs and understanding-generation trade-offs, GenAgent decouples these capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kaixun Jiang , Yuzheng Wang , Junjie Zhou , Pandeng Li , Zhihang Liu , Chen-Wei Xie , Zhaoyu Chen , Yun Zheng , Wenqiang Zhang

Scientific research relies on accurate information retrieval from literature to support analytical decisions. In this work, we introduce a new task, INformation reTRieval through literAture reVIEW (IntraView), which aims to automate…

Information Retrieval · Computer Science 2026-04-28 Fengbo Ma , Zixin Rao , Xiaoting Li , Zhetao Chen , Hongyue Sun , Yiping Zhao , Xianyan Chen , Zhen Xiang

LLMs often need effective configurations, like temperature and reasoning steps, to handle tasks requiring sophisticated reasoning and problem-solving, ranging from joke generation to mathematical reasoning. Existing prompting approaches…

Artificial Intelligence · Computer Science 2025-10-13 Xiangqi Wang , Yue Huang , Yanbo Wang , Xiaonan Luo , Kehan Guo , Yujun Zhou , Xiangliang Zhang

Modern large-scale ranking systems operate within a sophisticated landscape of competing objectives, operational constraints, and evolving product requirements. Progress in this domain is increasingly bottlenecked by the engineering context…

Artificial Intelligence · Computer Science 2026-05-26 Longfei Yun , Yihan Wu , Haoran Liu , Xiaoxuan Liu , Ziyun Xu , Yi Wang , Yang Xia , Pengfei Wang , Mingze Gao , Yunxiang Wang , Changfan Chen , Wenjie Fu , Hong Yan , Junfeng Pan

We study whether self-learning can scale LLM-based agents without relying on human-curated datasets or predefined rule-based rewards. Through controlled experiments in a search-agent setting, we identify two key determinants of scalable…

Artificial Intelligence · Computer Science 2025-10-22 Wangtao Sun , Xiang Cheng , Jialin Fan , Yao Xu , Xing Yu , Shizhu He , Jun Zhao , Kang Liu

Assessing the veracity of online content has become increasingly critical. Large language models (LLMs) have recently enabled substantial progress in automated veracity assessment, including automated fact-checking and claim verification…

Computation and Language · Computer Science 2026-04-14 Yupeng Cao , Chengyang He , Yangyang Yu , Ping Wang , K. P. Subbalakshmi

For many reinforcement learning (RL) applications, specifying a reward is difficult. This paper considers an RL setting where the agent obtains information about the reward only by querying an expert that can, for example, evaluate…

Machine Learning · Computer Science 2022-02-01 David Lindner , Matteo Turchetta , Sebastian Tschiatschek , Kamil Ciosek , Andreas Krause

The role of reasoning in Audio Large Language Models remains widely underexplored, as introducing a reasoning process often degrades rather than improves performance during inference, a phenomenon we term test-time inverse scaling, where…

Machine Learning · Computer Science 2025-10-27 Jiajun Fan , Roger Ren , Jingyuan Li , Rahul Pandey , Prashanth Gurunath Shivakumar , Ivan Bulyko , Ankur Gandhe , Ge Liu , Yile Gu

Real-world user requests to LLM agents are often underspecified. Agents must interact to acquire missing information and make correct downstream decisions. However, current multi-turn GRPO-based methods often rely on trajectory-level reward…

Artificial Intelligence · Computer Science 2026-03-03 Fanqi Kong , Jiayi Zhang , Mingyi Deng , Chenglin Wu , Yuyu Luo , Bang Liu

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

Artificial Intelligence · Computer Science 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

Recent advancements in agentic test-time scaling allow models to gather environmental feedback before committing to final actions. A key limitation of existing methods is that they typically employ undifferentiated exploration strategies,…

Artificial Intelligence · Computer Science 2026-05-13 Xingyuan Hua , Sheng Yue , Ju Ren

Retrieval-Augmented Generation (RAG) systems for Large Language Models (LLMs) hold promise in knowledge-intensive tasks but face limitations in complex multi-step reasoning. While recent methods have integrated RAG with chain-of-thought…

Computation and Language · Computer Science 2025-01-15 Zhongxiang Sun , Qipeng Wang , Weijie Yu , Xiaoxue Zang , Kai Zheng , Jun Xu , Xiao Zhang , Song Yang , Han Li