English
Related papers

Related papers: Rethinking Reasoning in Document Ranking: Why Chai…

200 papers

Ranking relevance is a fundamental task in search engines, aiming to identify the items most relevant to a given user query. Traditional relevance models typically produce scalar scores or directly predict relevance labels, limiting both…

Information Retrieval · Computer Science 2025-12-30 Ziyang Zeng , Heming Jing , Jindong Chen , Xiangli Li , Hongyu Liu , Yixuan He , Zhengyu Li , Yige Sun , Zheyong Xie , Yuqing Yang , Shaosheng Cao , Jun Fan , Yi Wu , Yao Hu

Large Reasoning Models (LRMs) excel at complex tasks using Chain-of-Thought (CoT) reasoning. However, their tendency to overthinking leads to unnecessarily lengthy reasoning chains, dramatically increasing inference costs. To mitigate this…

Machine Learning · Computer Science 2025-05-26 Zigeng Chen , Xinyin Ma , Gongfan Fang , Ruonan Yu , Xinchao Wang

Generative LLMs typically improve Named Entity Recognition (NER) performance through instruction tuning. They excel at generating entities by semantic pattern matching but lack an explicit, verifiable reasoning mechanism. This "cognitive…

Computation and Language · Computer Science 2025-11-18 Hui Huang , Yanping Chen , Ruizhang Huang , Chuan Lin , Yongbin Qin

Large Language Models (LLMs) have shown remarkable capabilities in reasoning, exemplified by the success of OpenAI-o1 and DeepSeek-R1. However, integrating reasoning with external search processes remains challenging, especially for complex…

Agentic search -- the task of training agents that iteratively reason, issue queries, and synthesize retrieved information to answer complex questions -- has achieved remarkable progress through reinforcement learning (RL). However,…

Artificial Intelligence · Computer Science 2026-04-23 Hansi Zeng , Liam Collins , Bhuvesh Kumar , Neil Shah , Hamed Zamani

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

State-of-the-art large language models (LLMs) exhibit impressive problem-solving capabilities but may struggle with complex reasoning and factual correctness. Existing methods harness the strengths of chain-of-thought and…

Computation and Language · Computer Science 2024-10-03 Xingxuan Li , Weiwen Xu , Ruochen Zhao , Fangkai Jiao , Shafiq Joty , Lidong Bing

Training Large Language Models (LLMs) for chain-of-thought reasoning presents a significant challenge: supervised fine-tuning on a single "golden" rationale hurts generalization as it penalizes equally valid alternatives, whereas…

Computation and Language · Computer Science 2025-11-14 Mingye Zhu , Yi Liu , Zheren Fu , Quan Wang , Yongdong Zhang

With the improving semantic understanding capability of Large Language Models (LLMs), they exhibit a greater awareness and alignment with human values, but this comes at the cost of transparency. Although promising results are achieved via…

Computation and Language · Computer Science 2026-05-27 Nafis Tanveer Islam , Zhiming Zhao

Existing works of reasoning segmentation often fall short in complex cases, particularly when addressing complicated queries and out-of-domain images. Inspired by the chain-of-thought reasoning, where harder problems require longer thinking…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Shiu-hong Kao , Chak Ho Huang , Huaiqian Liu , Yu-Wing Tai , Chi-Keung Tang

With the growing popularity of LLM agents and RAG, it has become increasingly important to retrieve documents that are essential for solving a task, even when their connection to the task is indirect or implicit. Addressing this problem…

Information Retrieval · Computer Science 2025-10-14 Junwei Lan , Jianlyu Chen , Zheng Liu , Chaofan Li , Siqi Bao , Defu Lian

While Long Chain-of-Thought (Long CoT) reasoning has shown promise in Large Language Models (LLMs), its adoption for enhancing recommendation quality is growing rapidly. In this work, we critically examine this trend and argue that Long CoT…

Information Retrieval · Computer Science 2026-02-03 Hongxun Ding , Keqin Bao , Jizhi Zhang , Yi Fang , Wenxin Xu , Fuli Feng , Xiangnan He

Reranking algorithms have made progress in improving document retrieval quality by efficiently aggregating relevance judgments generated by large language models (LLMs). However, identifying relevant documents for queries that require…

Information Retrieval · Computer Science 2025-11-04 Jerry Huang , Siddarth Madala , Cheng Niu , Julia Hockenmaier , Tong Zhang

Large reasoning models (LRMs) exhibit unprecedented capabilities in solving complex problems through Chain-of-Thought (CoT) reasoning. However, recent studies reveal that their final answers often contradict their own reasoning traces. We…

Artificial Intelligence · Computer Science 2026-03-03 Yuhui Wang , Changjiang Li , Guangke Chen , Jiacheng Liang , Ting Wang

Large Reasoning Models (LRMs) have shown remarkable reasoning capabilities, yet they often suffer from overthinking, expending redundant computational steps on simple problems, or underthinking, failing to explore sufficient reasoning paths…

Artificial Intelligence · Computer Science 2026-04-03 Yulin Li , Tengyao Tu , Li Ding , Junjie Wang , Huiling Zhen , Yixin Chen , Yong Li , Zhuotao Tian

Search engines are crucial as they provide an efficient and easy way to access vast amounts of information on the internet for diverse information needs. User queries, even with a specific need, can differ significantly. Prior research has…

Information Retrieval · Computer Science 2023-12-27 Xiaopeng Li , Lixin Su , Pengyue Jia , Xiangyu Zhao , Suqi Cheng , Junfeng Wang , Dawei Yin

Long chain-of-thought (CoT) significantly enhances the reasoning capabilities of large language models (LLMs). However, extensive reasoning traces lead to inefficiencies and increased time-to-first-token (TTFT). We propose a training…

Computation and Language · Computer Science 2026-01-08 Roy Xie , David Qiu , Deepak Gopinath , Dong Lin , Yanchao Sun , Chong Wang , Saloni Potdar , Bhuwan Dhingra

Large Language Models (LLMs) have shown remarkable performance on complex reasoning tasks, especially when equipped with long chain-of-thought (CoT) reasoning. However, eliciting long CoT typically requires large-scale reinforcement…

Computation and Language · Computer Science 2026-01-30 Huiyuan Lai , Malvina Nissim

Rerankers play a pivotal role in refining retrieval results for Retrieval-Augmented Generation. However, current reranking models are typically optimized on static human annotated relevance labels in isolation, decoupled from the downstream…

Computation and Language · Computer Science 2026-04-03 Yuhang Wu , Xiangqing Shen , Fanfan Wang , Cangqi Zhou , Zhen Wu , Xinyu Dai , Rui Xia

Deep research agents rely on iterative retrieval and reasoning to answer complex queries, but scaling test-time computation raises significant efficiency concerns. We study how to allocate reasoning budget in deep search pipelines, focusing…

Information Retrieval · Computer Science 2026-01-21 Sahel Sharifymoghaddam , Jimmy Lin