English
Related papers

Related papers: Integrating Chain-of-Thought into Generative Retri…

200 papers

The complex reasoning ability of Large Language Models (LLMs) poses a critical bottleneck for their practical applications. Test-time expansion methods such as Tree-of-Thought (ToT) and Graph-of-Thought (GoT) enhance reasoning by…

Computation and Language · Computer Science 2025-12-01 Yujiao Yang , Jing Lian , Linhui Li

Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round retrieval and reasoning to resolve queries. Although recent…

Information Retrieval · Computer Science 2025-11-10 Chao Zhang , Yuhao Wang , Derong Xu , Haoxin Zhang , Yuanjie Lyu , Yuhao Chen , Shuochen Liu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

Chain of thought (CoT) elicits reasoning in large language models by explicitly generating intermediate tokens. In contrast, latent thought reasoning operates directly in the continuous latent space, enabling computation beyond discrete…

Artificial Intelligence · Computer Science 2026-05-13 Kevin Xu , Issei Sato

With the rapid development of code intelligence, the application of multiple programming languages is becoming increasingly widespread. However, most existing code generation models mainly focus on a single or a few programming languages,…

Software Engineering · Computer Science 2025-04-28 Naizhu Jin , Zhong Li , Tian Zhang , Qingkai Zeng

Knowledge-intensive tasks, particularly open-domain question answering (ODQA), document reranking, and retrieval-augmented language modeling, require a balance between retrieval accuracy and generative flexibility. Traditional retrieval…

Computation and Language · Computer Science 2025-02-28 Abdelrahman Abdallah , Jamshid Mozafari , Bhawna Piryani , Mohammed Ali , Adam Jatowt

Long-horizon personalization requires dialogue assistants to retrieve user-specific facts from extended interaction histories. In practice, many relevant facts often have low semanticsimilarity to the query under dense retrieval. Standard…

Information Retrieval · Computer Science 2026-05-15 Harshita Chopra , Krishna Kant Chintalapudi , Suman Nath , Ryen W. White , Chirag Shah

Graph Retrieval-Augmented Generation (GraphRAG) enhances factual reasoning in LLMs by structurally modeling knowledge through graph-based representations. However, existing GraphRAG approaches face two core limitations: shallow retrieval…

Computation and Language · Computer Science 2025-10-01 Cehao Yang , Xiaojun Wu , Xueyuan Lin , Chengjin Xu , Xuhui Jiang , Yuanliang Sun , Jia Li , Hui Xiong , Jian Guo

Retrieval-Augmented Generation (RAG) integrates external knowledge with Large Language Models (LLMs) to enhance factual correctness and mitigate hallucination. However, dense retrievers often become the bottleneck of RAG systems due to…

Computation and Language · Computer Science 2025-10-27 Yuan Li , Qi Luo , Xiaonan Li , Bufan Li , Qinyuan Cheng , Bo Wang , Yining Zheng , Yuxin Wang , Zhangyue Yin , Xipeng Qiu

Retrieval-augmented generation (RAG) equips large language models (LLMs) with reliable knowledge memory. To strengthen cross-text associations, recent research integrates graphs and hypergraphs into RAG to capture pairwise and multi-entity…

Information Retrieval · Computer Science 2026-02-10 Xingliang Hou , Yuyan Liu , Qi Sun , haoxiu wang , Hao Hu , Shaoyi Du , Zhiqiang Tian

Chain-of-Thought (CoT) prompting often improves classification accuracy, but it introduces a significant throughput penalty with rationale generation (Wei et al., 2022; Cheng and Van Durme, 2024). To resolve this trade-off, we introduce…

Computation and Language · Computer Science 2025-09-30 Jillian Xu , Dylan Zhou , Vinay Shukla , Yang Yang , Junrui Ruan , Shuhuai Lin , Wenfei Zou , Yinxiao Liu , Karthik Lakshmanan

Large Multimodal Models (LMMs) face limitations in geometric reasoning due to insufficient Chain of Thought (CoT) image-text training data. While existing approaches leverage template-based or LLM-assisted methods for geometric CoT data…

Artificial Intelligence · Computer Science 2025-06-02 Linger Deng , Linghao Zhu , Yuliang Liu , Yu Wang , Qunyi Xie , Jingjing Wu , Gang Zhang , Yingying Zhu , Xiang Bai

Chain-of-Thought (CoT) prompting enables complex reasoning in large language models (LLMs), including applications in information retrieval (IR). However, it often leads to overthinking, where models produce excessively long and…

Information Retrieval · Computer Science 2025-05-30 Dohyeon Lee , Yeonseok Jeong , Seung-won Hwang

Chain-of-Thought (CoT) technique has proven effective in improving the performance of large language models (LLMs) on complex reasoning tasks. However, the performance gains are inconsistent across different tasks, and the underlying…

Computation and Language · Computer Science 2025-06-09 Peijie Liu , Fengli Xu , Yong Li

The classical cascading pipeline of retrieve--rerank suffers from a bounded recall problem, stemming from limitations of the first-stage retriever. Most current approaches address the bounded recall problem by improving the first-stage…

Information Retrieval · Computer Science 2026-05-01 Mandeep Rathee , V Venktesh , Sean MacAvaney , Avishek Anand

Code generation, the task of creating executable programs from natural language requirements, has recently seen tremendous advances through Chain-of-Thought (CoT) reasoning, which enables Large Language Models (LLMs) to develop high-level…

Software Engineering · Computer Science 2025-10-21 Shuzheng Gao , Chaozheng Wang , Cuiyun Gao , Michael R. Lyu

Implicit Chain-of-Thought (CoT) reduces the inference cost of large language models by internalizing the explicit rationales. However, existing approaches typically lack alignment with explicit rationales and adaptivity to example…

Computation and Language · Computer Science 2026-05-28 Yukyung Lee , Yumeng Shen , Jinhyeong Park , Hyein Yang , Jun-Hyung Park

While end-to-end video-to-audio generation has greatly improved, producing high-fidelity audio that authentically captures the nuances of visual content remains challenging. Like professionals in the creative industries, this generation…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-06 Huadai Liu , Kaicheng Luo , Jialei Wang , Wen Wang , Qian Chen , Zhou Zhao , Wei Xue

Graph-based retrieval-augmented generation (RAG) enriches large language models (LLMs) with external knowledge for long-context understanding and multi-hop reasoning, but existing methods face a granularity dilemma: fine-grained…

Computation and Language · Computer Science 2025-09-26 Yaxiong Wu , Jianyuan Bo , Yongyue Zhang , Sheng Liang , Yong Liu

Retrieval-Augmented Generation (RAG) enhances the response quality and domain-specific performance of large language models (LLMs) by incorporating external knowledge to combat hallucinations. In recent research, graph structures have been…

Information Retrieval · Computer Science 2025-12-17 Hao Hu , Yifan Feng , Ruoxue Li , Rundong Xue , Xingliang Hou , Zhiqiang Tian , Yue Gao , Shaoyi Du

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai