English
Related papers

Related papers: CorpusBrain: Pre-train a Generative Retrieval Mode…

200 papers

We revisit retrieval-augmented generation (RAG) by embedding retrieval control directly into generation. Instead of treating retrieval as an external intervention, we express retrieval decisions within token-level decoding, enabling…

Computation and Language · Computer Science 2026-04-21 Bo Li , Mingda Wang , Gexiang Fang , Shikun Zhang , Wei Ye

The core of information retrieval (IR) is to identify relevant information from large-scale resources and return it as a ranked list to respond to the user's information need. In recent years, the resurgence of deep learning has greatly…

Information Retrieval · Computer Science 2022-04-26 Yixing Fan , Xiaohui Xie , Yinqiong Cai , Jia Chen , Xinyu Ma , Xiangsheng Li , Ruqing Zhang , Jiafeng Guo

Multi-hop question answering is a challenging task in which language models must reason over multiple steps to reach the correct answer. With the help of Large Language Models and their reasoning capabilities, existing systems are able to…

Machine Learning · Computer Science 2025-12-08 Durga Prasad Maram , Kalpa Gunaratna , Vijay Srinivasan , Haris Jeelani , Srinivas Chappidi

Recent research has shown that mixed-initiative conversational search, based on the interaction between users and computers to clarify and improve a query, provides enormous advantages. Nonetheless, incorporating additional information…

Computation and Language · Computer Science 2021-09-23 Oleg Borisov , Mohammad Aliannejadi , Fabio Crestani

Machine learning (ML) holds great promise for clinical applications but is often hindered by limited access to high-quality data due to privacy concerns, high costs, and long timelines associated with clinical trials. While large language…

Computation and Language · Computer Science 2026-03-27 Zerui Xu , Fang Wu , Yingzhou Lu , Yuanyuan Zhang , Yue Zhao

The central challenge of reasoning-intensive retrieval lies in identifying implicitreasoning relationships between queries and documents, rather than superficial se-mantic or lexical similarity. The contrastive learning paradigm is…

Information Retrieval · Computer Science 2026-03-19 Guangzhi Wang , Yinghao Jiao , Zhi Liu

Retrieval-Augmented Generation (RAG) improves the reliability of large language model applications by grounding generation in retrieved evidence, but it also introduces a new attack surface: corpus poisoning. In this setting, an adversary…

Artificial Intelligence · Computer Science 2026-03-31 Xiangyu Yin , Yi Qi , Chih-Hong Cheng

Image-text retrieval (ITR) is a task to retrieve the relevant images/texts, given the query from another modality. The conventional dense retrieval paradigm relies on encoding images and texts into dense representations using dual-stream…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Ziyang luo , Pu Zhao , Can Xu , Xiubo Geng , Tao Shen , Chongyang Tao , Jing Ma , Qingwen lin , Daxin Jiang

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

Large language models have shown impressive few-shot results on a wide range of tasks. However, when knowledge is key for such results, as is the case for tasks such as question answering and fact checking, massive parameter counts to store…

Recent advancements in large language models have intensified the need for efficient and deployable models within limited inference budgets. Structured pruning pipelines have shown promise in token efficiency compared to training…

Computation and Language · Computer Science 2025-03-11 Yixiao Li , Xianzhi Du , Ajay Jaiswal , Tao Lei , Tuo Zhao , Chong Wang , Jianyu Wang

Image retrieval remains a fundamental yet challenging problem in computer vision. While recent advances in Multimodal Large Language Models (MLLMs) have demonstrated strong reasoning capabilities, existing methods typically employ them only…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shangrong Wu , Yanghong Zhou , Yang Chen , Feng Zhang , P. Y. Mok

Until recently, search engines were the predominant method for people to access online information. The recent emergence of large language models (LLMs) has given machines new capabilities such as the ability to generate new digital…

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

Computation and Language · Computer Science 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

Multilingual generative models obtain remarkable cross-lingual in-context learning capabilities through pre-training on large-scale corpora. However, they still exhibit a performance bias toward high-resource languages and learn isolated…

Computation and Language · Computer Science 2024-06-13 Chong Li , Shaonan Wang , Jiajun Zhang , Chengqing Zong

Large Language Models have brought a radical change in the process of remote learning students, among other aspects of educative activities. Current retrieval of remote learning resources lacks depth in contextual meaning that provides…

Human-Computer Interaction · Computer Science 2025-06-19 Wenqi Guan , Yang Fang

Large language models have demonstrated impressive reasoning capabilities but are inherently limited by their knowledge reservoir. Retrieval-augmented reasoning mitigates this limitation by allowing LLMs to query external resources, but…

Computation and Language · Computer Science 2025-09-22 Yaorui Shi , Sihang Li , Chang Wu , Zhiyuan Liu , Junfeng Fang , Hengxing Cai , An Zhang , Xiang Wang

A multi-turn dialogue always follows a specific topic thread, and topic shift at the discourse level occurs naturally as the conversation progresses, necessitating the model's ability to capture different topics and generate topic-aware…

Computation and Language · Computer Science 2021-09-14 Hongru Wang , Mingyu Cui , Zimo Zhou , Gabriel Pui Cheong Fung , Kam-Fai Wong

Knowledge graphs, as the cornerstone of many AI applications, usually face serious incompleteness problems. In recent years, there have been many efforts to study automatic knowledge graph completion (KGC), most of which use existing…

Computation and Language · Computer Science 2022-10-13 Xin Lv , Yankai Lin , Zijun Yao , Kaisheng Zeng , Jiajie Zhang , Lei Hou , Juanzi Li

Large Language Models (LLMs) have demonstrated impressive ability in generation and reasoning tasks but struggle with handling up-to-date knowledge, leading to inaccuracies or hallucinations. Retrieval-Augmented Generation (RAG) mitigates…

Databases · Computer Science 2026-03-13 Ziting Wang , Haitao Yuan , Wei Dong , Gao Cong , Feifei Li