English
Related papers

Related papers: Saving Dense Retriever from Shortcut Dependency in…

200 papers

Conversational search aims to retrieve passages containing essential information to answer queries in a multi-turn conversation. In conversational search, reformulating context-dependent conversational queries into stand-alone forms is…

Information Retrieval · Computer Science 2024-04-09 Yunah Jang , Kang-il Lee , Hyunkyung Bae , Hwanhee Lee , Kyomin Jung

Similar question retrieval is a core task in community-based question answering (CQA) services. To balance the effectiveness and efficiency, the question retrieval system is typically implemented as multi-stage rankers: The first-stage…

Information Retrieval · Computer Science 2021-07-20 Yinqiong Cai , Yixing Fan , Jiafeng Guo , Ruqing Zhang , Yanyan Lan , Xueqi Cheng

Conversational retrieval refers to an information retrieval system that operates in an iterative and interactive manner, requiring the retrieval of various external resources, such as persona, knowledge, and even response, to effectively…

Computation and Language · Computer Science 2024-02-29 Hongru Wang , Boyang Xue , Baohang Zhou , Rui Wang , Fei Mi , Weichao Wang , Yasheng Wang , Kam-Fai Wong

Effective information retrieval requires reasoning over partial evidence and refining strategies as information emerges. Yet current approaches fall short: neural retrievers lack reasoning capabilities, large language models (LLMs) provide…

Artificial Intelligence · Computer Science 2025-11-12 Supriti Vijay , Aman Priyanshu , Anu Vellore , Baturay Saglam , Amin Karbasi

The increasing demand for the web-based digital assistants has given a rapid rise in the interest of the Information Retrieval (IR) community towards the field of conversational question answering (ConvQA). However, one of the critical…

Computation and Language · Computer Science 2023-08-07 Munazza Zaib , Wei Emma Zhang , Quan Z. Sheng , Subhash Sagar , Adnan Mahmood , Yang Zhang

The proliferation of misinformation necessitates robust yet computationally efficient fact verification systems. While current state-of-the-art approaches leverage Large Language Models (LLMs) for generating explanatory rationales, these…

Computation and Language · Computer Science 2025-11-10 Alamgir Munir Qazi , John P. McCrae , Jamal Abdul Nasir

To obtain code snippets for reuse, programmers prefer to search for related documents, e.g., blogs or Q&A, instead of code itself. The major reason is due to the semantic diversity and mismatch between queries and code snippets. Deep…

Software Engineering · Computer Science 2020-08-18 Zhensu Sun , Yan Liu , Chen Yang , Yu Qian

Neural 'dense' retrieval models are state of the art for many datasets, however these models often exhibit limited domain transfer ability. Existing approaches to adaptation are unwieldy, such as requiring explicit supervision, complex…

Computation and Language · Computer Science 2023-11-28 Fan Jiang , Qiongkai Xu , Tom Drummond , Trevor Cohn

Inference, especially those derived from inductive processes, is a crucial component in our conversation to complement the information implicitly or explicitly conveyed by a speaker. While recent large language models show remarkable…

Computation and Language · Computer Science 2023-11-14 Etsuko Ishii , Yan Xu , Bryan Wilie , Ziwei Ji , Holy Lovenia , Willy Chung , Pascale Fung

Deep residual learning (ResNet) is a new method for training very deep neural networks using identity map-ping for shortcut connections. ResNet has won the ImageNet ILSVRC 2015 classification task, and achieved state-of-the-art performances…

Computation and Language · Computer Science 2017-07-28 Yi Yao Huang , William Yang Wang

Recent breakthrough results in compressed sensing (CS) have established that many high dimensional objects can be accurately recovered from a relatively small number of non- adaptive linear projection observations, provided that the objects…

Machine Learning · Statistics 2011-11-30 Akshay Soni , Jarvis Haupt

Memory-augmented language agents rely on embedding models for effective memory retrieval. However, existing training data construction overlooks a critical limitation: the hierarchical difficulty of negative samples and their natural…

Computation and Language · Computer Science 2026-01-22 Motong Tian , Allen P. Wong , Mingjun Mao , Wangchunshu Zhou

Conversational search provides a more convenient interface for users to search by allowing multi-turn interaction with the search engine. However, the effectiveness of the conversational dense retrieval methods is limited by the scarcity of…

Information Retrieval · Computer Science 2024-03-19 Fengran Mo , Bole Yi , Kelong Mao , Chen Qu , Kaiyu Huang , Jian-Yun Nie

Matching model is essential for Image-Text Retrieval framework. Existing research usually train the model with a triplet loss and explore various strategy to retrieve hard negative sentences in the dataset. We argue that current…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Zhihao Fan , Zhongyu Wei , Zejun Li , Siyuan Wang , Jianqing Fan

Generative retrieval employs sequence models for conditional generation of document IDs based on a query (DSI (Tay et al., 2022); NCI (Wang et al., 2022); inter alia). While this has led to improved performance in zero-shot retrieval, it is…

Information Retrieval · Computer Science 2025-02-27 Tongfei Chen , Ankita Sharma , Adam Pauls , Benjamin Van Durme

Recent advances in open-domain QA have led to strong models based on dense retrieval, but only focused on retrieving textual passages. In this work, we tackle open-domain QA over tables for the first time, and show that retrieval can be…

Computation and Language · Computer Science 2021-06-10 Jonathan Herzig , Thomas Müller , Syrine Krichene , Julian Martin Eisenschlos

We propose Latent Terms, a method revealing that models trained for dense retrieval, whether single- or multi-vector, learn representations that can trivially be decomposed into retrieval-ready sparse features. When trained on frozen…

Information Retrieval · Computer Science 2026-05-29 Benjamin Clavié , Sean Lee , Aamir Shakir , Makoto P. Kato

Using large language models (LMs) for query or document expansion can improve generalization in information retrieval. However, it is unknown whether these techniques are universally beneficial or only effective in specific settings, such…

Information Retrieval · Computer Science 2024-02-28 Orion Weller , Kyle Lo , David Wadden , Dawn Lawrie , Benjamin Van Durme , Arman Cohan , Luca Soldaini

Research on interference has provided evidence that the formation of dependencies between non-adjacent words relies on a cue-based retrieval mechanism. Two different models can account for one of the main predictions of interference, i.e.,…

Computation and Language · Computer Science 2017-08-25 Bruno Nicenboim , Shravan Vasishth

Recently, retrieval systems based on dense representations have led to important improvements in open-domain question answering, and related tasks. While very effective, this approach is also memory intensive, as the dense vectors for the…

Computation and Language · Computer Science 2021-01-01 Gautier Izacard , Fabio Petroni , Lucas Hosseini , Nicola De Cao , Sebastian Riedel , Edouard Grave