English
Related papers

Related papers: Empowering Dual-Encoder with Query Generator for C…

200 papers

Entity Linking has two main open areas of research: 1) generate candidate entities without using alias tables and 2) generate more contextual representations for both mentions and entities. Recently, a solution has been proposed for the…

Computation and Language · Computer Science 2020-04-08 Oshin Agarwal , Daniel M. Bikel

In the recent years, the dual-encoder vision-language models (\eg CLIP) have achieved remarkable text-to-image retrieval performance. However, we discover that these models usually results in very different retrievals for a pair of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jiacheng Cheng , Hijung Valentina Shin , Nuno Vasconcelos , Bryan Russell , Fabian Caba Heilbron

This paper presents our system for SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval. In an era where misinformation spreads rapidly, effective fact-checking is increasingly critical. We introduce TriAligner, a…

In this paper, we propose a new dense retrieval model which learns diverse document representations with deep query interactions. Our model encodes each document with a set of generated pseudo-queries to get query-informed, multi-view…

Information Retrieval · Computer Science 2022-08-09 Zehan Li , Nan Yang , Liang Wang , Furu Wei

Recent work has shown that more effective dense retrieval models can be obtained by distilling ranking knowledge from an existing base re-ranking model. In this paper, we propose a generic curriculum learning based optimization framework…

Information Retrieval · Computer Science 2022-04-29 Hansi Zeng , Hamed Zamani , Vishwa Vinay

We present an approach to ranking with dense representations that applies knowledge distillation to improve the recently proposed late-interaction ColBERT model. Specifically, we distill the knowledge from ColBERT's expressive MaxSim…

Information Retrieval · Computer Science 2020-10-23 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Dense retrieval models use bi-encoder network architectures for learning query and document representations. These representations are often in the form of a vector representation and their similarities are often computed using the dot…

Information Retrieval · Computer Science 2023-05-01 Hamed Zamani , Michael Bendersky

Rerankers play a critical role in multimodal Retrieval-Augmented Generation (RAG) by refining ranking of an initial set of retrieved documents. Rerankers are typically trained using hard negative mining, whose goal is to select pages for…

Information Retrieval · Computer Science 2025-05-29 Navve Wasserman , Oliver Heinimann , Yuval Golbari , Tal Zimbalist , Eli Schwartz , Michal Irani

Dense retrievers in retrieval-augmented generation (RAG) systems exhibit systematic biases -- including brevity, position, literal matching, and repetition biases -- that can compromise retrieval quality. Query rewriting techniques are now…

Information Retrieval · Computer Science 2026-04-21 Agam Goyal , Koyel Mukherjee , Apoorv Saxena , Anirudh Phukan , Eshwar Chandrasekharan , Hari Sundaram

Multilingual text-video retrieval methods have improved significantly in recent years, but the performance for other languages lags behind English. We propose a Cross-Lingual Cross-Modal Knowledge Distillation method to improve multilingual…

This paper proposes an approach to cross-language sentence selection in a low-resource setting. It uses data augmentation and negative sampling techniques on noisy parallel sentence data to directly learn a cross-lingual embedding-based…

Computation and Language · Computer Science 2021-06-07 Yanda Chen , Chris Kedzie , Suraj Nair , Petra Galuščáková , Rui Zhang , Douglas W. Oard , Kathleen McKeown

Retrieval of previously fact-checked claims is a well-established task, whose automation can assist professional fact-checkers in the initial steps of information verification. Previous works have mostly tackled the task monolingually,…

Computation and Language · Computer Science 2025-09-23 Alan Ramponi , Marco Rovera , Robert Moro , Sara Tonelli

Dense Retrieval (DR) models have proven to be effective for Document Retrieval and Information Grounding tasks. Usually, these models are trained and optimized for improving the relevance of top-ranked documents for a given query. Previous…

Information Retrieval · Computer Science 2025-08-12 Stefano Campese , Alessandro Moschitti , Ivano Lauriola

In various natural language processing tasks, passage retrieval and passage re-ranking are two key procedures in finding and ranking relevant information. Since both the two procedures contribute to the final performance, it is important to…

Computation and Language · Computer Science 2023-04-25 Ruiyang Ren , Yingqi Qu , Jing Liu , Wayne Xin Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Ji-Rong Wen

Pre-trained code models have emerged as the state-of-the-art paradigm for code search tasks. The paradigm involves pre-training the model on search-irrelevant tasks such as masked language modeling, followed by the fine-tuning stage, which…

Software Engineering · Computer Science 2024-11-25 Hande Dong , Jiayi Lin , Yanlin Wang , Yichong Leng , Jiawei Chen , Yutao Xie

Multilingual generative models obtain remarkable cross-lingual in-context learning capabilities through pre-training on large-scale corpora. However, they still exhibit a performance bias toward high-resource languages and learn isolated…

Computation and Language · Computer Science 2024-06-13 Chong Li , Shaonan Wang , Jiajun Zhang , Chengqing Zong

To ensure large language models (LLMs) are used safely, one must reduce their propensity to hallucinate or to generate unacceptable answers. A simple and often used strategy is to first let the LLM generate multiple hypotheses and then…

Computation and Language · Computer Science 2025-02-12 António Farinhas , Haau-Sing Li , André F. T. Martins

Modern search systems use several large ranker models with transformer architectures. These models require large computational resources and are not suitable for usage on devices with limited computational resources. Knowledge distillation…

Tool retrieval over large API catalogs is a core bottleneck for LLM agents: user queries arrive in colloquial, often underspecified language, while the catalog uses technical API vocabulary that no fixed encoder can bridge on its own. The…

Artificial Intelligence · Computer Science 2026-05-29 Vaishali Senthil , Ashutosh Hathidara , Sebastian Schreiber

Multiple-choice questions (MCQs) are commonly used across all levels of math education since they can be deployed and graded at a large scale. A critical component of MCQs is the distractors, i.e., incorrect answers crafted to reflect…

Computers and Society · Computer Science 2024-05-15 Alexander Scarlatos , Wanyong Feng , Digory Smith , Simon Woodhead , Andrew Lan