中文
相关论文

相关论文: Mr. TyDi: A Multi-lingual Benchmark for Dense Retr…

200 篇论文

Retrieval models based on dense representations in semantic space have become an indispensable branch for first-stage retrieval. These retrievers benefit from surging advances in representation learning towards compressive global…

计算与语言 · 计算机科学 2023-03-06 Kai Zhang , Chongyang Tao , Tao Shen , Can Xu , Xiubo Geng , Binxing Jiao , Daxin Jiang

Multilingual models have been widely used for cross-lingual transfer to low-resource languages. However, the performance on these languages is hindered by their underrepresentation in the pretraining data. To alleviate this problem, we…

计算与语言 · 计算机科学 2023-05-29 Tomasz Limisiewicz , Dan Malkin , Gabriel Stanovsky

The unbiased learning to rank (ULTR) problem has been greatly advanced by recent deep learning techniques and well-designed debias algorithms. However, promising results on the existing benchmark datasets may not be extended to the…

人工智能 · 计算机科学 2022-09-21 Lixin Zou , Haitao Mao , Xiaokai Chu , Jiliang Tang , Wenwen Ye , Shuaiqiang Wang , Dawei Yin

Dense passage retrieval (DPR) is the first step in the retrieval augmented generation (RAG) paradigm for improving the performance of large language models (LLM). DPR fine-tunes pre-trained networks to enhance the alignment of the…

计算与语言 · 计算机科学 2024-10-07 Benjamin Reichman , Larry Heck

We propose RaDeR, a set of reasoning-based dense retrieval models trained with data derived from mathematical problem solving using large language models (LLMs). Our method leverages retrieval-augmented reasoning trajectories of an LLM and…

计算与语言 · 计算机科学 2025-05-28 Debrup Das , Sam O' Nuallain , Razieh Rahimi

Words have been represented in a high-dimensional vector space that encodes their semantic similarities, enabling downstream applications such as retrieving synonyms, antonyms, and relevant contexts. However, despite recent advances in…

计算与语言 · 计算机科学 2024-09-25 Genta Indra Winata , Ruochen Zhang , David Ifeoluwa Adelani

Multilingual text-video retrieval methods have improved significantly in recent years, but the performance for other languages lags behind English. We propose a Cross-Lingual Cross-Modal Knowledge Distillation method to improve multilingual…

Despite their recent popularity and well-known advantages, dense retrievers still lag behind sparse methods such as BM25 in their ability to reliably match salient phrases and rare entities in the query and to generalize to out-of-domain…

While large language models (LLMs) are increasingly deployed as dense retrievers, the impact of their domain-specific specialization on retrieval effectiveness remains underexplored. This investigation systematically examines how…

信息检索 · 计算机科学 2025-08-07 Hengran Zhang , Keping Bi , Jiafeng Guo

Cross-lingual representations have the potential to make NLP techniques available to the vast majority of languages in the world. However, they currently require large pretraining corpora or access to typologically similar languages. In…

计算与语言 · 计算机科学 2021-06-22 Wei Zhao , Steffen Eger , Johannes Bjerva , Isabelle Augenstein

Despite the recent developments in the field of cross-modal retrieval, there has been less research focusing on low-resource languages due to the lack of manually annotated datasets. In this paper, we propose a noise-robust cross-lingual…

计算机视觉与模式识别 · 计算机科学 2022-08-29 Yabing Wang , Jianfeng Dong , Tianxiang Liang , Minsong Zhang , Rui Cai , Xun Wang

Literature search questions, such as "Where can I find research on the evaluation of consistency in generated summaries?" pose significant challenges for modern search engines and retrieval systems. These questions often require a deep…

信息检索 · 计算机科学 2024-10-18 Anirudh Ajith , Mengzhou Xia , Alexis Chevalier , Tanya Goyal , Danqi Chen , Tianyu Gao

Recent advance in Dense Retrieval (DR) techniques has significantly improved the effectiveness of first-stage retrieval. Trained with large-scale supervised data, DR models can encode queries and documents into a low-dimensional dense space…

信息检索 · 计算机科学 2022-08-18 Jingtao Zhan , Qingyao Ai , Yiqun Liu , Jiaxin Mao , Xiaohui Xie , Min Zhang , Shaoping Ma

Multimodal retrieval is becoming a crucial component of modern AI applications, yet its evaluation lags behind the demands of more realistic and challenging scenarios. Existing benchmarks primarily probe surface-level semantic…

This paper presents a fully self-supervised approach to borrowing detection in multilingual wordlists. The method combines two sources of information: PMI similarities based on a global correspondence model and a lightweight contrastive…

计算与语言 · 计算机科学 2025-12-02 Tim Wientzek

Most organizational data in this world are stored as documents, and visual retrieval plays a crucial role in unlocking the collective intelligence from all these documents. However, existing benchmarks focus on English-only document…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Jian Chen , Ming Li , Jihyung Kil , Chenguang Wang , Tong Yu , Ryan Rossi , Tianyi Zhou , Changyou Chen , Ruiyi Zhang

Dense retrieval has achieved impressive advances in first-stage retrieval from a large-scale document collection, which is built on bi-encoder architecture to produce single vector representation of query and document. However, a document…

计算与语言 · 计算机科学 2022-03-17 Shunyu Zhang , Yaobo Liang , Ming Gong , Daxin Jiang , Nan Duan

This paper describes a compact and effective model for low-latency passage retrieval in conversational search based on learned dense representations. Prior to our work, the state-of-the-art approach uses a multi-stage pipeline comprising…

信息检索 · 计算机科学 2021-11-30 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Dense retrieval (DR) approaches based on powerful pre-trained language models (PLMs) achieved significant advances and have become a key component for modern open-domain question-answering systems. However, they require large amounts of…

计算与语言 · 计算机科学 2022-08-08 Xiaoyu Shen , Svitlana Vakulenko , Marco del Tredici , Gianni Barlacchi , Bill Byrne , Adrià de Gispert

Recent research demonstrates the effectiveness of using pretrained language models (PLM) to improve dense retrieval and multilingual dense retrieval. In this work, we present a simple but effective monolingual pretraining task called…

信息检索 · 计算机科学 2022-06-08 Ning Wu , Yaobo Liang , Houxing Ren , Linjun Shou , Nan Duan , Ming Gong , Daxin Jiang