English
Related papers

Related papers: Jina-ColBERT-v2: A General-Purpose Multilingual La…

200 papers

Pre-trained language models are increasingly important components across multiple information retrieval (IR) paradigms. Late interaction, introduced with the ColBERT model and recently refined in ColBERTv2, is a popular paradigm that holds…

Information Retrieval · Computer Science 2022-05-20 Keshav Santhanam , Omar Khattab , Christopher Potts , Matei Zaharia

While question-like queries are gaining popularity and search engines' users increasingly adopt them, keyphrase search has traditionally been the cornerstone of web search. This query type is also prevalent in specialised search tasks such…

Information Retrieval · Computer Science 2024-12-05 Jorge Gabín , Javier Parapar , Craig Macdonald

Neural Information Retrieval has advanced rapidly in high-resource languages, but progress in lower-resource ones such as Japanese has been hindered by data scarcity, among other challenges. Consequently, multilingual models have dominated…

Information Retrieval · Computer Science 2024-07-31 Benjamin Clavié

Dense retrieval models using a transformer-based bi-encoder design have emerged as an active area of research. In this work, we focus on the task of monolingual retrieval in a variety of typologically diverse languages using one such…

Information Retrieval · Computer Science 2022-04-06 Xinyu Zhang , Kelechi Ogueji , Xueguang Ma , Jimmy Lin

Late-interaction models such as ColBERT offer competitive performance across various retrieval tasks but require storing a dense embedding for each document token, leading to a substantial index storage overhead. Past works address this by…

Information Retrieval · Computer Science 2026-05-12 Yash Kankanampati , Yuxuan Zong , Nadi Tomeh , Benjamin Piwowarski , Joseph Le Roux

A lot of recent work has focused on sparse learned indexes that use deep neural architectures to significantly improve retrieval quality while keeping the efficiency benefits of the inverted index. While such sparse learned structures…

Information Retrieval · Computer Science 2024-07-09 Soyuj Basnet , Jerry Gou , Antonio Mallia , Torsten Suel

The recent mainstream adoption of large language model (LLM) technology is enabling novel applications in the form of chatbots and virtual assistants across many domains. With the aim of grounding LLMs in trusted domains and avoiding the…

Computation and Language · Computer Science 2025-07-08 Antoine Nzeyimana , Andre Niyongabo Rubungo

Interactive and non-interactive model are the two de-facto standard frameworks in vector-based cross-lingual information retrieval (V-CLIR), which embed queries and documents in synchronous and asynchronous fashions, respectively. From the…

Computation and Language · Computer Science 2021-11-04 Linlong Xu , Baosong Yang , Xiaoyu Lv , Tianchi Bi , Dayiheng Liu , Haibo Zhang

Multi-vector retrieval methods, exemplified by the ColBERT architecture, have shown substantial promise for retrieval by providing strong trade-offs in terms of retrieval latency and effectiveness. However, they come at a high cost in terms…

Information Retrieval · Computer Science 2025-04-03 Sean MacAvaney , Antonio Mallia , Nicola Tonellotto

Conversational search requires accurate interpretation of user intent from complex multi-turn contexts. This paper presents ChatRetriever, which inherits the strong generalization capability of large language models to robustly represent…

Information Retrieval · Computer Science 2024-04-23 Kelong Mao , Chenlong Deng , Haonan Chen , Fengran Mo , Zheng Liu , Tetsuya Sakai , Zhicheng Dou

Conversational search provides a natural interface for information retrieval (IR). Recent approaches have demonstrated promising results in applying dense retrieval to conversational IR. However, training dense retrievers requires large…

Computation and Language · Computer Science 2023-09-14 Chao-Wei Huang , Chen-Yu Hsu , Tsu-Yuan Hsu , Chen-An Li , Yun-Nung Chen

Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method called dense retrieval.…

Information Retrieval · Computer Science 2025-03-25 Ahmed H. Salamah , Pierre McWhannel , Nicole Yan

Neural models that independently project questions and answers into a shared embedding space allow for efficient continuous space retrieval from large corpora. Independently computing embeddings for questions and answers results in late…

Computation and Language · Computer Science 2020-09-30 Yinfei Yang , Ning Jin , Kuo Lin , Mandy Guo , Daniel Cer

Passage retrieval is a fundamental task in many information systems, such as web search and question answering, where both efficiency and effectiveness are critical concerns. In recent years, neural retrievers based on pre-trained language…

Information Retrieval · Computer Science 2024-03-21 Qian Dong , Yiding Liu , Qingyao Ai , Haitao Li , Shuaiqiang Wang , Yiqun Liu , Dawei Yin , Shaoping Ma

Pretrained language models like BERT and T5 serve as crucial backbone encoders for dense retrieval. However, these models often exhibit limited generalization capabilities and face challenges in improving in domain accuracy. Recent research…

Computation and Language · Computer Science 2024-08-26 Kun Luo , Minghao Qin , Zheng Liu , Shitao Xiao , Jun Zhao , Kang Liu

Conversational dense retrieval has shown to be effective in conversational search. However, a major limitation of conversational dense retrieval is their lack of interpretability, hindering intuitive understanding of model behaviors for…

Information Retrieval · Computer Science 2024-06-04 Yiruo Cheng , Kelong Mao , Zhicheng Dou

It is known that a deep neural network model pre-trained with large-scale data greatly improves the accuracy of various tasks, especially when there are resource constraints. However, the information needed to solve a given task can vary,…

Computation and Language · Computer Science 2019-04-17 Masahiro Kaneko , Mamoru Komachi

Neural retrieval methods using transformer-based pre-trained language models have advanced multilingual and cross-lingual retrieval. However, their effectiveness for low-resource, morphologically rich languages such as Amharic remains…

Information Retrieval · Computer Science 2025-06-11 Kidist Amde Mekonnen , Yosef Worku Alemneh , Maarten de Rijke

Recent research demonstrates the effectiveness of using fine-tuned language models~(LM) for dense retrieval. However, dense retrievers are hard to train, typically requiring heavily engineered fine-tuning pipelines to realize their full…

Information Retrieval · Computer Science 2021-08-13 Luyu Gao , Jamie Callan

Motivated by the growing demand for retrieval systems that operate across modalities, we introduce llama-nemoretriever-colembed, a unified text-image retrieval model that delivers state-of-the-art performance across multiple benchmarks. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Mengyao Xu , Gabriel Moreira , Ronay Ak , Radek Osmulski , Yauhen Babakhin , Zhiding Yu , Benedikt Schifferer , Even Oldridge