English
Related papers

Related papers: Linq-Embed-Mistral Technical Report

200 papers

Large Language Models (LLMs) are limited by their parametric knowledge, leading to hallucinations in knowledge-extensive tasks. To address this, Retrieval-Augmented Generation (RAG) incorporates external document chunks to expand LLM…

Computation and Language · Computer Science 2025-04-30 Zhonghao Li , Xuming Hu , Aiwei Liu , Kening Zheng , Sirui Huang , Hui Xiong

Motivated by the growing demand for retrieval systems that operate across modalities, we introduce llama-nemoretriever-colembed, a unified text-image retrieval model that delivers state-of-the-art performance across multiple benchmarks. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Mengyao Xu , Gabriel Moreira , Ronay Ak , Radek Osmulski , Yauhen Babakhin , Zhiding Yu , Benedikt Schifferer , Even Oldridge

We present SwiftEmbed, a production-oriented serving system for static token embeddings that achieves 1.12\,ms p50 latency for single-text requests while maintaining a 60.6 MTEB average score across 8 representative tasks. Built around the…

Computation and Language · Computer Science 2026-03-10 Edouard Lansiaux , Antoine Simonet , Eric Wiel

Existing retrieval benchmarks primarily consist of text-based queries where keyword or semantic matching is usually sufficient. Many real-world queries contain multimodal elements, particularly, images such as diagrams, charts, and…

Sentence embedding models play a key role in various Natural Language Processing tasks, such as in Topic Modeling, Document Clustering and Recommendation Systems. However, these models rely heavily on parallel data, which can be scarce for…

Computation and Language · Computer Science 2024-12-06 Fred Philippy , Siwen Guo , Jacques Klein , Tegawendé F. Bissyandé

Beyond general web-scale search, social network search uniquely enables users to retrieve information and discover potential connections within their social context. We introduce a framework of modernized Facebook Group Scoped Search by…

Information Retrieval · Computer Science 2025-09-18 Yongye Su , Zeya Zhang , Jane Kou , Cheng Ju , Shubhojeet Sarkar , Yamin Wang , Ji Liu , Shengbo Guo

Conversational search aims to satisfy users' complex information needs via multiple-turn interactions. The key challenge lies in revealing real users' search intent from the context-dependent queries. Previous studies achieve conversational…

Information Retrieval · Computer Science 2025-11-13 Fengran Mo , Jinghan Zhang , Yuchen Hui , Jia Ao Sun , Zhichao Xu , Zhan Su , Jian-Yun Nie

Text embeddings are commonly evaluated on a small set of datasets from a single task not covering their possible applications to other tasks. It is unclear whether state-of-the-art embeddings on semantic textual similarity (STS) can be…

Computation and Language · Computer Science 2023-03-21 Niklas Muennighoff , Nouamane Tazi , Loïc Magne , Nils Reimers

Recent progress in developing general purpose text embedders has been driven by training on ever-growing corpora of synthetic LLM-generated data. Nonetheless, no publicly available synthetic dataset exists, posing a barrier to studying its…

Computation and Language · Computer Science 2025-09-09 Jacob Mitchell Springer , Vaibhav Adlakha , Siva Reddy , Aditi Raghunathan , Marius Mosbach

Multimodal Large Language Models (MLLMs) have shown immense promise in universal multimodal retrieval, which aims to find relevant items of various modalities for a given query. But their practical application is often hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Qi Li , Yanzhe Zhao , Yongxin Zhou , Yameng Wang , Yandong Yang , Yuanjia Zhou , Jue Wang , Zuojian Wang , Jinxiang Liu

Text-to-video retrieval systems have recently made significant progress by utilizing pre-trained models trained on large-scale image-text pairs. However, most of the latest methods primarily focus on the video modality while disregarding…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Sarah Ibrahimi , Xiaohang Sun , Pichao Wang , Amanmeet Garg , Ashutosh Sanan , Mohamed Omar

This contribution summarizes the participation of the UNIMIB team to the TREC 2021 Clinical Trials Track. We have investigated the effect of different query representations combined with several retrieval models on the retrieval…

Information Retrieval · Computer Science 2022-07-28 Georgios Peikos , Oscar Espitia , Gabriella Pasi

Our objective is language-based search of large-scale image and video datasets. For this task, the approach that consists of independently mapping text and vision to a joint embedding space, a.k.a. dual encoders, is attractive as retrieval…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Antoine Miech , Jean-Baptiste Alayrac , Ivan Laptev , Josef Sivic , Andrew Zisserman

Decoder-only LLM-based embedding models are beginning to outperform BERT or T5-based embedding models in general-purpose text embedding tasks, including dense vector-based retrieval. In this work, we introduce NV-Embed, incorporating…

Computation and Language · Computer Science 2025-02-26 Chankyu Lee , Rajarshi Roy , Mengyao Xu , Jonathan Raiman , Mohammad Shoeybi , Bryan Catanzaro , Wei Ping

We present ReMatch, a framework that leverages the generative strength of MLLMs for multimodal retrieval. Previous approaches treated an MLLM as a simple encoder, ignoring its generative nature, and under-utilising its compositional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Qianying Liu , Xiao Liang , Zhiqiang Zhang , Zhongfei Qing , Fengfan Zhou , Yibo Chen , Xu Tang , Yao Hu , Paul Henderson

Music Information Retrieval (MIR) research is increasingly leveraging representation learning to obtain more compact, powerful music audio representations for various downstream MIR tasks. However, current representation evaluation methods…

Sound · Computer Science 2023-12-13 Christos Plachouras , Pablo Alonso-Jiménez , Dmitry Bogdanov

The development of high-quality text embeddings is increasingly drifting toward an exclusionary future, defined by three critical barriers: prohibitive computational costs, a narrow linguistic focus that neglects most of the world's…

Computation and Language · Computer Science 2026-05-15 Ziyin Zhang , Zihan Liao , Hang Yu , Peng Di , Rui Wang

Retrieving events from videos using text queries has become increasingly challenging due to the rapid growth of multimedia content. Existing methods for text-based video event retrieval often focus heavily on object-level descriptions,…

Computation and Language · Computer Science 2025-01-29 Long Nguyen , Huy Nguyen , Bao Khuu , Huy Luu , Huy Le , Tuan Nguyen , Tho Quan

Retrieval-Augmented Generation (RAG) methods enhance LLM performance by efficiently filtering relevant context for LLMs, reducing hallucinations and inference cost. However, most existing RAG methods focus on single-step retrieval, which is…

We introduce llama-embed-nemotron-8b, an open-weights text embedding model that achieves state-of-the-art performance on the Multilingual Massive Text Embedding Benchmark (MMTEB) leaderboard as of October 21, 2025. While recent models show…

Computation and Language · Computer Science 2025-11-11 Yauhen Babakhin , Radek Osmulski , Ronay Ak , Gabriel Moreira , Mengyao Xu , Benedikt Schifferer , Bo Liu , Even Oldridge