English
Related papers

Related papers: NV-Retriever: Improving text embedding models with…

200 papers

Current advances in Natural Language Processing (NLP) have made it increasingly feasible to build applications leveraging textual data. Generally, the core of these applications rely on having a good semantic representation of text into…

Computation and Language · Computer Science 2024-10-21 Thomas Uriot

This extended abstract introduces Self-Explaining Contrastive Evidence Re-Ranking (CER), a novel method that restructures retrieval around factual evidence by fine-tuning embeddings with contrastive learning and generating token-level…

Computation and Language · Computer Science 2025-12-05 Francielle Vargas , Daniel Pedronette

Pre-trained language models have been successful in many knowledge-intensive NLP tasks. However, recent work has shown that models such as BERT are not ``structurally ready'' to aggregate textual information into a [CLS] vector for dense…

Information Retrieval · Computer Science 2023-05-26 Sheng-Chieh Lin , Minghan Li , Jimmy Lin

This report explores the enhancement of text retrieval performance using advanced data refinement techniques. We develop Linq-Embed-Mistral\footnote{\url{https://huggingface.co/Linq-AI-Research/Linq-Embed-Mistral}} by building on the…

Computation and Language · Computer Science 2024-12-05 Chanyeol Choi , Junseong Kim , Seolhwa Lee , Jihoon Kwon , Sangmo Gu , Yejin Kim , Minkyung Cho , Jy-yong Sohn

A reliable resume-job matching system helps a company recommend suitable candidates from a pool of resumes and helps a job seeker find relevant jobs from a list of job posts. However, since job seekers apply only to a few jobs, interaction…

Computation and Language · Computer Science 2025-03-04 Xiao Yu , Ruize Xu , Chengyuan Xue , Jinzhong Zhang , Xu Ma , Zhou Yu

Text embeddings are useful features in many applications such as semantic search and computing text similarity. Previous work typically trains models customized for different use cases, varying in dataset choice, training objective and…

Motivated by the growing demand for retrieval systems that operate across modalities, we introduce llama-nemoretriever-colembed, a unified text-image retrieval model that delivers state-of-the-art performance across multiple benchmarks. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Mengyao Xu , Gabriel Moreira , Ronay Ak , Radek Osmulski , Yauhen Babakhin , Zhiding Yu , Benedikt Schifferer , Even Oldridge

This paper investigates negative sampling for contrastive learning in the context of audio-text retrieval. The strategy for negative sampling refers to selecting negatives (either audio clips or textual descriptions) from a pool of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-20 Huang Xie , Okko Räsänen , Tuomas Virtanen

Modern information retrieval (IR) models, trained exclusively on standard <query, passage> pairs, struggle to effectively interpret and follow explicit user instructions. We introduce InF-IR, a large-scale, high-quality training corpus…

Computation and Language · Computer Science 2025-05-28 Yuchen Zhuang , Aaron Trinh , Rushi Qiang , Haotian Sun , Chao Zhang , Hanjun Dai , Bo Dai

Recent advances in open-vocabulary object detection models will enable Automatic Target Recognition systems to be sustainable and repurposed by non-technical end-users for a variety of applications or missions. New, and potentially nuanced,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Louis Y. Kim , Michelle Karker , Victoria Valledor , Seiyoung C. Lee , Karl F. Brzoska , Margaret Duff , Anthony Palladino

E-commerce information retrieval (IR) systems struggle to simultaneously achieve high accuracy in interpreting complex user queries and maintain efficient processing of vast product catalogs. The dual challenge lies in precisely matching…

Information Retrieval · Computer Science 2025-06-25 Shenbin Qian , Diptesh Kanojia , Samarth Agrawal , Hadeel Saadany , Swapnil Bhosale , Constantin Orasan , Zhe Wu

This study addresses the challenges of multi-label text classification. The difficulties arise from imbalanced data sets, varied text lengths, and numerous subjective feature labels. Existing solutions include traditional machine learning…

Computation and Language · Computer Science 2024-05-22 Hongren Wang

Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit…

Large Language Models (LLMs) have achieved impressive progress in natural language processing, but their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks. Retrieval-Augmented…

Computation and Language · Computer Science 2025-05-20 Zhangyu Wang , Siyuan Gao , Rong Zhou , Hao Wang , Li Ning

Training robust retrieval and reranker models typically relies on large-scale retrieval datasets; for example, the BGE collection contains 1.6 million query-passage pairs sourced from various data sources. However, we find that certain…

Information Retrieval · Computer Science 2025-10-21 Nandan Thakur , Crystina Zhang , Xueguang Ma , Jimmy Lin

Contemporary large-scale visual language models (VLMs) exhibit strong representation capacities, making them ubiquitous for enhancing image and text understanding tasks. They are often trained in a contrastive manner on a large and diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Ugur Sahin , Hang Li , Qadeer Khan , Daniel Cremers , Volker Tresp

Text embeddings are essential for many tasks, such as document retrieval, clustering, and semantic similarity assessment. In this paper, we study how to contrastively train text embedding models in a compute-optimal fashion, given a suite…

Machine Learning · Computer Science 2024-11-22 Alicja Ziarko , Albert Q. Jiang , Bartosz Piotrowski , Wenda Li , Mateja Jamnik , Piotr Miłoś

Open-domain extractive question answering works well on textual data by first retrieving candidate texts and then extracting the answer from those candidates. However, some questions cannot be answered by text alone but require information…

Computation and Language · Computer Science 2021-10-20 Bogdan Kostić , Julian Risch , Timo Möller

Vietnam ranks among the top countries in terms of both internet traffic and online toxicity. As a result, implementing embedding models for recommendation and content control duties in applications is crucial. However, a lack of large-scale…

Computation and Language · Computer Science 2025-07-30 Loc Pham , Tung Luu , Thu Vo , Minh Nguyen , Viet Hoang

Efficiently retrieving a concise set of candidates from a large document corpus remains a pivotal challenge in Information Retrieval (IR). Neural retrieval models, particularly dense retrieval models built with transformers and pretrained…

Information Retrieval · Computer Science 2025-01-01 Haitian Chen , Qingyao Ai , Xiao Wang , Yiqun Liu , Fen Lin , Qin Liu