中文
相关论文

相关论文: Arctic-Embed: Scalable, Efficient, and Accurate Te…

200 篇论文

Despite the success of text retrieval in many NLP tasks, code retrieval remains a largely underexplored area. Most text retrieval systems are tailored for natural language queries, often neglecting the specific challenges of retrieving…

软件工程 · 计算机科学 2025-08-11 Ye Liu , Rui Meng , Shafiq Joty , Silvio Savarese , Caiming Xiong , Yingbo Zhou , Semih Yavuz

We introduce llama-embed-nemotron-8b, an open-weights text embedding model that achieves state-of-the-art performance on the Multilingual Massive Text Embedding Benchmark (MMTEB) leaderboard as of October 21, 2025. While recent models show…

计算与语言 · 计算机科学 2025-11-11 Yauhen Babakhin , Radek Osmulski , Ronay Ak , Gabriel Moreira , Mengyao Xu , Benedikt Schifferer , Bo Liu , Even Oldridge

In this paper, we introduce a novel and simple method for obtaining high-quality text embeddings using only synthetic data and less than 1k training steps. Unlike existing methods that often depend on multi-stage intermediate pre-training…

计算与语言 · 计算机科学 2024-06-03 Liang Wang , Nan Yang , Xiaolong Huang , Linjun Yang , Rangan Majumder , Furu Wei

Text embeddings from large language models (LLMs) have achieved excellent results in tasks such as information retrieval, semantic textual similarity, etc. In this work, we show an interesting finding: when feeding a text into the LLM-based…

计算与语言 · 计算机科学 2025-07-08 Zhijie Nie , Richong Zhang , Zhanyu Wu

The development of high-quality text embeddings is increasingly drifting toward an exclusionary future, defined by three critical barriers: prohibitive computational costs, a narrow linguistic focus that neglects most of the world's…

计算与语言 · 计算机科学 2026-05-15 Ziyin Zhang , Zihan Liao , Hang Yu , Peng Di , Rui Wang

Transformer-based text embedding models have improved their performance on benchmarks like MIRACL and BEIR by increasing their parameter counts. However, this scaling approach introduces significant deployment challenges, including…

计算与语言 · 计算机科学 2025-03-11 Zach Nussbaum , Brandon Duderstadt

Medical text embedding models are foundational to a wide array of healthcare applications, ranging from clinical decision support and biomedical information retrieval to medical question answering, yet they remain hampered by two critical…

计算与语言 · 计算机科学 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Hamidreza Mahyar

Traditional text embedding benchmarks primarily evaluate embedding models' capabilities to capture semantic similarity. However, more advanced NLP tasks require a deeper understanding of text, such as safety and factuality. These tasks…

计算与语言 · 计算机科学 2025-03-05 Simeng Han , Frank Palma Gomez , Tu Vu , Zefei Li , Daniel Cer , Hansi Zeng , Chris Tar , Arman Cohan , Gustavo Hernandez Abrego

Deep learning models such as convolutional neural networks and recurrent networks are widely applied in text classification. In spite of their great success, most deep learning models neglect the importance of modeling context information,…

计算与语言 · 计算机科学 2019-06-05 Liuyu Xiang , Xiaoming Jin , Lan Yi , Guiguang Ding

We present an analysis of large-scale pretrained deep learning models used for cross-modal (text-to-audio) retrieval. We use embeddings extracted by these models in a metric learning framework to connect matching pairs of audio and text.…

信息检索 · 计算机科学 2022-10-07 Benno Weck , Miguel Pérez Fernández , Holger Kirchhoff , Xavier Serra

As retrieval-augmented generation prevails in large language models, embedding models are becoming increasingly crucial. Despite the growing number of general embedding models, prior work often overlooks the critical role of training data…

Recently, numerous embedding models have been made available and widely used for various NLP tasks. The Massive Text Embedding Benchmark (MTEB) has primarily simplified the process of choosing a model that performs well for several tasks in…

计算与语言 · 计算机科学 2024-06-18 Mathieu Ciancone , Imene Kerboua , Marion Schaeffer , Wissam Siblini

This paper addresses the gap between general-purpose text embeddings and the specific demands of item retrieval tasks. We demonstrate the shortcomings of existing models in capturing the nuances necessary for zero-shot performance on item…

信息检索 · 计算机科学 2024-03-01 Yuxuan Lei , Jianxun Lian , Jing Yao , Mingqi Wu , Defu Lian , Xing Xie

Patent text embeddings enable prior art search, technology landscaping, and patent analysis, yet existing benchmarks inadequately capture patent-specific challenges. We introduce PatenTEB, a comprehensive benchmark comprising 15 tasks…

计算与语言 · 计算机科学 2025-10-28 Iliass Ayaou , Denis Cavallucci

The reproducibility and transparency of large language models are crucial for advancing open research, ensuring the trustworthiness of results, and enabling investigations into data and model biases, as well as potential risks. To this end,…

This report explores the enhancement of text retrieval performance using advanced data refinement techniques. We develop Linq-Embed-Mistral\footnote{\url{https://huggingface.co/Linq-AI-Research/Linq-Embed-Mistral}} by building on the…

计算与语言 · 计算机科学 2024-12-05 Chanyeol Choi , Junseong Kim , Seolhwa Lee , Jihoon Kwon , Sangmo Gu , Yejin Kim , Minkyung Cho , Jy-yong Sohn

Text embedding representing natural language documents in a semantic vector space can be used for document retrieval using nearest neighbor lookup. In order to study the feasibility of neural models specialized for retrieval in a…

信息检索 · 计算机科学 2019-05-03 Tolgahan Cakaloglu , Christian Szegedy , Xiaowei Xu

Retrieval augmentation has become an effective solution to empower large language models (LLMs) with external and verified knowledge sources from the database, which overcomes the limitations and hallucinations of LLMs in handling…

信息检索 · 计算机科学 2023-11-21 Tong Wu , Yulei Qin , Enwei Zhang , Zihan Xu , Yuting Gao , Ke Li , Xing Sun

Embedding models play a crucial role in Natural Language Processing (NLP) by creating text embeddings used in various tasks such as information retrieval and assessing semantic text similarity. This paper focuses on research related to…

计算与语言 · 计算机科学 2025-02-04 Artem Snegirev , Maria Tikhonova , Anna Maksimova , Alena Fenogenova , Alexander Abramov

Image representations are often evaluated through disjointed, task-specific protocols, leading to a fragmented understanding of model capabilities. For instance, it is unclear whether an image embedding model adept at clustering images is…