English
Related papers

Related papers: jina-embeddings-v4: Universal Embeddings for Multi…

200 papers

Multimodal retrieval still leans on embedding-based models like CLIP for fast vector search over pre-computed image embeddings. Yet, unlike text retrieval, where joint-encoder rerankers are standard, comparable vision-language rerankers are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mitchell Keren Taraday , Shahaf Wagner , Chaim Baskin

Multilingual (or cross-lingual) embeddings represent several languages in a unique vector space. Using a common embedding space enables for a shared semantic between words from different languages. In this paper, we propose to embed images…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Maxime Portaz , Hicham Randrianarivo , Adrien Nivaggioli , Estelle Maudet , Christophe Servan , Sylvain Peyronnet

We introduce llama-embed-nemotron-8b, an open-weights text embedding model that achieves state-of-the-art performance on the Multilingual Massive Text Embedding Benchmark (MMTEB) leaderboard as of October 21, 2025. While recent models show…

Computation and Language · Computer Science 2025-11-11 Yauhen Babakhin , Radek Osmulski , Ronay Ak , Gabriel Moreira , Mengyao Xu , Benedikt Schifferer , Bo Liu , Even Oldridge

This study evaluates the effectiveness of Vision Language Models (VLMs) in representing and utilizing multimodal content for fact-checking. To be more specific, we investigate whether incorporating multimodal content improves performance…

Computation and Language · Computer Science 2024-12-09 Recep Firat Cekinel , Pinar Karagoz , Cagri Coltekin

In this report, we propose PaddleOCR-VL, a SOTA and resource-efficient model tailored for document parsing. Its core component is PaddleOCR-VL-0.9B, a compact yet powerful vision-language model (VLM) that integrates a NaViT-style dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Cheng Cui , Ting Sun , Suyin Liang , Tingquan Gao , Zelun Zhang , Jiaxuan Liu , Xueqing Wang , Changda Zhou , Hongen Liu , Manhui Lin , Yue Zhang , Yubo Zhang , Handong Zheng , Jing Zhang , Jun Zhang , Yi Liu , Dianhai Yu , Yanjun Ma

We introduce the Granite Embedding R2 models, a comprehensive family of high-performance English encoder-based embedding models engineered for enterprise-scale dense retrieval applications. Building upon our first-generation release, these…

This paper presents a comparison of embedding models in tri-modal hybrid retrieval for Retrieval-Augmented Generation (RAG) systems. We investigate the fusion of dense semantic, sparse lexical, and graph-based embeddings, focusing on the…

Information Retrieval · Computer Science 2025-06-03 Arjun Rao , Hanieh Alipour , Nick Pendar

With the popularity of multimodal techniques, it receives growing interests to acquire useful information in visual forms. In this work, we formally define an emerging IR paradigm called \textit{Visualized Information Retrieval}, or…

Computation and Language · Computer Science 2025-02-18 Ze Liu , Zhengyang Liang , Junjie Zhou , Zheng Liu , Defu Lian

While an image is worth more than a thousand words, only a few provide crucial information for a given task and thus should be focused on. In light of this, ideal text-to-image (T2I) retrievers should prioritize specific visual attributes…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Siting Li , Xiang Gao , Simon Shaolei Du

In autonomous driving, robust place recognition is critical for global localization and loop closure detection. While inter-modality fusion of camera and LiDAR data in multimodal place recognition (MPR) has shown promise in overcoming the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Jingyi Xu , Zhangshuo Qi , Zhongmiao Yan , Xuyu Gao , Qianyun Jiao , Songpengcheng Xia , Xieyuanli Chen , Ling Pei

Large-scale contrastive pre-training produces powerful Vision-and-Language Models (VLMs) capable of generating representations (embeddings) effective for a wide variety of visual and multimodal tasks. However, these pretrained embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nikolaos-Antonios Ypsilantis , Kaifeng Chen , André Araujo , Ondřej Chum

Multimodal Large Language Models (MLLMs) are undergoing rapid progress and represent the frontier of AI development. However, their training and inference efficiency have emerged as a core bottleneck in making MLLMs more accessible and…

We study joint video and language (VL) pre-training to enable cross-modality learning and benefit plentiful downstream VL tasks. Existing works either extract low-quality video features or learn limited text embedding, while neglecting that…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Hongwei Xue , Tiankai Hang , Yanhong Zeng , Yuchong Sun , Bei Liu , Huan Yang , Jianlong Fu , Baining Guo

Retrieving relevant evidence from visually rich documents such as textbooks, technical reports, and manuals is challenging due to long context, complex layouts, and weak lexical overlap between user questions and supporting pages. We…

Information Retrieval · Computer Science 2026-03-31 Seonok Kim

Large Multimodal Models (LMMs) have shown significant visual reasoning capabilities by connecting a visual encoder and a large language model. LMMs typically take in a fixed and large amount of visual tokens, such as the penultimate layer…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yuzhang Shang , Mu Cai , Bingxin Xu , Yong Jae Lee , Yan Yan

Seeing clearly with high resolution is a foundation of Large Multimodal Models (LMMs), which has been proven to be vital for visual perception and reasoning. Existing works usually employ a straightforward resolution upscaling method, where…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yi-Fan Zhang , Qingsong Wen , Chaoyou Fu , Xue Wang , Zhang Zhang , Liang Wang , Rong Jin

Retrieving specific information from a large corpus of documents is a prevalent industrial use case of modern AI, notably due to the popularity of Retrieval-Augmented Generation (RAG) systems. Although neural document retrieval models have…

Information Retrieval · Computer Science 2025-12-17 Paul Teiletche , Quentin Macé , Max Conti , Antonio Loison , Gautier Viaud , Pierre Colombo , Manuel Faysse

Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit…

Vision-Language Models (VLMs) have demonstrated strong performance across various multimodal tasks, where position encoding plays a vital role in modeling both the sequential structure of textual information and the spatial structure of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ruoxiang Huang , Xindian Ma , Rundong Kong , Zhen Yuan , Peng Zhang

Retrieval-augmented generation (RAG) with large language models (LLMs) plays a crucial role in question answering, as LLMs possess limited knowledge and are not updated with continuously growing information. Most recent work on RAG has…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shichao Kan , Yuhai Deng , Jiale Fu , Lihui Cen , Zhe Qu , Linna Zhang , Yixiong Liang , Yigang Cen