English
Related papers

Related papers: M3DR: Towards Universal Multilingual Multimodal Do…

200 papers

Multi-modal retrieval has seen tremendous progress with the development of vision-language models. However, further improving these models require additional labelled data which is a huge manual effort. In this paper, we propose a framework…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Avinash Madasu , Estelle Aflalo , Gabriela Ben Melech Stan , Shachar Rosenman , Shao-Yen Tseng , Gedas Bertasius , Vasudev Lal

State-of-the-art retrieval models typically address a straightforward search scenario, in which retrieval tasks are fixed (e.g., finding a passage to answer a specific question) and only a single modality is supported for both queries and…

Computation and Language · Computer Science 2025-02-25 Sheng-Chieh Lin , Chankyu Lee , Mohammad Shoeybi , Jimmy Lin , Bryan Catanzaro , Wei Ping

In this paper, we introduce a new embedding model called M3-Embedding, which is distinguished for its versatility in \textit{Multi-Linguality}, \textit{Multi-Functionality}, and \textit{Multi-Granularity}. It provides a uniform support for…

Computation and Language · Computer Science 2025-12-15 Jianlv Chen , Shitao Xiao , Peitian Zhang , Kun Luo , Defu Lian , Zheng Liu

With the increasing use of RetrievalAugmented Generation (RAG), strong retrieval models have become more important than ever. In healthcare, multimodal retrieval models that combine information from both text and images offer major…

Information Retrieval · Computer Science 2025-10-09 Arkadeep Acharya , Akash Ghosh , Pradeepika Verma , Kitsuchart Pasupa , Sriparna Saha , Priti Singh

Document visual question answering (DocVQA) pipelines that answer questions from documents have broad applications. Existing methods focus on handling single-page documents with multi-modal language models (MLMs), or rely on text-based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Jaemin Cho , Debanjan Mahata , Ozan Irsoy , Yujie He , Mohit Bansal

We present Omni-Embed-Nemotron, a unified multimodal retrieval embedding model developed to handle the increasing complexity of real-world information needs. While Retrieval-Augmented Generation (RAG) has significantly advanced language…

Computation and Language · Computer Science 2025-10-07 Mengyao Xu , Wenfei Zhou , Yauhen Babakhin , Gabriel Moreira , Ronay Ak , Radek Osmulski , Bo Liu , Even Oldridge , Benedikt Schifferer

Recent advancements in large language models (LLMs) have driven interest in billion-scale retrieval models with strong generalization across retrieval tasks and languages. Additionally, progress in large vision-language models has created…

Information Retrieval · Computer Science 2025-05-06 Xueguang Ma , Luyu Gao , Shengyao Zhuang , Jiaqi Samantha Zhan , Jamie Callan , Jimmy Lin

We introduce MRMR, the first expert-level multidisciplinary multimodal retrieval benchmark requiring intensive reasoning. MRMR contains 1,502 queries spanning 23 domains, with positive documents carefully verified by human experts. Compared…

Information Retrieval · Computer Science 2026-02-17 Siyue Zhang , Yuan Gao , Xiao Zhou , Yilun Zhao , Tingyu Song , Arman Cohan , Anh Tuan Luu , Chen Zhao

Cross-lingual cross-modal retrieval has garnered increasing attention recently, which aims to achieve the alignment between vision and target language (V-T) without using any annotated V-T data pairs. Current methods employ machine…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yabing Wang , Fan Wang , Jianfeng Dong , Hao Luo

Multimodal embedding models aim to map heterogeneous inputs, such as text, images, videos, and audio, into a shared semantic space. However, existing methods and benchmarks remain largely limited to partial modality coverage, making it…

Information Retrieval · Computer Science 2026-04-28 Haohang Huang , Xuan Lu , Mingyi Su , Xuan Zhang , Ziyan Jiang , Ping Nie , Kai Zou , Tomas Pfister , Wenhu Chen , Wei Zhang , Xiaoyu Shen , Rui Meng

The rapid advancement of Multimodal Large Language Models (MLLMs) has extended CLIP-based frameworks to produce powerful, universal embeddings for retrieval tasks. However, existing methods primarily focus on natural images, offering…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Weijian Jian , Yajun Zhang , Dawei Liang , Chunyu Xie , Yixiao He , Dawei Leng , Yuhui Yin

Most organizational data in this world are stored as documents, and visual retrieval plays a crucial role in unlocking the collective intelligence from all these documents. However, existing benchmarks focus on English-only document…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jian Chen , Ming Li , Jihyung Kil , Chenguang Wang , Tong Yu , Ryan Rossi , Tianyi Zhou , Changyou Chen , Ruiyi Zhang

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Computation and Language · Computer Science 2026-01-21 Mingxin Li , Yanzhao Zhang , Dingkun Long , Keqin Chen , Sibo Song , Shuai Bai , Zhibo Yang , Pengjun Xie , An Yang , Dayiheng Liu , Jingren Zhou , Junyang Lin

Retrieval-augmented generation (RAG) systems have predominantly focused on text-based retrieval, limiting their effectiveness in handling visually-rich documents that encompass text, images, tables, and charts. To bridge this gap, we…

Information Retrieval · Computer Science 2025-05-07 Mingjun Xu , Zehui Wang , Hengxing Cai , Renxin Zhong

With the rapid proliferation of multimodal information, Visual Document Retrieval (VDR) has emerged as a critical frontier in bridging the gap between unstructured visually rich data and precise information acquisition. Unlike traditional…

Computation and Language · Computer Science 2026-03-24 Yibo Yan , Jiahao Huo , Guanbo Feng , Mingdong Ou , Yi Cao , Xin Zou , Shuliang Liu , Yuanhuiyi Lyu , Yu Huang , Jungang Li , Kening Zheng , Xu Zheng , Philip S. Yu , James Kwok , Xuming Hu

Benchmarks that reflect the diversity and complexity of real-world documents are essential for accurately evaluating Automatic Text Recognition (ATR) systems, especially Vision-Large Language Models (vLLMs). Although recent models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mélodie Boillet , Solène Tarride , Christopher Kermorvant

The rapid advancement of unsupervised representation learning and large-scale pre-trained vision-language models has significantly improved cross-modal retrieval tasks. However, existing multi-modal information retrieval (MMIR) studies lack…

Information Retrieval · Computer Science 2025-10-20 Zirui Li , Siwei Wu , Yizhi Li , Xingyu Wang , Yi Zhou , Chenghua Lin

Document translation poses a challenge for Neural Machine Translation (NMT) systems. Most document-level NMT systems rely on meticulously curated sentence-level parallel data, assuming flawless extraction of text from documents along with…

Computation and Language · Computer Science 2024-06-13 Benjamin Hsu , Xiaoyu Liu , Huayang Li , Yoshinari Fujinuma , Maria Nadejde , Xing Niu , Yair Kittenplon , Ron Litman , Raghavendra Pappagari

Recent advances in multimodal large language models (MLLMs) have substantially expanded the capabilities of multimodal retrieval, enabling systems to align and retrieve information across visual and textual modalities. Yet, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xuan Lu , Kangle Li , Haohang Huang , Rui Meng , Wenjun Zeng , Xiaoyu Shen

Embedding models are pivotal in industrial information retrieval systems like search and advertising. However, existing pretrained models often exhibit fixed architectures and embedding dimensionalities, posing significant challenges when…

Computation and Language · Computer Science 2026-05-20 Yaoxiang Wang , Simiao Zuo , Qingguo Hu , Yucheng Ding , Yeyun Gong , Jian Jiao , Jinsong Su
‹ Prev 1 2 3 10 Next ›