English
Related papers

Related papers: ReinPool: Reinforcement Learning Pooling Multi-Vec…

200 papers

Pooling layers are essential building blocks of convolutional neural networks (CNNs), to reduce computational overhead and increase the receptive fields of proceeding convolutional operations. Their goal is to produce downsampled volumes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Alexandros Stergiou , Ronald Poppe

Multimodal retrieval relies heavily on single-vector retrievers, which compress rich, sequential token sequences into one single global representation. While efficient, they discard fine-grained, local evidence critical for dense retrieval…

Information Retrieval · Computer Science 2026-05-26 Jianrui Zhang , Hyun Jung Lee , Sukanta Ganguly , Tae-Eui Kam , Donghyun Kim , Yong Jae Lee

Over the last few years, multi-vector retrieval methods, spearheaded by ColBERT, have become an increasingly popular approach to Neural IR. By storing representations at the token level rather than at the document level, these methods have…

Information Retrieval · Computer Science 2024-09-24 Benjamin Clavié , Antoine Chaffin , Griffin Adams

Multi-vector visual retrievers (e.g., ColPali-style late interaction models) deliver strong accuracy, but scale poorly because each page yields thousands of vectors, making indexing and search increasingly expensive. We present Visual RAG…

Information Retrieval · Computer Science 2026-02-16 Ara Yeroyan

Images captured nowadays are of varying dimensions with smartphones and DSLR's allowing users to choose from a list of available image resolutions. It is therefore imperative for forensic algorithms such as resampling detection to scale…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Mohit Lamba , Kaushik Mitra

Learnable embedding vector is one of the most important applications in machine learning, and is widely used in various database-related domains. However, the high dimensionality of sparse data in recommendation tasks and the huge volume of…

Machine Learning · Computer Science 2024-02-14 Hailin Zhang , Penghao Zhao , Xupeng Miao , Yingxia Shao , Zirui Liu , Tong Yang , Bin Cui

Universal multimodal embedding models have achieved great success in capturing semantic relevance between queries and candidates. However, current methods either condense queries and candidates into a single vector, potentially limiting the…

Information Retrieval · Computer Science 2026-04-08 Zilin Xiao , Qi Ma , Mengting Gu , Chun-cheng Jason Chen , Xintao Chen , Vicente Ordonez , Vijai Mohan

Vector retrieval systems exhibit significant performance variance across queries due to heterogeneous embedding quality. We propose a lightweight framework for predicting retrieval performance at the query level by combining quantization…

Information Retrieval · Computer Science 2025-07-09 Y. Du

Visual-Semantic Embedding (VSE) aims to learn an embedding space where related visual and semantic instances are close to each other. Recent VSE models tend to design complex structures to pool visual and semantic features into fixed-length…

Multimedia · Computer Science 2022-10-06 Zijian Zhang , Chang Shu , Ya Xiao , Yuan Shen , Di Zhu , Jing Xiao , Youxin Chen , Jey Han Lau , Qian Zhang , Zheng Lu

Pooling is an essential component of a wide variety of sentence representation and embedding models. This paper explores generalized pooling methods to enhance sentence embedding. We propose vector-based multi-head attention that includes…

Computation and Language · Computer Science 2022-02-24 Qian Chen , Zhen-Hua Ling , Xiaodan Zhu

Visual document retrieval has become essential for accessing information in visually rich documents. Existing approaches fall into two camps. Late-interaction retrievers achieve strong quality through fine-grained token-level matching but…

Machine Learning · Computer Science 2026-05-08 Weien Li , Rui Song , Zeyu Li , Haochen Liu , Gonghao Zhang , Difan Jiao , Zhenwei Tang , Bowei He , Haolun Wu , Xue Liu , Ye Yuan

The rapid advancement of Multimodal Large Language Models (MLLMs) has extended CLIP-based frameworks to produce powerful, universal embeddings for retrieval tasks. However, existing methods primarily focus on natural images, offering…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Weijian Jian , Yajun Zhang , Dawei Liang , Chunyu Xie , Yixiao He , Dawei Leng , Yuhui Yin

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

Dense retrieval, which encodes queries and documents into a single dense vector, has become the dominant neural retrieval approach due to its simplicity and compatibility with fast approximate nearest neighbor algorithms. As the tasks dense…

Information Retrieval · Computer Science 2026-02-06 Julian Killingback , Mahta Rafiee , Madine Manas , Hamed Zamani

Visual Semantic Embedding (VSE) is a dominant approach for vision-language retrieval, which aims at learning a deep embedding space such that visual data are embedded close to their semantic text labels or descriptions. Recent VSE models…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Jiacheng Chen , Hexiang Hu , Hao Wu , Yuning Jiang , Changhu Wang

LLMs confront inherent limitations in terms of its knowledge, memory, and action. The retrieval augmentation stands as a vital mechanism to address these limitations, which brings in useful information from external sources to augment the…

Information Retrieval · Computer Science 2026-01-06 Peitian Zhang , Shitao Xiao , Zheng Liu , Zhicheng Dou , Jian-Yun Nie

Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit…

Recent advances in large language models have demonstrated remarkable effectiveness in information retrieval (IR) tasks. While many neural IR systems encode queries and documents into single-vector representations, multi-vector models…

Information Retrieval · Computer Science 2023-12-12 Susav Shrestha , Narasimha Reddy , Zongwang Li

Multi-modal retrieval becomes increasingly popular in practice. However, the existing retrievers are mostly text-oriented, which lack the capability to process visual information. Despite the presence of vision-language models like CLIP,…

Information Retrieval · Computer Science 2024-06-07 Junjie Zhou , Zheng Liu , Shitao Xiao , Bo Zhao , Yongping Xiong

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Computation and Language · Computer Science 2026-01-21 Mingxin Li , Yanzhao Zhang , Dingkun Long , Keqin Chen , Sibo Song , Shuai Bai , Zhibo Yang , Pengjun Xie , An Yang , Dayiheng Liu , Jingren Zhou , Junyang Lin
‹ Prev 1 2 3 10 Next ›