English
Related papers

Related papers: Col-Bandit: Zero-Shot Query-Time Pruning for Late-…

200 papers

State-of-the-art neural retrievers predominantly focus on high-resource languages like English, which impedes their adoption in retrieval scenarios involving other languages. Current approaches circumvent the lack of high-quality labeled…

Computation and Language · Computer Science 2024-02-26 Antoine Louis , Vageesh Saxena , Gijs van Dijck , Gerasimos Spanakis

As the capabilities of Vision-Language Models (VLMs) advance, they can process increasingly large inputs, which, unlike in LLMs, generates significant visual token redundancy and leads to prohibitive inference costs. While many methods aim…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Pu Zhang , Yuwei Li , Xingyuan Xian , Guoming Tang

Large Multimodal Models (LMMs) excel in visual-language tasks by leveraging numerous visual tokens for fine-grained visual information, but this token redundancy results in significant computational costs. Previous research aimed at…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Sihan Yang , Runsen Xu , Chenhang Cui , Tai Wang , Dahua Lin , Jiangmiao Pang

The PLAID (Performance-optimized Late Interaction Driver) algorithm for ColBERTv2 uses clustered term representations to retrieve and progressively prune documents for final (exact) document scoring. In this paper, we reproduce and fill in…

Information Retrieval · Computer Science 2024-04-24 Sean MacAvaney , Nicola Tonellotto

In this paper, we formulate a Collaborative Pure Exploration in Kernel Bandit problem (CoPE-KB), which provides a novel model for multi-agent multi-task decision making under limited communication and general reward functions, and is…

Machine Learning · Computer Science 2023-03-17 Yihan Du , Wei Chen , Yuko Kuroki , Longbo Huang

Retrieval-augmented generation has proven practical when models require specialized knowledge or access to the latest data. However, existing methods for multimodal document retrieval often replicate techniques developed for text-only…

Reliable biomedical and clinical retrieval requires more than strong ranking performance: it requires a practical way to find systematic model failures and curate the training evidence needed to correct them. Late-interaction models such as…

Information Retrieval · Computer Science 2026-04-22 François Remy

In this work, we tackle the problem of text-to-video retrieval (T2VR). Inspired by the success of late interaction techniques in text-document, text-image, and text-video retrieval, our approach, Video-ColBERT, introduces a simple and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Arun Reddy , Alexander Martin , Eugene Yang , Andrew Yates , Kate Sanders , Kenton Murray , Reno Kriz , Celso M. de Melo , Benjamin Van Durme , Rama Chellappa

Late interaction retrieval methods, pioneered by ColBERT, have emerged as a powerful alternative to single-vector neural IR. By leveraging fine-grained, token-level representations, they have been demonstrated to deliver strong…

Information Retrieval · Computer Science 2025-11-04 Benjamin Clavié , Xianming Li , Antoine Chaffin , Omar Khattab , Tom Aarsen , Manuel Faysse , Jing Li

Neural information retrieval systems excel in high-resource languages but remain underexplored for morphologically rich, lower-resource languages such as Turkish. Dense bi-encoders currently dominate Turkish IR, yet late-interaction models…

Computation and Language · Computer Science 2025-11-21 Özay Ezerceli , Mahmoud El Hussieni , Selva Taş , Reyhan Bayraktar , Fatma Betül Terzioğlu , Yusuf Çelebi , Yağız Asker

Multi-vector retrieval models such as ColBERT [Khattab and Zaharia, 2020] allow token-level interactions between queries and documents, and hence achieve state of the art on many information retrieval benchmarks. However, their non-linear…

Computation and Language · Computer Science 2024-04-10 Jinhyuk Lee , Zhuyun Dai , Sai Meher Karthik Duddu , Tao Lei , Iftekhar Naim , Ming-Wei Chang , Vincent Y. Zhao

In this paper, we explore the benefit of cooperation in adversarial bandit settings. As a motivating example, we consider the problem of wireless network selection. Mobile devices are often required to choose the right network to associate…

Networking and Internet Architecture · Computer Science 2019-01-24 Anuja Meetoo Appavoo , Seth Gilbert , Kian-Lee Tan

Vision-Language Models (VLMs) demand substantial computational resources during inference, largely due to the extensive visual input tokens for representing visual information. Previous studies have noted that visual tokens tend to receive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Cheng Yang , Yang Sui , Jinqi Xiao , Lingyi Huang , Yu Gong , Chendi Li , Jinghua Yan , Yu Bai , Ponnuswamy Sadayappan , Xia Hu , Bo Yuan

Multi-vector document retrieval systems, such as ColPali, excel in fine-grained matching for complex queries but incur significant storage and computational costs due to their reliance on high-dimensional patch embeddings and…

Information Retrieval · Computer Science 2025-07-03 Duong Bach

Diffusion Transformers (DiTs) deliver remarkable image and video generation quality but incur high computational cost, limiting scalability and on-device deployment. We introduce CoReDiT, a structured token pruning framework for DiTs across…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhuojin Li , Hsin-Pai Cheng , Hong Cai , Shizhong Han , Fatih Porikli

Multi-vector representations generated by late interaction models, such as ColBERT, enable superior retrieval quality compared to single-vector representations in information retrieval applications. In multi-vector retrieval systems, both…

Information Retrieval · Computer Science 2026-05-22 Elias Jääsaari , Ville Hyvönen , Teemu Roos

In this paper, we aim to build a novel bandits algorithm that is capable of fully harnessing the power of multi-dimensional data and the inherent non-linearity of reward functions to provide high-usable and accountable decision-making…

Machine Learning · Computer Science 2024-01-18 Qianxin Yi , Yiyang Yang , Shaojie Tang , Jiapeng Liu , Yao Wang

We study efficient multi-vector retrieval for late interaction in any modality. Late interaction has emerged as a dominant paradigm for information retrieval in text, images, visual documents, and videos, but its computation and storage…

Information Retrieval · Computer Science 2026-02-25 Hanxiang Qin , Alexander Martin , Rohan Jha , Chunsheng Zuo , Reno Kriz , Benjamin Van Durme

In many scenarios, recommender system user interaction data such as clicks or ratings is sparse, and item turnover rates (e.g., new articles, job postings) high. Given this, the integration of contextual "side" information in addition to…

Information Retrieval · Computer Science 2023-05-31 Maria Lentini , Umashanger Thayasivam

In this work, we propose a multi-armed bandit-based framework for identifying a compact set of informative data instances (i.e., the prototypes) from a source dataset $S$ that best represents a given target set $T$. Prototypical examples of…

Machine Learning · Computer Science 2023-08-24 Arghya Roy Chaudhuri , Pratik Jawanpuria , Bamdev Mishra