English
Related papers

Related papers: SPRINT: A Unified Toolkit for Evaluating and Demys…

200 papers

The last few years have seen gigantic leaps in algorithms and systems to support efficient deep learning inference. Pruning and quantization algorithms can now consistently compress neural networks by an order of magnitude. For a compressed…

Machine Learning · Computer Science 2021-07-22 Ziheng Wang

Learned sparse retrieval, which can efficiently perform retrieval through mature inverted-index engines, has garnered growing attention in recent years. Particularly, the inference-free sparse retrievers are attractive as they eliminate…

Information Retrieval · Computer Science 2025-07-02 Zhichao Geng , Yiwen Wang , Dongyu Ru , Yang Yang

Neural retrievers based on dense representations combined with Approximate Nearest Neighbors search have recently received a lot of attention, owing their success to distillation and/or better sampling of examples for training -- while…

Information Retrieval · Computer Science 2022-05-13 Thibault Formal , Carlos Lassance , Benjamin Piwowarski , Stéphane Clinchant

Neural information retrieval architectures based on transformers such as BERT are able to significantly improve system effectiveness over traditional sparse models such as BM25. Though highly effective, these neural approaches are very…

Information Retrieval · Computer Science 2022-04-26 Antonio Mallia , Joel Mackenzie , Torsten Suel , Nicola Tonellotto

Detecting the source model of AI-generated images is a growing accountability problem. AI fingerprinting techniques address this by detecting imperceptible patterns in the images that are unique to each model, achieving high detection…

Cryptography and Security · Computer Science 2026-05-06 Kai Yao , Marc Juarez

Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result,…

Information Retrieval · Computer Science 2022-08-11 Dahlia Shehata , Negar Arabzadeh , Charles L. A. Clarke

Large Language Models (LLMs) are popular for their impressive abilities, but the need for model-specific fine-tuning or task-specific prompt engineering can hinder their generalization. We propose UPRISE (Universal Prompt Retrieval for…

Computation and Language · Computer Science 2023-12-19 Daixuan Cheng , Shaohan Huang , Junyu Bi , Yuefeng Zhan , Jianfeng Liu , Yujing Wang , Hao Sun , Furu Wei , Denvy Deng , Qi Zhang

Inspired by recent findings on the fractal geometry of language, we introduce Recursive INference Scaling (RINS) as a complementary, plug-in recipe for scaling inference time in language and multimodal systems. RINS is a particular form of…

Artificial Intelligence · Computer Science 2025-05-09 Ibrahim Alabdulmohsin , Xiaohua Zhai

We introduce SPARTA, a novel neural retrieval method that shows great promise in performance, generalization, and interpretability for open-domain question answering. Unlike many neural ranking methods that use dense vector nearest neighbor…

Computation and Language · Computer Science 2020-09-29 Tiancheng Zhao , Xiaopeng Lu , Kyusong Lee

Table Structure Recognition (TSR) is vital for various downstream tasks like information retrieval, table reconstruction, and document understanding. While most state-of-the-art (SOTA) research predominantly focuses on TSR in English…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dhruv Kudale , Badri Vishal Kasuba , Venkatapathy Subramanian , Parag Chaudhuri , Ganesh Ramakrishnan

This report presents our participation to the WSDM Cup 2026 shared task on multilingual document retrieval from English queries. The task provides a challenging benchmark for cross-lingual generalization. It also provides a natural testbed…

Information Retrieval · Computer Science 2026-02-25 Thibault Formal , Maxime Louis , Hervé Déjean , Stéphane Clinchant

Diffusion Transformers (DiTs) deliver state-of-the-art generative performance but their quadratic training cost with sequence length makes large-scale pretraining prohibitively expensive. Token dropping can reduce training cost, yet na\"ive…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Dogyun Park , Moayed Haji-Ali , Yanyu Li , Willi Menapace , Sergey Tulyakov , Hyunwoo J. Kim , Aliaksandr Siarohin , Anil Kag

A lot of recent work has focused on sparse learned indexes that use deep neural architectures to significantly improve retrieval quality while keeping the efficiency benefits of the inverted index. While such sparse learned structures…

Information Retrieval · Computer Science 2024-07-09 Soyuj Basnet , Jerry Gou , Antonio Mallia , Torsten Suel

We propose the new problem of choosing which dense retrieval model to use when searching on a new collection for which no labels are available, i.e. in a zero-shot setting. Many dense retrieval models are readily available. Each model…

Information Retrieval · Computer Science 2023-09-19 Ekaterina Khramtsova , Shengyao Zhuang , Mahsa Baktashmotlagh , Xi Wang , Guido Zuccon

Model pruning in transformer-based language models, traditionally viewed as a means of achieving computational savings, can enhance the model's reasoning capabilities. In this work, we uncover a surprising phenomenon: the selective pruning…

Computation and Language · Computer Science 2025-06-10 Hieu Trung Nguyen , Bao Nguyen , Viet Anh Nguyen

One of the key shortcomings in current text-to-image (T2I) models is their inability to consistently generate images which faithfully follow the spatial relationships specified in the text prompt. In this paper, we offer a comprehensive…

Recent years have witnessed the significant advance in dense retrieval (DR) based on powerful pre-trained language models (PLM). DR models have achieved excellent performance in several benchmark datasets, while they are shown to be not as…

Computation and Language · Computer Science 2023-04-25 Ruiyang Ren , Yingqi Qu , Jing Liu , Wayne Xin Zhao , Qifei Wu , Yuchen Ding , Hua Wu , Haifeng Wang , Ji-Rong Wen

Existing dense retrieval models struggle with reasoning-intensive retrieval task as they fail to capture implicit relevance that requires reasoning beyond surface-level semantic information. To address these challenges, we propose…

Information Retrieval · Computer Science 2025-07-18 Sangam Lee , Ryang Heo , SeongKu Kang , Dongha Lee

Zero-shot sketch-based image retrieval (ZS-SBIR) is a task of cross-domain image retrieval from a natural image gallery with free-hand sketch under a zero-shot scenario. Previous works mostly focus on a generative approach that takes a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Hao Wang , Cheng Deng , Xinxu Xu , Wei Liu , Xinbo Gao , Dacheng Tao

Recent developments in representational learning for information retrieval can be organized in a conceptual framework that establishes two pairs of contrasts: sparse vs. dense representations and unsupervised vs. learned representations.…

Information Retrieval · Computer Science 2021-06-29 Jimmy Lin , Xueguang Ma