English
Related papers

Related papers: Selecting which Dense Retriever to use for Zero-Sh…

200 papers

Modern computing and communication technologies can make data collection procedures very efficient. However, our ability to analyze large data sets and/or to extract information out from them is hard-pressed to keep up with our capacities…

Machine Learning · Statistics 2019-01-30 Zhanfeng Wang , Yumi Kwon , Yuan-chin Ivan Chang

Feature selection, an effective technique for dimensionality reduction, plays an important role in many machine learning systems. Supervised knowledge can significantly improve the performance. However, faced with the rapid growth of newly…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Zheng Wang , Qiao Wang , Tingzhang Zhao , Xiaojun Ye

How can we reuse existing knowledge, in the form of available datasets, when solving a new and apparently unrelated target task from a set of unlabeled data? In this work we make a first contribution to answer this question in the context…

Computer Vision and Pattern Recognition · Computer Science 2015-10-07 Efstratios Gavves , Thomas Mensink , Tatiana Tommasi , Cees G. M. Snoek , Tinne Tuytelaars

In open-domain question answering, a model receives a text question as input and searches for the correct answer using a large evidence corpus. The retrieval step is especially difficult as typical evidence corpora have \textit{millions} of…

Computation and Language · Computer Science 2021-09-24 Christopher Sciavolino

Deep learning has significantly improved the precision of instance segmentation with abundant labeled data. However, in many areas like medical and manufacturing, collecting sufficient data is extremely hard and labeling this data requires…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Ye Zheng , Jiahong Wu , Yongqiang Qin , Faen Zhang , Li Cui

Large-scale datasets are essential for the success of deep learning in image retrieval. However, manual assessment errors and semi-supervised annotation techniques can lead to label noise even in popular datasets. As previous works…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Stanislav Dereka , Ivan Karpukhin , Sergey Kolesnikov

Large pre-trained models can dramatically reduce the amount of task-specific data required to solve a problem, but they often fail to capture domain-specific nuances out of the box. The Web likely contains the information necessary to excel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Hamed Damirchi , Cristian Rodríguez-Opazo , Ehsan Abbasnejad , Damien Teney , Javen Qinfeng Shi , Stephen Gould , Anton van den Hengel

This work stems from an observed limitation of text encoders: embeddings may not be able to recognize fine-grained entities or events within encoded semantics, resulting in failed retrieval even in simple cases. To examine such behaviors,…

Computation and Language · Computer Science 2025-08-27 Liyan Xu , Zhenlin Su , Mo Yu , Jiangnan Li , Fandong Meng , Jie Zhou

With the explosive 3D data growth, the urgency of utilizing zero-shot learning to facilitate data labeling becomes evident. Recently, methods transferring language or language-image pre-training models like Contrastive Language-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Weiguang Zhao , Guanyu Yang , Rui Zhang , Chenru Jiang , Chaolong Yang , Yuyao Yan , Amir Hussain , Kaizhu Huang

Over the last few years, contextualized pre-trained transformer models such as BERT have provided substantial improvements on information retrieval tasks. Recent approaches based on pre-trained transformer models such as BERT, fine-tune…

Information Retrieval · Computer Science 2021-09-23 Negar Arabzadeh , Xinyi Yan , Charles L. A. Clarke

Few-shot dense retrieval (DR) aims to effectively generalize to novel search scenarios by learning a few samples. Despite its importance, there is little study on specialized datasets and standardized evaluation protocols. As a result,…

Computation and Language · Computer Science 2023-04-13 Si Sun , Yida Lu , Shi Yu , Xiangyang Li , Zhonghua Li , Zhao Cao , Zhiyuan Liu , Deiming Ye , Jie Bao

In Information Retrieval, and more generally in Natural Language Processing, adapting models to specific domains is conducted through fine-tuning. Despite the successes achieved by this method and its versatility, the need for human-curated…

Information Retrieval · Computer Science 2024-07-08 Mathias Vast , Yuxuan Zong , Basile Van Cooten , Benjamin Piwowarski , Laure Soulier

Zero-Shot Learning (ZSL) is a classification task where we do not have even a single training labeled example from a set of unseen classes. Instead, we only have prior information (or description) about seen and unseen classes, often in the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Shabnam Daghaghi , Tharun Medini , Anshumali Shrivastava

One of important areas of machine learning research is zero-shot learning. It is applied when properly labeled training data set is not available. A number of zero-shot algorithms have been proposed and experimented with. However, none of…

Machine Learning · Computer Science 2022-03-30 Elie Saad , Marcin Paprzycki , Maria Ganzha

Dense retrievers play a vital role in accessing external and specialized knowledge to augment language models (LMs). Training dense retrievers typically requires annotated query-document pairs, which are costly to create and scarce in…

Information Retrieval · Computer Science 2026-02-23 Fengyu Cai , Tong Chen , Xinran Zhao , Sihao Chen , Hongming Zhang , Sherry Tongshuang Wu , Iryna Gurevych , Heinz Koeppl

In the field of visual scene understanding, deep neural networks have made impressive advancements in various core tasks like segmentation, tracking, and detection. However, most approaches operate on the close-set assumption, meaning that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Jianzong Wu , Xiangtai Li , Shilin Xu , Haobo Yuan , Henghui Ding , Yibo Yang , Xia Li , Jiangning Zhang , Yunhai Tong , Xudong Jiang , Bernard Ghanem , Dacheng Tao

The development of advanced 3D sensors has enabled many objects to be captured in the wild at a large scale, and a 3D object recognition system may therefore encounter many objects for which the system has received no training. Zero-Shot…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Ali Cheraghian , Shafin Rahman , Dylan Campbell , Lars Petersson

In recent years, deep discriminative models have achieved extraordinary performance on supervised learning tasks, significantly outperforming their generative counterparts. However, their success relies on the presence of a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Gaurav Pandey , Ambedkar Dukkipati

Deep learning has gained broad interest in remote sensing image scene classification thanks to the effectiveness of deep neural networks in extracting the semantics from complex data. However, deep networks require large amounts of training…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Gianmarco Perantoni , Lorenzo Bruzzone

This paper presents a method of zero-shot learning (ZSL) which poses ZSL as the missing data problem, rather than the missing label problem. Specifically, most existing ZSL methods focus on learning mapping functions from the image feature…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Botong Wu , Tianfu Wu , Yizhou Wang