中文
相关论文

相关论文: Selecting which Dense Retriever to use for Zero-Sh…

200 篇论文

In-line with the success of deep learning on traditional recognition problem, several end-to-end deep models for zero-shot recognition have been proposed in the literature. These models are successful to predict a single unseen label given…

计算机视觉与模式识别 · 计算机科学 2018-03-19 Shafin Rahman , Salman Khan

Dense retrieval is a basic building block of information retrieval applications. One of the main challenges of dense retrieval in real-world settings is the handling of queries containing misspelled words. A popular approach for handling…

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

机器学习 · 计算机科学 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

Recent advances in large pretrained language models have increased attention to zero-shot text classification. In particular, models finetuned on natural language inference datasets have been widely adopted as zero-shot classifiers due to…

计算与语言 · 计算机科学 2022-11-01 Ariel Gera , Alon Halfon , Eyal Shnarch , Yotam Perlitz , Liat Ein-Dor , Noam Slonim

In principle, zero-shot learning makes it possible to train a recognition model simply by specifying the category's attributes. For example, with classifiers for generic attributes like \emph{striped} and \emph{four-legged}, one can…

计算机视觉与模式识别 · 计算机科学 2016-03-30 Dinesh Jayaraman , Kristen Grauman

Hashing has been widely studied for big data retrieval due to its low storage cost and fast query speed. Zero-shot hashing (ZSH) aims to learn a hashing model that is trained using only samples from seen categories, but can generalize well…

机器学习 · 计算机科学 2019-08-21 Xuanwu Liu , Zhao Li , Jun Wang , Guoxian Yu , Carlotta Domeniconi , Xiangliang Zhang

Deep Neural Networks (DNNs) have been shown to be susceptible to memorization or overfitting in the presence of noisily-labelled data. For the problem of robust learning under such noisy data, several algorithms have been proposed. A…

机器学习 · 计算机科学 2022-12-06 Deep Patel , P. S. Sastry

Deploying deep visual models can lead to performance drops due to the discrepancies between source and target distributions. Several approaches leverage labeled source data to estimate target domain accuracy, but accessing labeled source…

计算机视觉与模式识别 · 计算机科学 2023-07-20 JoonHo Lee , Jae Oh Woo , Hankyu Moon , Kwonho Lee

Most visual recognition methods implicitly assume the data distribution remains unchanged from training to testing. However, in practice domain shift often exists, where real-world factors such as lighting and sensor type change between…

机器学习 · 计算机科学 2015-07-30 Yongxin Yang , Timothy Hospedales

Methods for object detection and segmentation often require abundant instance-level annotations for training, which are time-consuming and expensive to collect. To address this, the task of zero-shot object detection (or segmentation) aims…

计算机视觉与模式识别 · 计算机科学 2023-02-16 Siddhesh Khandelwal , Anirudth Nambirajan , Behjat Siddiquie , Jayan Eledath , Leonid Sigal

Dense retrieval methods have demonstrated promising performance in multilingual information retrieval, where queries and documents can be in different languages. However, dense retrievers typically require a substantial amount of paired…

计算与语言 · 计算机科学 2024-03-07 Chao-Wei Huang , Chen-An Li , Tsu-Yuan Hsu , Chen-Yu Hsu , Yun-Nung Chen

Mislabeled, duplicated, or biased data in real-world scenarios can lead to prolonged training and even hinder model convergence. Traditional solutions prioritizing easy or hard samples lack the flexibility to handle such a variety…

机器学习 · 计算机科学 2023-11-08 Zhijie Deng , Peng Cui , Jun Zhu

State-of-the-art deep neural network recognition systems are designed for a static and closed world. It is usually assumed that the distribution at test time will be the same as the distribution during training. As a result, classifiers are…

计算机视觉与模式识别 · 计算机科学 2019-02-28 Benjamin J. Meyer , Tom Drummond

Pretrained language models like BERT and T5 serve as crucial backbone encoders for dense retrieval. However, these models often exhibit limited generalization capabilities and face challenges in improving in domain accuracy. Recent research…

计算与语言 · 计算机科学 2024-08-26 Kun Luo , Minghao Qin , Zheng Liu , Shitao Xiao , Jun Zhao , Kang Liu

The availability of large labeled datasets is the key component for the success of deep learning. However, annotating labels on large datasets is generally time-consuming and expensive. Active learning is a research area that addresses the…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Felix Buchert , Nassir Navab , Seong Tae Kim

Dense retrieval approaches can overcome the lexical gap and lead to significantly improved search results. However, they require large amounts of training data which is not available for most domains. As shown in previous work (Thakur et…

计算与语言 · 计算机科学 2022-04-26 Kexin Wang , Nandan Thakur , Nils Reimers , Iryna Gurevych

Building dense retrievers requires a series of standard procedures, including training and validating neural models and creating indexes for efficient search. However, these procedures are often misaligned in that training objectives do not…

计算与语言 · 计算机科学 2022-10-26 Gyuwan Kim , Jinhyuk Lee , Barlas Oguz , Wenhan Xiong , Yizhe Zhang , Yashar Mehdad , William Yang Wang

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

音频与语音处理 · 电气工程与系统科学 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis

Entity linking aims to link ambiguous mentions to their corresponding entities in a knowledge base. One of the key challenges comes from insufficient labeled data for specific domains. Although dense retrievers have achieved excellent…

计算与语言 · 计算机科学 2023-10-20 Yulin Chen , Zhenran Xu , Baotian Hu , Min Zhang

Collecting and labeling real datasets to train the person search networks not only requires a lot of time and effort, but also accompanies privacy issues. The weakly-supervised and unsupervised domain adaptation methods have been proposed…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Minyoung Oh , Duhyun Kim , Jae-Young Sim