English
Related papers

Related papers: Dense Retrieval Adaptation using Target Domain Des…

200 papers

In Information Retrieval, and more generally in Natural Language Processing, adapting models to specific domains is conducted through fine-tuning. Despite the successes achieved by this method and its versatility, the need for human-curated…

Information Retrieval · Computer Science 2024-07-08 Mathias Vast , Yuxuan Zong , Basile Van Cooten , Benjamin Piwowarski , Laure Soulier

The \textit{de facto} paradigm for applying dense retrieval (DR) to new tasks involves fine-tuning a pre-trained model for a specific task. However, this paradigm has two significant limitations: (1) It is difficult adapt the DR to a new…

Information Retrieval · Computer Science 2026-02-27 Zhan Su , Fengran Mo , Jinghan Zhang , Yuchen Hui , Jia Ao Sun , Bingbing Wen , Jian-Yun Nie

Dense retrievers have demonstrated significant potential for neural information retrieval; however, they lack robustness to domain shifts, limiting their efficacy in zero-shot settings across diverse domains. In this paper, we set out to…

Information Retrieval · Computer Science 2025-01-27 Goksenin Yuksel , Jaap Kamps

Dense retrievers have demonstrated significant potential for neural information retrieval; however, they exhibit a lack of robustness to domain shifts, thereby limiting their efficacy in zero-shot settings across diverse domains. Previous…

Information Retrieval · Computer Science 2025-01-27 Goksenin Yuksel , Jaap Kamps

Most visual recognition methods implicitly assume the data distribution remains unchanged from training to testing. However, in practice domain shift often exists, where real-world factors such as lighting and sensor type change between…

Machine Learning · Computer Science 2015-07-30 Yongxin Yang , Timothy Hospedales

Recent advance in Dense Retrieval (DR) techniques has significantly improved the effectiveness of first-stage retrieval. Trained with large-scale supervised data, DR models can encode queries and documents into a low-dimensional dense space…

Information Retrieval · Computer Science 2022-08-18 Jingtao Zhan , Qingyao Ai , Yiqun Liu , Jiaxin Mao , Xiaohui Xie , Min Zhang , Shaoping Ma

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Sicheng Zhao , Xiangyu Yue , Shanghang Zhang , Bo Li , Han Zhao , Bichen Wu , Ravi Krishna , Joseph E. Gonzalez , Alberto L. Sangiovanni-Vincentelli , Sanjit A. Seshia , Kurt Keutzer

We propose the new problem of choosing which dense retrieval model to use when searching on a new collection for which no labels are available, i.e. in a zero-shot setting. Many dense retrieval models are readily available. Each model…

Information Retrieval · Computer Science 2023-09-19 Ekaterina Khramtsova , Shengyao Zhuang , Mahsa Baktashmotlagh , Xi Wang , Guido Zuccon

Dense retrieval overcome the lexical gap and has shown great success in ad-hoc information retrieval (IR). Despite their success, dense retrievers are expensive to serve across practical use cases. For use cases requiring to search from…

Information Retrieval · Computer Science 2023-07-21 Nandan Thakur , Nils Reimers , Jimmy Lin

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

We study the problem of unsupervised domain adaptation, which aims to adapt classifiers trained on a labeled source domain to an unlabeled target domain. Many existing approaches first learn domain-invariant features and then construct…

Machine Learning · Computer Science 2012-07-03 Yuan Shi , Fei Sha

Recent studies have demonstrated that the ability of dense retrieval models to generalize to target domains with different distributions is limited, which contrasts with the results obtained with interaction-based models. Prior attempts to…

Information Retrieval · Computer Science 2024-03-15 Minghan Li , Eric Gaussier

Most domain adaptation methods focus on single-source-single-target adaptation settings. Multi-target domain adaptation is a powerful extension in which a single classifier is learned for multiple unlabeled target domains. To build a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Sudipan Saha , Shan Zhao , Nasrullah Sheikh , Xiao Xiang Zhu

We propose associative domain adaptation, a novel technique for end-to-end domain adaptation with neural networks, the task of inferring class labels for an unlabeled target domain based on the statistical properties of a labeled source…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Philip Haeusser , Thomas Frerix , Alexander Mordvintsev , Daniel Cremers

This literature review gives an overview of current approaches to perform domain adaptation in a low-resource and approaches to perform multilingual semantic search in a low-resource setting. We developed a new typology to cluster domain…

Information Retrieval · Computer Science 2024-02-06 Anna Bringmann , Anastasia Zhukova

The goal of domain adaptation is to adapt models learned on a source domain to a particular target domain. Most methods for unsupervised domain adaptation proposed in the literature to date, assume that the set of classes present in the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Ayush Mittal , Anant Raj , Vinay P. Namboodiri , Tinne Tuytelaars

Since annotating and curating large datasets is very expensive, there is a need to transfer the knowledge from existing annotated datasets to unlabelled data. Data that is relevant for a specific application, however, usually differs from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Pau Panareda Busto , Ahsan Iqbal , Juergen Gall

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Applying an object detector, which is neither trained nor fine-tuned on data close to the final application, often leads to a substantial performance drop. In order to overcome this problem, it is necessary to consider a shift between…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Alexey Abramov , Christopher Bayer , Claudio Heller

Domain adaptation investigates the problem of leveraging knowledge from a well-labeled source domain to an unlabeled target domain, where the two domains are drawn from different data distributions. Because of the distribution shifts,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Jingjing Li , Mengmeng Jing , Yue Xie , Ke Lu , Zi Huang
‹ Prev 1 2 3 10 Next ›