English
Related papers

Related papers: Towards Learning free Naive Bayes Nearest Neighbor…

200 papers

Deep neural networks have demonstrated impressive performance in various machine learning tasks. However, they are notoriously sensitive to changes in data distribution. Often, even a slight change in the distribution can lead to drastic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Alon Hazan , Yoel Shoshan , Daniel Khapun , Roy Aladjem , Vadim Ratner

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

This paper addresses the general problem of domain adaptation which arises in a variety of applications where the distribution of the labeled sample available somewhat differs from that of the test data. Building on previous work by…

Machine Learning · Computer Science 2023-12-04 Yishay Mansour , Mehryar Mohri , Afshin Rostamizadeh

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Domain adaptation problems arise in a variety of applications, where a training dataset from the \textit{source} domain and a test dataset from the \textit{target} domain typically follow different distributions. The primary difficulty in…

Machine Learning · Computer Science 2017-08-11 Wenhao Jiang , Cheng Deng , Wei Liu , Feiping Nie , Fu-lai Chung , Heng Huang

Domain generalization (DG) deals with the problem of domain shift where a machine learning model trained on multiple-source domains fail to generalize well on a target domain with different statistics. Multiple approaches have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

Machine Learning · Computer Science 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani

Naive Bayes Nearest Neighbour (NBNN) is a simple and effective framework which addresses many of the pitfalls of K-Nearest Neighbour (KNN) classification. It has yielded competitive results on several computer vision benchmarks. Its central…

Machine Learning · Computer Science 2016-07-12 Daniel Jiwoong Im , Graham W. Taylor

Convolutional neural networks (CNNs) tend to become a standard approach to solve a wide array of computer vision problems. Besides important theoretical and practical advances in their design, their success is built on the existence of…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Adrian Popescu , Etienne Gadeski , Hervé Le Borgne

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

Machine Learning · Computer Science 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

Object detection typically assumes that training and test data are drawn from an identical distribution, which, however, does not always hold in practice. Such a distribution mismatch will lead to a significant performance drop. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-03-09 Yuhua Chen , Wen Li , Christos Sakaridis , Dengxin Dai , Luc Van Gool

Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. The hope is that the…

Machine Learning · Computer Science 2019-05-31 Han Zhao , Remi Tachet des Combes , Kun Zhang , Geoffrey J. Gordon

Domain adaptation enables the learner to safely generalize into novel environments by mitigating domain shifts across distributions. Previous works may not effectively uncover the underlying reasons that would lead to the drastic model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Ruijia Xu , Guanbin Li , Jihan Yang , Liang Lin

The major challenge in today's computer vision scenario is the availability of good quality labeled data. In a field of study like image classification, where data is of utmost importance, we need to find more reliable methods which can…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Aashish Dhawan , Divyanshu Mudgal

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

When there is a distributional shift between data used to train a predictive algorithm and current data, performance can suffer. This is known as the domain adaptation problem. Bootstrap aggregating, or bagging, is a popular method for…

Methodology · Statistics 2020-06-17 Meimei Liu , David B. Dunson

We consider unsupervised domain adaptation: given labelled examples from a source domain and unlabelled examples from a related target domain, the goal is to infer the labels of target examples. Under the assumption that features from…

Machine Learning · Statistics 2019-01-08 Jeroen Manders , Twan van Laarhoven , Elena Marchiori

We present Local Naive Bayes Nearest Neighbor, an improvement to the NBNN image classification algorithm that increases classification accuracy and improves its ability to scale to large numbers of object classes. The key observation is…

Computer Vision and Pattern Recognition · Computer Science 2011-12-02 Sancho McCann , David G. Lowe

We propose associative domain adaptation, a novel technique for end-to-end domain adaptation with neural networks, the task of inferring class labels for an unlabeled target domain based on the statistical properties of a labeled source…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Philip Haeusser , Thomas Frerix , Alexander Mordvintsev , Daniel Cremers