English
Related papers

Related papers: A unified framework for dataset shift diagnostics

200 papers

The problem of detecting changes with multiple sensors has received significant attention in the literature. In many practical applications such as critical infrastructure monitoring and modeling of disease spread, a useful change…

Information Theory · Computer Science 2019-02-19 Mehmet Necip Kurt , Xiaodong Wang

This paper introduces a universal approach to seamlessly combine out-of-distribution (OOD) detection scores. These scores encompass a wide range of techniques that leverage the self-confidence of deep learning models and the anomalous…

Machine Learning · Statistics 2024-06-25 Eduardo Dadalto , Florence Alberge , Pierre Duhamel , Pablo Piantanida

Dependable visual drone detection is crucial for the secure integration of drones into the airspace. However, drone detection accuracy is significantly affected by domain shifts due to environmental changes, varied points of view, and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Fardad Dadboud , Hamid Azad , Varun Mehta , Miodrag Bolic , Iraj Mantegh

Unsupervised models can provide supplementary soft constraints to help classify new target data under the assumption that similar objects in the target set are more likely to share the same class label. Such models can also help detect…

Machine Learning · Computer Science 2015-03-13 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Badrul Sarwar , Jean-David Ruvini

To reduce annotation labor associated with object detection, an increasing number of studies focus on transferring the learned knowledge from a labeled source domain to another unlabeled target domain. However, existing methods assume that…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Xingxu Yao , Sicheng Zhao , Pengfei Xu , Jufeng Yang

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

Machine Learning · Computer Science 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

Detecting changepoints in datasets with many variates is a data science challenge of increasing importance. Motivated by the problem of detecting changes in the incidence of terrorism from a global terrorism database, we propose a novel…

Methodology · Statistics 2021-03-30 S. O. Tickle , I. A. Eckley , P. Fearnhead

In recent years, deep neural networks have emerged as a dominant machine learning tool for a wide variety of application domains. However, training a deep neural network requires a large amount of labeled data, which is an expensive process…

Computer Vision and Pattern Recognition · Computer Science 2017-06-26 Hemanth Venkateswara , Jose Eusebio , Shayok Chakraborty , Sethuraman Panchanathan

Recent advances in deep learning have led to the development of accurate and efficient models for various computer vision applications such as classification, segmentation, and detection. However, learning highly accurate models relies on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Poojan Oza , Vishwanath A. Sindagi , Vibashan VS , Vishal M. Patel

Dataset shift is common in credit scoring scenarios, and the inconsistency between the distribution of training data and the data that actually needs to be predicted is likely to cause poor model performance. However, most of the current…

Machine Learning · Computer Science 2021-12-21 Hongyi Qian , Baohui Wang , Ping Ma , Lei Peng , Songfeng Gao , You Song

Change point detection is a crucial aspect of analyzing time series data, as the presence of a change point indicates an abrupt and significant change in the process generating the data. While many algorithms for the problem of change point…

Machine Learning · Computer Science 2023-05-23 Mario Krause

Quantification learning deals with the task of estimating the target label distribution under label shift. In this paper, we first present a unifying framework, distribution feature matching (DFM), that recovers as particular instances…

Machine Learning · Statistics 2023-07-04 Bastien Dussap , Gilles Blanchard , Badr-Eddine Chérief-Abdellatif

Transfer learning plays a key role in modern data analysis when: (1) the target data are scarce but the source data are sufficient; (2) the distributions of the source and target data are heterogeneous. This paper develops an interpretable…

Machine Learning · Statistics 2024-01-31 Shuo Shuo Liu

Few-shot image classification remains challenging due to the scarcity of labeled training examples. Augmenting them with synthetic data has emerged as a promising way to alleviate this issue, but models trained on synthetic samples often…

Machine Learning · Computer Science 2025-06-26 Lan-Cuong Nguyen , Quan Nguyen-Tri , Bang Tran Khanh , Dung D. Le , Long Tran-Thanh , Khoat Than

High dimensional hypothesis test deals with models in which the number of parameters is significantly larger than the sample size. Existing literature develops a variety of individual tests. Some of them are sensitive to the dense and small…

Statistics Theory · Mathematics 2018-08-09 Cheng Zhou , Xinsheng Zhang , Wenxin Zhou , Han Liu

Performance of trained neural network (NN) models, in terms of testing accuracy, has improved remarkably over the past several years, especially with the advent of deep learning. However, even the most accurate NNs can be biased toward a…

Machine Learning · Computer Science 2023-03-14 Mahum Naseer , Bharath Srinivas Prabakaran , Osman Hasan , Muhammad Shafique

Person re-identification (Re-ID) across multiple datasets is a challenging task due to two main reasons: the presence of large cross-dataset distinctions and the absence of annotated target instances. To address these two issues, this paper…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yangru Huang , Peixi Peng , Yi Jin , Yidong Li , Junliang Xing , Shiming Ge

We study the open-set label shift problem, where the test data may include a novel class absent from training. This setting is challenging because both the class proportions and the distribution of the novel class are not identifiable…

Methodology · Statistics 2025-09-19 Siyan Liu , Yukun Liu , Qinglong Tian , Pengfei Li , Jing Qin

This paper presents a framework for deep transfer learning, which aims to leverage information from multi-domain upstream data with a large number of samples $n$ to a single-domain downstream task with a considerably smaller number of…

Machine Learning · Computer Science 2025-01-07 Yuling Jiao , Huazhen Lin , Yuchen Luo , Jerry Zhijian Yang

In practice, the data distribution at test time often differs, to a smaller or larger extent, from that of the original training data. Consequentially, the so-called source classifier, trained on the available labelled data, deteriorates on…

Machine Learning · Statistics 2021-06-18 Wouter M. Kouw , Marco Loog