English
Related papers

Related papers: Adapting to Shifting Correlations with Unlabeled D…

200 papers

Transformer models have achieved profound success in prediction tasks in a wide range of applications in natural language processing, speech recognition and computer vision. Extending Transformer's success to safety-critical domains…

Machine Learning · Computer Science 2025-09-11 Wenlong Chen , Yingzhen Li

One of the most common pitfalls often found in high dimensional biological data sets are correlations between the features. This may lead to statistical and machine learning methodologies overvaluing or undervaluing these correlated…

Machine Learning · Computer Science 2021-11-18 Troy Maaslandand , João Pereira , Diogo Bastos , Marcus de Goffau , Max Nieuwdorp , Aeilko H. Zwinderman , Evgeni Levin

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, thus facing a drastic…

Machine Learning · Computer Science 2024-03-05 Inseop Chung , Kyomin Hwang , Jayeon Yoo , Nojun Kwak

Domain generalization(DG) endeavors to develop robust models that possess strong generalizability while preserving excellent discriminability. Nonetheless, pivotal DG techniques tend to improve the feature generalizability by learning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shaocong Long , Qianyu Zhou , Chenhao Ying , Lizhuang Ma , Yuan Luo

We consider the problem of active domain adaptation (ADA) to unlabeled target data, of which subset is actively selected and labeled given a budget constraint. Inspired by recent analysis on a critical issue from label distribution mismatch…

Machine Learning · Computer Science 2022-08-16 Sehyun Hwang , Sohyun Lee , Sungyeon Kim , Jungseul Ok , Suha Kwak

Spatial data display correlation between observations collected at neighboring locations. Generally, machine and deep learning methods either do not account for this correlation or do so indirectly through correlated features and thereby…

Methodology · Statistics 2024-10-08 Matthew J. Heaton , Andrew Millane , Jake S. Rhodes

Estimating the generalization error (GE) of machine learning models is fundamental, with resampling methods being the most common approach. However, in non-standard settings, particularly those where observations are not independently and…

Real-world data streams exhibit inherent non-stationarity characterized by concept drift, posing significant challenges for adaptive learning systems. While existing methods address isolated distribution shifts, they overlook the critical…

Machine Learning · Computer Science 2026-03-24 En Yu , Jie Lu , Guangquan Zhang

Graph neural networks (GNNs) have demonstrated remarkable success in numerous graph analytical tasks. Yet, their effectiveness is often compromised in real-world scenarios due to distribution shifts, limiting their capacity for knowledge…

Machine Learning · Computer Science 2024-07-30 Renhong Huang , Jiarong Xu , Xin Jiang , Ruichuan An , Yang Yang

Despite the remarkable success of deep neural networks (DNNs), the security threat of adversarial attacks poses a significant challenge to the reliability of DNNs. In this paper, both theoretically and empirically, we discover a universal…

Machine Learning · Computer Science 2025-06-10 Ran Wang , Xinlei Zhou , Meng Hu , Rihao Li , Wenhui Wu , Yuheng Jia

Unsupervised Domain Adaptation (UDA) aims to generalize the knowledge learned from a well-labeled source domain to an unlabeled target domain. Recently, adversarial domain adaptation with two distinct classifiers (bi-classifier) has been…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Zhekai Du , Jingjing Li , Hongzu Su , Lei Zhu , Ke Lu

Instance-dependent label noise is realistic but rather challenging, where the label-corruption process depends on instances directly. It causes a severe distribution shift between the distributions of training and test data, which impairs…

Machine Learning · Computer Science 2022-10-12 Manyi Zhang , Yuxin Ren , Zihao Wang , Chun Yuan

This paper introduces a novel Bayesian approach to detect changes in the variance of a Gaussian sequence model, focusing on quantifying the uncertainty in the change point locations and providing a scalable algorithm for inference. Such a…

Methodology · Statistics 2025-03-04 Lorenzo Cappello , Oscar Hernan Madrid Padilla

Source-free domain adaptation (SFDA) is compelling because it allows adapting an off-the-shelf model to a new domain using only unlabelled data. In this work, we apply existing SFDA techniques to a challenging set of naturally-occurring…

Machine Learning · Computer Science 2023-06-27 Malik Boudiaf , Tom Denton , Bart van Merriënboer , Vincent Dumoulin , Eleni Triantafillou

Geometric morphometrics (GMM) is widely used to quantify shape variation, more recently serving as input for machine learning (ML) analyses. Standard practice aligns all specimens via Generalized Procrustes Analysis (GPA) prior to splitting…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Lloyd Austin Courtenay

Many traditional signal recovery approaches can behave well basing on the penalized likelihood. However, they have to meet with the difficulty in the selection of hyperparameters or tuning parameters in the penalties. In this article, we…

Machine Learning · Statistics 2022-11-17 Bin Wang , Xiaofei Wang , Jianhua Guo

We consider the testing and estimation of change-points -- locations where the distribution abruptly changes -- in a data sequence. A new approach, based on scan statistics utilizing graphs representing the similarity between observations,…

Methodology · Statistics 2015-02-18 Hao Chen , Nancy Zhang

In real-world scenarios, tabular data often suffer from distribution shifts that threaten the performance of machine learning models. Despite its prevalence and importance, handling distribution shifts in the tabular domain remains…

Machine Learning · Computer Science 2025-02-13 Changhun Kim , Taewon Kim , Seungyeon Woo , June Yong Yang , Eunho Yang

Deep learning models can achieve high accuracy when trained on large amounts of labeled data. However, real-world scenarios often involve several challenges: Training data may become available in installments, may originate from multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Boqi Chen , Kevin Thandiackal , Pushpak Pati , Orcun Goksel

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy