English
Related papers

Related papers: MixNorm: Test-Time Adaptation Through Online Norma…

200 papers

High-dimensional changepoint inference that adapts to various change patterns has received much attention recently. We propose a simple, fast yet effective approach for adaptive changepoint testing. The key observation is that two…

Methodology · Statistics 2022-05-03 Guanghui Wang , Long Feng

Surface defect detection is significant in industrial production. However, detecting defects with varying textures and anomaly classes during the test time is challenging. This arises due to the differences in data distributions between…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yiran Song , Qianyu Zhou , Lizhuang Ma

Deep neural networks have a clear degradation when applying to the unseen environment due to the covariate shift. Conventional approaches like domain adaptation requires the pre-collected target data for iterative training, which is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Fuming You , Jingjing Li , Zhou Zhao

A default assumption in many machine learning scenarios is that the training and test samples are drawn from the same probability distribution. However, such an assumption is often violated in the real world due to non-stationarity of the…

Machine Learning · Computer Science 2021-05-04 Tianyi Zhang , Ikko Yamane , Nan Lu , Masashi Sugiyama

We consider offline detection of a single changepoint in binary and count time-series. We compare exact tests based on the cumulative sum (CUSUM) and the likelihood ratio (LR) statistics, and a new proposal that combines exact two-sample…

Methodology · Statistics 2020-08-21 Shyamal K. De , Soumendu Sundar Mukherjee

Out-of-distribution (OOD) detection is essential for the reliability of ML models. Most existing methods for OOD detection learn a fixed decision criterion from a given in-distribution dataset and apply it universally to decide if a data…

Machine Learning · Computer Science 2023-11-29 YiFan Zhang , Xue Wang , Tian Zhou , Kun Yuan , Zhang Zhang , Liang Wang , Rong Jin , Tieniu Tan

Data augmentation has emerged as a powerful technique for improving the performance of deep neural networks and led to state-of-the-art results in computer vision. However, state-of-the-art data augmentation strongly distorts training…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Amil Merchant , Barret Zoph , Ekin Dogus Cubuk

Existing trajectory prediction methods exhibit significant performance degradation under distribution shifts during test time. Although test-time training techniques have been explored to enable adaptation, current approaches rely on an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yuning Wang , Pu Zhang , Yuan He , Ke Wang , Jianru Xue

Test-time adaptation is a promising research direction that allows the source model to adapt itself to changes in data distribution without any supervision. Yet, current methods are usually evaluated on benchmarks that are only a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Damian Sójka , Sebastian Cygert , Bartłomiej Twardowski , Tomasz Trzciński

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

Machine Learning · Computer Science 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

Machine Learning · Computer Science 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

We construct an adaptive independent Metropolis-Hastings sampler that uses a mixture of normals as a proposal distribution. To take full advantage of the potential of adaptive sampling our algorithm updates the mixture of normals…

Computation · Statistics 2008-01-15 P. Giordani , R. Kohn

In this paper, we propose energy-based sample adaptation at test time for domain generalization. Where previous works adapt their models to target domains, we adapt the unseen target samples to source-trained models. To this end, we design…

Machine Learning · Computer Science 2023-02-23 Zehao Xiao , Xiantong Zhen , Shengcai Liao , Cees G. M. Snoek

Batch normalization (BN) is a milestone technique in deep learning. It normalizes the activation using mini-batch statistics during training but the estimated population statistics during inference. This paper focuses on investigating the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Lei Huang , Yi Zhou , Tian Wang , Jie Luo , Xianglong Liu

To deal with the domain shift between training and test samples, current methods have primarily focused on learning generalizable features during training and ignore the specificity of unseen samples that are also critical during the test.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

We propose Neural Priming, a technique for adapting large pretrained models to distribution shifts and downstream tasks given few or no labeled examples. Presented with class names or unlabeled test samples, Neural Priming enables the model…

The two-sample test is a fundamental problem in statistics with a wide range of applications. In the realm of high-dimensional data, nonparametric methods have gained prominence due to their flexibility and minimal distributional…

Methodology · Statistics 2024-12-24 Zexi Cai , Wenbo Fei , Doudou Zhou

In this work, we investigate Batch Normalization technique and propose its probabilistic interpretation. We propose a probabilistic model and show that Batch Normalization maximazes the lower bound of its marginalized log-likelihood. Then,…

Machine Learning · Statistics 2018-03-22 Andrei Atanov , Arsenii Ashukha , Dmitry Molchanov , Kirill Neklyudov , Dmitry Vetrov

We consider the challenge of efficiently detecting changes within a network of sensors, where we also need to minimise communication between sensors and the cloud. We propose an online, communication-efficient method to detect such changes.…

Methodology · Statistics 2024-04-11 Ziyang Yang , Idris A. Eckley , Paul Fearnhead

Popular zero-shot models suffer due to artifacts inherited from pretraining. One particularly detrimental issue, caused by unbalanced web-scale pretraining data, is mismatched label distribution. Existing approaches that seek to repair the…

Machine Learning · Computer Science 2024-10-31 Changho Shin , Jitian Zhao , Sonia Cromp , Harit Vishwakarma , Frederic Sala