English
Related papers

Related papers: TTTFlow: Unsupervised Test-Time Training with Norm…

200 papers

Nowadays, the volume of network traffic continues to grow, along with the frequency and sophistication of attacks. This scenario highlights the need for solutions capable of continuously adapting, since network behavior is dynamic and…

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

Machine Learning · Computer Science 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

With the rapid development of the Internet, various types of anomaly traffic are threatening network security. We consider the problem of anomaly network traffic detection and propose a three-stage anomaly detection framework using only…

Machine Learning · Computer Science 2024-03-19 Zhangxuan Dang , Yu Zheng , Xinglin Lin , Chunlei Peng , Qiuyu Chen , Xinbo Gao

Improving model's generalizability against domain shifts is crucial, especially for safety-critical applications such as autonomous driving. Real-world domain styles can vary substantially due to environment changes and sensor noises, but…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Qi Fan , Mattia Segu , Yu-Wing Tai , Fisher Yu , Chi-Keung Tang , Bernt Schiele , Dengxin Dai

Neural networks are notorious for being overconfident predictors, posing a significant challenge to their safe deployment in real-world applications. While feature normalization has garnered considerable attention within the deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Sudarshan Regmi , Bibek Panthi , Sakar Dotel , Prashnna K. Gyawali , Danail Stoyanov , Binod Bhattarai

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

Unsupervised domain adaptation (UDA) aims to address the domain-shift problem between a labeled source domain and an unlabeled target domain. Many efforts have been made to address the mismatch between the distributions of training and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Pingyang Dai , Peixian Chen , Qiong Wu , Xiaopeng Hong , Qixiang Ye , Qi Tian , Rongrong Ji

The sampling of probability distributions specified up to a normalization constant is an important problem in both machine learning and statistical mechanics. While classical stochastic sampling methods such as Markov Chain Monte Carlo…

Machine Learning · Statistics 2020-10-27 Hao Wu , Jonas Köhler , Frank Noé

Unsupervised domain adaptation aims to transfer knowledge from a source domain to a target domain so that the target domain data can be recognized without any explicit labelling information for this domain. One limitation of the problem…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Qian Wang , Penghui Bu , Toby P. Breckon

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

Deep neural networks, trained with large amount of labeled data, can fail to generalize well when tested with examples from a \emph{target domain} whose distribution differs from the training data distribution, referred as the \emph{source…

The accuracy of deep learning (e.g., convolutional neural networks) for an image classification task critically relies on the amount of labeled training data. Aiming to solve an image classification task on a new domain that lacks labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Xianghong Fang , Haoli Bai , Ziyi Guo , Bin Shen , Steven Hoi , Zenglin Xu

In this paper, we study the application of Test-Time Training (TTT) as a solution to handling distribution shifts in speech applications. In particular, we introduce distribution-shifts to the test datasets of standard speech-classification…

Sound · Computer Science 2023-10-02 Sri Harsha Dumpala , Chandramouli Sastry , Sageev Oore

Convolutional neural networks provide visual features that perform remarkably well in many computer vision applications. However, training these networks requires significant amounts of supervision. This paper introduces a generic framework…

Machine Learning · Statistics 2017-04-19 Piotr Bojanowski , Armand Joulin

Existing methods for unsupervised domain adaptation often rely on minimizing some statistical distance between the source and target samples in the latent space. To avoid the sampling variability, class imbalance, and data-privacy concerns…

Machine Learning · Computer Science 2021-10-26 Korawat Tanwisuth , Xinjie Fan , Huangjie Zheng , Shujian Zhang , Hao Zhang , Bo Chen , Mingyuan Zhou

This paper introduces temporal-conditioned normalizing flows (tcNF), a novel framework that addresses anomaly detection in time series data with accurate modeling of temporal dependencies and uncertainty. By conditioning normalizing flows…

Machine Learning · Computer Science 2026-03-11 David Baumgartner , Helge Langseth , Kenth Engø-Monsen , Heri Ramampiaro

Although achieving remarkable progress, it is very difficult to induce a supervised classifier without any labeled data. Unsupervised domain adaptation is able to overcome this challenge by transferring knowledge from a labeled source…

Machine Learning · Computer Science 2021-06-29 Yuntao Du , Ruiting Zhang , Xiaowen Zhang , Yirong Yao , Hengyang Lu , Chongjun Wang

Test-time training (TTT) enhances model performance by explicitly updating designated parameters prior to each prediction to adapt to the test data. While TTT has demonstrated considerable empirical success, its theoretical underpinnings…

Machine Learning · Statistics 2026-02-03 Kento Kuwataka , Taiji Suzuki

Machine learning is driven by data, yet while their availability is constantly increasing, training data require laborious, time consuming and error-prone labelling or ground truth acquisition, which in some cases is very difficult or even…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Vasileios Gkitsas , Antonis Karakottas , Nikolaos Zioulis , Dimitrios Zarpalas , Petros Daras

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino