English
Related papers

Related papers: Online Feature Updates Improve Online (Generalized…

200 papers

What sorts of structure might enable a learner to discover classes from unlabeled data? Traditional approaches rely on feature-space similarity and heroic assumptions on the data. In this paper, we introduce unsupervised learning under…

Machine Learning · Computer Science 2022-12-02 Manley Roberts , Pranav Mani , Saurabh Garg , Zachary C. Lipton

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

To deal with distribution shifts in graph data, various graph out-of-distribution (OOD) generalization techniques have been recently proposed. These methods often employ a two-step strategy that first creates augmented environments and…

Machine Learning · Computer Science 2025-01-09 Song Wang , Xiaodong Yang , Rashidul Islam , Huiyuan Chen , Minghua Xu , Jundong Li , Yiwei Cai

Time series forecasting is of significant importance across various domains. However, it faces significant challenges due to distribution shift. This issue becomes particularly pronounced in online deployment scenarios where data arrives…

Machine Learning · Computer Science 2026-02-27 Xiannan Huang , Shuhan Qiu , Jiayuan Du , Chao Yang

Recently, a variety of regularization techniques have been widely applied in deep neural networks, such as dropout, batch normalization, data augmentation, and so on. These methods mainly focus on the regularization of weight parameters to…

Machine Learning · Computer Science 2019-08-16 Qianggang Ding , Sifan Wu , Hao Sun , Jiadong Guo , Shu-Tao Xia

Test-time adaptation (TTA) aims to adapt a pre-trained model to the target domain in a batch-by-batch manner during inference. While label distributions often exhibit imbalances in real-world scenarios, most previous TTA approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sunghyun Park , Seunghan Yang , Jaegul Choo , Sungrack Yun

This paper introduces an advanced approach for fortifying Federated Learning (FL) systems against label-flipping attacks. We propose a simplified consensus-based verification process integrated with an adaptive thresholding mechanism. This…

Cryptography and Security · Computer Science 2024-03-11 Zahir Alsulaimawi

Transfer learning has been demonstrated to be successful and essential in diverse applications, which transfers knowledge from related but different source domains to the target domain. Online transfer learning(OTL) is a more challenging…

Machine Learning · Computer Science 2020-02-12 Yuntao Du , Zhiwen Tan , Qian Chen , Yi Zhang , Chongjun Wang

Online learning updates models incrementally with new data, avoiding large storage requirements and costly model recalculations. In this paper, we introduce "OLR-WA; OnLine Regression with Weighted Average", a novel and versatile…

Machine Learning · Computer Science 2025-12-18 Mohammad Abu-Shaira , Alejandro Rodriguez , Greg Speegle , Victor Sheng , Ishfaq Ahmad

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

Machine Learning · Computer Science 2021-12-16 Xiaoxuan Wang , Rolf Stadler

This paper challenges the cross-domain semantic segmentation task, aiming to improve the segmentation accuracy on the unlabeled target domain without incurring additional annotation. Using the pseudo-label-based unsupervised domain…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Kai Zhang , Yifan Sun , Rui Wang , Haichang Li , Xiaohui Hu

Category discovery methods aim to find novel categories in unlabeled visual data. At training time, a set of labeled and unlabeled images are provided, where the labels correspond to the categories present in the images. The labeled data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Bingchen Zhao , Nico Lang , Serge Belongie , Oisin Mac Aodha

The processing of high-dimensional streaming data commonly utilizes online streaming feature selection (OSFS) techniques. However, practical implementations often face challenges with data incompleteness due to equipment failures and…

Machine Learning · Computer Science 2025-11-26 Ruiyang Xu

Complementary-label Learning (CLL) is a form of weakly supervised learning that trains an ordinary classifier using only complementary labels, which are the classes that certain instances do not belong to. While existing CLL studies…

Machine Learning · Computer Science 2023-05-16 Wei-I Lin , Gang Niu , Hsuan-Tien Lin , Masashi Sugiyama

Existing works typically treat cross-domain semantic segmentation (CDSS) as a data distribution mismatch problem and focus on aligning the marginal distribution or conditional distribution. However, the label shift issue is unfortunately…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Yahao Liu , Jinhong Deng , Jiale Tao , Tong Chu , Lixin Duan , Wen Li

Unsupervised Domain Adaptation (UDA), a branch of transfer learning where labels for target samples are unavailable, has been widely researched and developed in recent years with the help of adversarially trained models. Although existing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Changwei Xu , Jianfei Yang , Haoran Tang , Han Zou , Cheng Lu , Tianshuo Zhang

Unsupervised domain adaptive segmentation typically relies on self-training using pseudo labels predicted by a pre-trained network on an unlabeled target dataset. However, the noisy nature of such pseudo-labels presents a major bottleneck…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Md Shazid Islam , Sayak Nag , Arindam Dutta , Miraj Ahmed , Fahim Faisal Niloy , Shreyangshu Bera , Amit K. Roy-Chowdhury

In this work, we tackle the problem of online adaptation for stereo depth estimation, that consists in continuously adapting a deep network to a target video recordedin an environment different from that of the source training set. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Zhenyu Zhang , Stéphane Lathuilière , Andrea Pilzer , Nicu Sebe , Elisa Ricci , Jian Yang

State-of-the-art pre-trained language models (PLMs) outperform other models when applied to the majority of language processing tasks. However, PLMs have been found to degrade in performance under distribution shift, a phenomenon that…

Computation and Language · Computer Science 2022-12-06 Ayush Singh , John E. Ortega

Existing research into online multi-label classification, such as online sequential multi-label extreme learning machine (OSML-ELM) and stochastic gradient descent (SGD), has achieved promising performance. However, these works do not take…

Machine Learning · Computer Science 2020-06-15 Xiuwen Gong , Jiahui Yang , Dong Yuan , Wei Bao