English
Related papers

Related papers: SelfReg: Self-supervised Contrastive Regularizatio…

200 papers

Recent advancements of sequential deep learning models such as Transformer and BERT have significantly facilitated the sequential recommendation. However, according to our study, the distribution of item embeddings generated by these models…

Information Retrieval · Computer Science 2021-11-19 Ruihong Qiu , Zi Huang , Hongzhi Yin , Zijian Wang

Classical machine learning assumes that the training and test sets come from the same distributions. Therefore, a model learned from the labeled training data is expected to perform well on the test data. However, This assumption may not…

Machine Learning · Computer Science 2020-10-12 Abolfazl Farahani , Sahar Voghoei , Khaled Rasheed , Hamid R. Arabnia

Accurate segmentation of retinal fluids in 3D Optical Coherence Tomography images is key for diagnosis and personalized treatment of eye diseases. While deep learning has been successful at this task, trained supervised models often fail…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Alvaro Gomariz , Huanxiang Lu , Yun Yvonna Li , Thomas Albrecht , Andreas Maunz , Fethallah Benmansour , Alessandra M. Valcarcel , Jennifer Luu , Daniela Ferrara , Orcun Goksel

Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different in these two…

Machine Learning · Computer Science 2019-11-20 Qian Wang , Toby P. Breckon

Domain Generalization (DG) aims to generalize a model trained on multiple source domains to an unseen target domain. The source domains always require precise annotations, which can be cumbersome or even infeasible to obtain in practice due…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Luojun Lin , Han Xie , Zhishu Sun , Weijie Chen , Wenxi Liu , Yuanlong Yu , Lei Zhang

Despite recent stereo matching networks achieving impressive performance given sufficient training data, they suffer from domain shifts and generalize poorly to unseen domains. We argue that maintaining feature consistency between matching…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Jiawei Zhang , Xiang Wang , Xiao Bai , Chen Wang , Lei Huang , Yimin Chen , Lin Gu , Jun Zhou , Tatsuya Harada , Edwin R. Hancock

Deep reinforcement learning (RL) agents trained in a limited set of environments tend to suffer overfitting and fail to generalize to unseen testing environments. To improve their generalizability, data augmentation approaches (e.g. cutout…

Machine Learning · Computer Science 2020-10-22 Kaixin Wang , Bingyi Kang , Jie Shao , Jiashi Feng

Existing unsupervised domain adaptation methods based on adversarial learning have achieved good performance in several medical imaging tasks. However, these methods focus only on global distribution adaptation and ignore distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Wei Feng , Lin Wang , Lie Ju , Xin Zhao , Xin Wang , Xiaoyu Shi , Zongyuan Ge

Domain generalization (DG) deals with the problem of domain shift where a machine learning model trained on multiple-source domains fail to generalize well on a target domain with different statistics. Multiple approaches have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP

Domain generalization aims at learning a universal model that performs well on unseen target domains, incorporating knowledge from multiple source domains. In this research, we consider the scenario where different domain shifts occur among…

Machine Learning · Computer Science 2024-03-26 Jingge Wang , Liyan Xie , Yao Xie , Shao-Lun Huang , Yang Li

This paper proposes a novel pixel-level distribution regularization scheme (DRSL) for self-supervised domain adaptation of semantic segmentation. In a typical setting, the classification loss forces the semantic segmentation model to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Javed Iqbal , Hamza Rawal , Rehan Hafiz , Yu-Tseh Chi , Mohsen Ali

The discriminability of feature representation is the key to open-set face recognition. Previous methods rely on the learnable weights of the classification layer that represent the identities. However, the evaluation process learns no…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Youzhe Song , Feng Wang

Domain shift is a formidable issue in Machine Learning that causes a model to suffer from performance degradation when tested on unseen domains. Federated Domain Generalization (FedDG) attempts to train a global model using collaborative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Khiem Le , Long Ho , Cuong Do , Danh Le-Phuoc , Kok-Seng Wong

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

Machine Learning · Computer Science 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

Deep convolutional neural networks for semantic segmentation achieve outstanding accuracy, however they also have a couple of major drawbacks: first, they do not generalize well to distributions slightly different from the one of the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Francesco Barbato , Marco Toldo , Umberto Michieli , Pietro Zanuttigh

Representations learned via self-supervised learning (SSL) can be susceptible to dimensional collapse, where the learned representation subspace is of extremely low dimensionality and thus fails to represent the full data distribution and…

Machine Learning · Computer Science 2024-03-15 Hanxun Huang , Ricardo J. G. B. Campello , Sarah Monazam Erfani , Xingjun Ma , Michael E. Houle , James Bailey

We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training…

Machine Learning · Computer Science 2023-10-31 Toan Nguyen , Kien Do , Bao Duong , Thin Nguyen

Current supervised learning models cannot generalize well across domain boundaries, which is a known problem in many applications, such as robotics or visual classification. Domain adaptation methods are used to improve these generalization…

Machine Learning · Computer Science 2020-07-09 Christoph Raab , Frank-Michael Schleif

Semantic segmentation models struggle to generalize in the presence of domain shift. In this paper, we introduce contrastive learning for feature alignment in cross-domain adaptation. We assemble both in-domain contrastive pairs and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Feihu Zhang , Vladlen Koltun , Philip Torr , René Ranftl , Stephan R. Richter

Deep learning has made significant advancements in supervised learning. However, models trained in this setting often face challenges due to domain shift between training and test sets, resulting in a significant drop in performance during…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Lei Qi , Hongpeng Yang , Yinghuan Shi , Xin Geng