English
Related papers

Related papers: Multi-Scale and Multi-Layer Contrastive Learning f…

200 papers

One of the main drawbacks of deep Convolutional Neural Networks (DCNN) is that they lack generalization capability. In this work, we focus on the problem of heterogeneous domain generalization which aims to improve the generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Yufei Wang , Haoliang Li , Alex C. Kot

Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the…

Machine Learning · Computer Science 2019-10-29 Raha Moraffah , Kai Shu , Adrienne Raglin , Huan Liu

Adaptation to out-of-distribution data is a meta-challenge for all statistical learning algorithms that strongly rely on the i.i.d. assumption. It leads to unavoidable labor costs and confidence crises in realistic applications. For that,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Jingye Wang , Ruoyi Du , Dongliang Chang , Kongming Liang , Zhanyu Ma

In this paper, we present generalization bounds for the unsupervised risk in the Deep Contrastive Representation Learning framework, which employs deep neural networks as representation functions. We approach this problem from two angles.…

Machine Learning · Statistics 2024-12-20 Nong Minh Hieu , Antoine Ledent , Yunwen Lei , Cheng Yeaw Ku

Deep neural networks (DNNs) and, in particular, convolutional neural networks (CNNs) have brought significant advances in a wide range of modern computer application problems. However, the increasing availability of large amounts of…

Machine Learning · Computer Science 2024-07-03 Axel Klawonn , Martin Lanser , Janine Weber

Transformations in the input space of Deep Neural Networks (DNN) lead to unintended changes in the feature space. Almost perceptually identical inputs, such as adversarial examples, can have significantly distant feature representations. On…

Machine Learning · Computer Science 2022-11-29 Iordanis Fostiropoulos , Laurent Itti

We propose a simple neural network model to deal with the domain adaptation problem in object recognition. Our model incorporates the Maximum Mean Discrepancy (MMD) measure as a regularization in the supervised learning to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Muhammad Ghifary , W. Bastiaan Kleijn , Mengjie Zhang

Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. However, when applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. After…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Rang Meng , Xianfeng Li , Weijie Chen , Shicai Yang , Jie Song , Xinchao Wang , Lei Zhang , Mingli Song , Di Xie , Shiliang Pu

Domain generalization (DG) aims to learn a generalizable model from multiple training domains such that it can perform well on unseen target domains. A popular strategy is to augment training data to benefit generalization through methods…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Wang Lu , Jindong Wang , Han Yu , Lei Huang , Xiang Zhang , Yiqiang Chen , Xing Xie

Handling out-of-distribution samples is a long-lasting challenge for deep visual models. In particular, domain generalization (DG) is one of the most relevant tasks that aims to train a model with a generalization capability on novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Sang-Yeong Jo , Sung Whan Yoon

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales

Deep learning has gained great success in various classification tasks. Typically, deep learning models learn underlying features directly from data, and no underlying relationship between classes are included. Similarity between classes…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Xueli Xiao , Chunyan Ji , Thosini Bamunu Mudiyanselage , Yi Pan

The major challenge in today's computer vision scenario is the availability of good quality labeled data. In a field of study like image classification, where data is of utmost importance, we need to find more reliable methods which can…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Aashish Dhawan , Divyanshu Mudgal

Domain generalization (DG) is about learning models that generalize well to new domains that are related to, but different from, the training domain(s). It is a fundamental problem in machine learning and has attracted much attention in…

Machine Learning · Computer Science 2023-07-14 Nevin L. Zhang , Kaican Li , Han Gao , Weiyan Xie , Zhi Lin , Zhenguo Li , Luning Wang , Yongxiang Huang

Foundation models have achieved great success in natural language processing (NLP) and computer vision (CV). Their success largely stems from the ability to integrate multi-domain knowledge in pre-training and transfer it to target domains.…

Computation and Language · Computer Science 2025-07-01 Zihao Zhao , Xinlong Zhai , Jinyu Yang , Chuan Shi

Machine learning models that can generalize to unseen domains are essential when applied in real-world scenarios involving strong domain shifts. We address the challenging domain generalization (DG) problem, where a model trained on a set…

Machine Learning · Computer Science 2022-10-04 Ahmed Frikha , Denis Krompaß , Volker Tresp

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

Domain generalization (DG) aims to generalize a model trained on multiple source (i.e., training) domains to a distributionally different target (i.e., test) domain. In contrast to the conventional DG that strictly requires the availability…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zijian Wang , Yadan Luo , Ruihong Qiu , Zi Huang , Mahsa Baktashmotlagh

Domain Generalization (DG) techniques have emerged as a popular approach to address the challenges of domain shift in Deep Learning (DL), with the goal of generalizing well to the target domain unseen during the training. In recent years,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Aveen Dayal , Vimal K. B. , Linga Reddy Cenkeramaddi , C. Krishna Mohan , Abhinav Kumar , Vineeth N Balasubramanian

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz