English
Related papers

Related papers: Equivariant Disentangled Transformation for Domain…

200 papers

Learning models that gracefully handle distribution shifts is central to research on domain generalization, robust optimization, and fairness. A promising formulation is domain-invariant learning, which identifies the key issue of learning…

Machine Learning · Computer Science 2021-07-16 Elliot Creager , Jörn-Henrik Jacobsen , Richard Zemel

Irregular distribution in latent space causes posterior collapse, misalignment between posterior and prior, and ill-sampling problem in Variational Autoencoders (VAEs). In this paper, we introduce a novel adaptable three-stage Uniform…

Machine Learning · Computer Science 2024-07-04 Ye Shi , C. S. George Lee

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

We propose a new framework for binary classification in transfer learning settings where both covariate and label distributions may shift between source and target domains. Unlike traditional covariate shift or label shift assumptions, we…

Methodology · Statistics 2025-09-29 Manli Cheng , Subha Maity , Qinglong Tian , Pengfei Li

In machine learning applications, distribution shifts between training and target environments can lead to significant drops in model performance. This study investigates the impact of such shifts on binary classification models within the…

Machine Learning · Statistics 2024-08-20 Minji Kim , Seong Jin Lee , Bumsik Kim

How to handle domain shifts when recognizing or segmenting visual data across domains has been studied by learning and vision communities. In this paper, we address domain generalized semantic segmentation, in which the segmentation model…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Zu-Yun Shiau , Wei-Wei Lin , Ci-Siang Lin , Yu-Chiang Frank Wang

The learning of Transformation-Equivariant Representations (TERs), which is introduced by Hinton et al. \cite{hinton2011transforming}, has been considered as a principle to reveal visual structures under various transformations. It contains…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Guo-Jun Qi , Liheng Zhang , Chang Wen Chen , Qi Tian

A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For instance, labels of images are invariant under translations of…

Machine Learning · Statistics 2021-03-01 Song Mei , Theodor Misiakiewicz , Andrea Montanari

Test-time adaptation (TTA) aims to improve model generalizability when test data diverges from training distribution, offering the distinct advantage of not requiring access to training data and processes, especially valuable in the context…

Machine Learning · Computer Science 2024-02-28 Yige Yuan , Bingbing Xu , Liang Hou , Fei Sun , Huawei Shen , Xueqi Cheng

For tabular datasets, the change in the relationship between the label and covariates ($Y|X$-shifts) is common due to missing variables (a.k.a. confounders). Since it is impossible to generalize to a completely new and unknown domain, we…

Machine Learning · Computer Science 2024-10-11 Yibo Zeng , Jiashuo Liu , Henry Lam , Hongseok Namkoong

Dynamic graph neural networks (DGNNs) are increasingly pervasive in exploiting spatio-temporal patterns on dynamic graphs. However, existing works fail to generalize under distribution shifts, which are common in real-world scenarios. As…

Machine Learning · Computer Science 2023-11-21 Haonan Yuan , Qingyun Sun , Xingcheng Fu , Ziwei Zhang , Cheng Ji , Hao Peng , Jianxin Li

In model serving, having one fixed model during the entire often life-long inference process is usually detrimental to model performance, as data distribution evolves over time, resulting in lack of reliability of the model trained on…

Artificial Intelligence · Computer Science 2020-12-16 Yiming Xu , Diego Klabjan

How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The disentangled representation learning approach posits that such an agent would benefit from separating out (disentangling) the underlying structure of…

Machine Learning · Computer Science 2018-12-07 Irina Higgins , David Amos , David Pfau , Sebastien Racaniere , Loic Matthey , Danilo Rezende , Alexander Lerchner

Convolution neural network is successful in pervasive vision tasks, including label distribution learning, which usually takes the form of learning an injection from the non-linear visual features to the well-defined labels. However, how…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ping Chen , Xingpeng Zhang , Chengtao Zhou , Dichao Fan , Peng Tu , Le Zhang , Yanlin Qian

Entity alignment (EA) refers to the task of linking entities in different knowledge graphs (KGs). Existing EA methods rely heavily on structural isomorphism. However, in real-world KGs, aligned entities usually have non-isomorphic…

Computation and Language · Computer Science 2024-11-06 Linyan Yang , Jingwei Cheng , Chuanhao Xu , Xihao Wang , Jiayi Li , Fu Zhang

Domain Adaptation (DA) enables transferring a learning machine from a labeled source domain to an unlabeled target one. While remarkable advances have been made, most of the existing DA methods focus on improving the target accuracy at…

Machine Learning · Computer Science 2020-11-10 Ximei Wang , Mingsheng Long , Jianmin Wang , Michael I. Jordan

Domain generalization (DG) aims to learn a model on several source domains, hoping that the model can generalize well to unseen target domains. The distribution shift between domains contains the covariate shift and conditional shift, both…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Jianxin Lin , Yongqiang Tang , Junping Wang , Wensheng Zhang

Electromagnetic phenomena are mathematically described by solutions of boundary value problems. For exploiting symmetries of these boundary value problems in a way that is offered by techniques of dimensional reduction, it needs to be…

Numerical Analysis · Mathematics 2020-04-20 Marcus Christian Lehmann , Mirsad Hadžiefendić , Albert Piwonski , Rolf Schuhmann

Real-world learning tasks often encounter uncertainty due to covariate shift and noisy or inconsistent labels. However, existing robust learning methods merge these effects into a single distributional uncertainty set. In this work, we…

Methodology · Statistics 2026-03-17 Varun Venkatesh , Eyke Hüllermeier , Bernd Bischl , Mina Rezaei