English
Related papers

Related papers: Disentangling Masked Autoencoders for Unsupervised…

200 papers

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Distributed learning and Edge AI necessitate efficient data processing, low-latency communication, decentralized model training, and stringent data privacy to facilitate real-time intelligence on edge devices while reducing dependency on…

Machine Learning · Computer Science 2025-07-08 Lucas Heublein , Simon Kocher , Tobias Feigl , Alexander Rügamer , Christopher Mutschler , Felix Ott

Deep neural networks (DNNs) usually fail to generalize well to outside of distribution (OOD) data, especially in the extreme case of single domain generalization (single-DG) that transfers DNNs from single domain to multiple unseen domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Sanqing Qu , Yingwei Pan , Guang Chen , Ting Yao , Changjun Jiang , Tao Mei

Robust segmentation is critical for deriving quantitative measures from large-scale, multi-center, and longitudinal medical scans. Manually annotating medical scans, however, is expensive and labor-intensive and may not always be available…

The ability to generalize learned representations across significantly different visual domains, such as between real photos, clipart, paintings, and sketches, is a fundamental capacity of the human visual system. In this paper, different…

While recent person re-identification (ReID) methods achieve high accuracy in a supervised setting, their generalization to an unlabelled domain is still an open problem. In this paper, we introduce a novel unsupervised disentanglement…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Yacine Khraimeche , Guillaume-Alexandre Bilodeau , David Steele , Harshad Mahadik

Unsupervised Multiple Domain Translation is the task of transforming data from one domain to other domains without having paired data to train the systems. Typically, methods based on Generative Adversarial Networks (GANs) are used to…

Machine Learning · Computer Science 2024-01-19 Antonio Almudévar , Théo Mariotte , Alfonso Ortega , Marie Tahon

Disentangled generative models map a latent code vector to a target space, while enforcing that a subset of the learned latent codes are interpretable and associated with distinct properties of the target distribution. Recent advances have…

Machine Learning · Computer Science 2020-08-10 Zinan Lin , Kiran Koshy Thekumparampil , Giulia Fanti , Sewoong Oh

Generalized Category Discovery (GCD) aims to leverage labeled samples from known categories to cluster unlabeled data that may include both known and unknown categories. While existing methods have achieved impressive results under standard…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Wei Feng , Zongyuan Ge

Unsupervised Domain Adaptation (UDA) is the task of bridging the domain gap between a labeled source domain, e.g., synthetic data, and an unlabeled target domain. We observe that current UDA methods show inferior results on fine structures…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Linyan Yang , Lukas Hoyer , Mark Weber , Tobias Fischer , Dengxin Dai , Laura Leal-Taixé , Marc Pollefeys , Daniel Cremers , Luc Van Gool

Unsupervised multivariate time series (MTS) representation learning aims to extract compact and informative representations from raw sequences without relying on labels, enabling efficient transfer to diverse downstream tasks. In this…

Machine Learning · Computer Science 2025-09-22 Yi Xu , Yitian Zhang , Yun Fu

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

Various deep learning models have been developed to segment anatomical structures from medical images, but they typically have poor performance when tested on another target domain with different data distribution. Recently, unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2022-01-21 Linkai Peng , Li Lin , Pujin Cheng , Ziqi Huang , Xiaoying Tang

Deep neural networks have become increasingly of interest in dynamical system prediction, but out-of-distribution generalization and long-term stability still remains challenging. In this work, we treat the domain parameters of dynamical…

Machine Learning · Computer Science 2023-06-02 Stathi Fotiadis , Mario Lino , Shunlong Hu , Stef Garasto , Chris D Cantwell , Anil Anthony Bharath

Dysarthric speech detection (DSD) systems aim to detect characteristics of the neuromotor disorder from speech. Such systems are particularly susceptible to domain mismatch where the training and testing data come from the source and target…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-26 Disong Wang , Liqun Deng , Yu Ting Yeung , Xiao Chen , Xunying Liu , Helen Meng

A dominant approach for addressing unsupervised domain adaptation is to map data points for the source and the target domains into an embedding space which is modeled as the output-space of a shared deep encoder. The encoder is trained to…

Machine Learning · Computer Science 2022-09-30 Mohammad Rostami

The primary objective of domain adaptation methods is to transfer knowledge from a source domain to a target domain that has similar but different data distributions. Thus, in order to correctly classify the unlabeled target domain samples,…

Machine Learning · Computer Science 2019-08-12 Rohith AP , Ambedkar Dukkipati , Gaurav Pandey

Cross-domain disentanglement is the problem of learning representations partitioned into domain-invariant and domain-specific representations, which is a key to successful domain transfer or measuring semantic distance between two domains.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 HyeongJoo Hwang , Geon-Hyeong Kim , Seunghoon Hong , Kee-Eung Kim

At the core of both successful generative and self-supervised representation learning models there is a reconstruction objective that incorporates some form of image corruption. Diffusion models implement this approach through a scheduled…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Philippe Hansen-Estruch , Sriram Vishwanath , Amy Zhang , Manan Tomar

We introduce a novel masked graph autoencoder (MGAE) framework to perform effective learning on graph structure data. Taking insights from self-supervised learning, we randomly mask a large proportion of edges and try to reconstruct these…

Machine Learning · Computer Science 2022-01-10 Qiaoyu Tan , Ninghao Liu , Xiao Huang , Rui Chen , Soo-Hyun Choi , Xia Hu