English
Related papers

Related papers: Equivariant Disentangled Transformation for Domain…

200 papers

Distribution shift presents a significant challenge in machine learning, where models often underperform during the test stage when faced with a different distribution than the one they were trained on. This paper focuses on domain shifts,…

Machine Learning · Computer Science 2024-03-19 Huaxiu Yao , Xinyu Yang , Xinyi Pan , Shengchao Liu , Pang Wei Koh , Chelsea Finn

We present a simple non-generative approach to deep representation learning that seeks equivariant deep embedding through simple objectives. In contrast to existing equivariant networks, our transformation coding approach does not constrain…

Machine Learning · Computer Science 2022-02-23 Mehran Shakerinava , Arnab Kumar Mondal , Siamak Ravanbakhsh

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate…

Machine Learning · Computer Science 2025-03-31 Kexin Zhang , Shuhan Liu , Song Wang , Weili Shi , Chen Chen , Pan Li , Sheng Li , Jundong Li , Kaize Ding

An applied problem facing all areas of data science is harmonizing data sources. Joining data from multiple origins with unmapped and only partially overlapping features is a prerequisite to developing and testing robust, generalizable…

In an era defined by rapid data evolution, traditional Machine Learning (ML) models often struggle to adapt to dynamic environments. Evolving Machine Learning (EML) has emerged as a pivotal paradigm, enabling continuous learning and…

Efficiently and reliably estimating uncertainty is an important objective in deep learning. It is especially pertinent to autoregressive sequence tasks, where training and inference costs are typically very high. However, existing research…

Machine Learning · Computer Science 2023-05-18 Yassir Fathullah , Guoxuan Xia , Mark Gales

Geographic distribution shift arises when the distribution of locations on Earth in a training dataset is different from what is seen at inference time. Using standard empirical risk minimization (ERM) in this setting can lead to uneven…

Machine Learning · Computer Science 2026-02-10 Ruth Crasto , Esther Rolf

An interesting phenomenon arises: Empirical Risk Minimization (ERM) sometimes outperforms methods specifically designed for out-of-distribution tasks. This motivates an investigation into the reasons behind such behavior beyond algorithmic…

Machine Learning · Computer Science 2026-01-21 Hong Zheng , Fei Teng

Many unsupervised domain adaptation (UDA) methods have been proposed to bridge the domain gap by utilizing domain invariant information. Most approaches have chosen depth as such information and achieved remarkable success. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Ting-Hsuan Liao , Huang-Ru Liao , Shan-Ya Yang , Jie-En Yao , Li-Yuan Tsao , Hsu-Shen Liu , Bo-Wun Cheng , Chen-Hao Chao , Chia-Che Chang , Yi-Chen Lo , Chun-Yi Lee

In this work, we explore the usage of the Frequency Transformation for reducing the domain shift between the source and target domain (e.g., synthetic image and real image respectively) towards solving the Domain Adaptation task. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vikash Kumar , Himanshu Patil , Rohit Lal , Anirban Chakraborty

Dual-encoder-based neural retrieval models achieve appreciable performance and complement traditional lexical retrievers well due to their semantic matching capabilities, which makes them a common choice for hybrid IR systems. However,…

Information Retrieval · Computer Science 2022-11-10 Jurek Leonhardt , Marcel Jahnke , Avishek Anand

Unsupervised domain adaptation methods seek to generalize effectively on unlabeled test data, especially when encountering the common challenge in time series data that distribution shifts occur between training and testing datasets. In…

Machine Learning · Computer Science 2025-08-27 Weide Liu , Xiaoyang Zhong , Lu Wang , Jingwen Hou , Yuemei Luo , Jiebin Yan , Yuming Fang

Disentanglement learning is central to understanding and reusing learned representations in variational autoencoders (VAEs). Although equivariance has been explored in this context, effectively exploiting it for disentanglement remains…

Machine Learning · Computer Science 2026-02-06 Hee-Jun Jung , Jaehyoung Jeong , Kangil Kim

This paper solves a generalized version of the problem of multi-source model adaptation for semantic segmentation. Model adaptation is proposed as a new domain adaptation problem which requires access to a pre-trained model instead of data…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Zongyao Li , Ren Togo , Takahiro Ogawa , Miki haseyama

Modern deep learning techniques have illustrated their excellent capabilities in many areas, but relies on large training data. Optimization-based meta-learning train a model on a variety tasks, such that it can solve new learning tasks…

Machine Learning · Computer Science 2023-02-23 Penghao Jiang , Ke Xin , Zifeng Wang , Chunxi Li

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

Continual Test-Time Adaptation (CTTA) enables pre-trained models to adapt to continuously evolving domains. Existing methods have improved robustness but typically rely on fixed or batch-level thresholds, which cannot account for varying…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seunghwan Lee , Inyoung Jung , Hojoon Lee , Eunil Park , Sungeun Hong

Deep learning models for clinical event prediction on electronic health records (EHR) often suffer performance degradation when deployed under different data distributions. While domain adaptation (DA) methods can mitigate such shifts, its…

Machine Learning · Computer Science 2026-02-16 Pengfei Hu , Chang Lu , Feifan Liu , Yue Ning

In many machine learning domains, datasets are characterized by highly imbalanced and overlapping classes. Particularly in the medical domain, a specific list of symptoms can be labeled as one of various different conditions. Some of these…

Machine Learning · Computer Science 2020-06-03 Ran Ilan Ber , Tom Haramaty