English
Related papers

Related papers: Mixstyle-Entropy: Domain Generalization with Causa…

200 papers

While deep neural networks are highly effective at solving complex tasks, large pre-trained models are commonly employed even to solve consistently simpler downstream tasks, which do not necessarily require a large model's complexity.…

Machine Learning · Computer Science 2024-06-06 Victor Quétu , Zhu Liao , Enzo Tartaglione

Deep Neural Networks (DNNs) suffer from domain shift when the test dataset follows a distribution different from the training dataset. Domain generalization aims to tackle this issue by learning a model that can generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yu Ding , Lei Wang , Bin Liang , Shuming Liang , Yang Wang , Fang Chen

The class of problems in causal inference which seeks to isolate causal correlations solely from observational data even without interventions has come to the forefront of machine learning, neuroscience and social sciences. As new large…

Emerging Technologies · Computer Science 2022-01-02 Mohammad Ali Javidian , Vaneet Aggarwal , Fanglin Bao , Zubin Jacob

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the…

Machine Learning · Computer Science 2019-10-29 Raha Moraffah , Kai Shu , Adrienne Raglin , Huan Liu

Crisis classification in social media aims to extract actionable disaster-related information from multimodal posts, which is a crucial task for enhancing situational awareness and facilitating timely emergency responses. However, the wide…

Deep neural networks (DNNs) are a contemporary solution for semantic segmentation and are usually trained to operate on a predefined closed set of classes. In open-set environments, it is possible to encounter semantically unknown objects…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jurica Runtas , Tomislav Petkovic

Modern deep neural networks struggle to transfer knowledge and generalize across diverse domains when deployed to real-world applications. Currently, domain generalization (DG) is introduced to learn a universal representation from multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yijun Yang , Shujun Wang , Lei Zhu , Lequan Yu

In this work, we propose a domain generalization (DG) approach to learn on several labeled source domains and transfer knowledge to a target domain that is inaccessible in training. Considering the inherent conditional and label shifts, we…

Machine Learning · Computer Science 2021-07-26 Xiaofeng Liu , Bo Hu , Linghao Jin , Xu Han , Fangxu Xing , Jinsong Ouyang , Jun Lu , Georges EL Fakhri , Jonghye Woo

In this paper, we tackle the problem of training with multiple source domains with the aim to generalize to new domains at test time without an adaptation step. This is known as domain generalization (DG). Previous works on DG assume…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Mohammad Mahfujur Rahman , Clinton Fookes , Sridha Sridharan

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla

Given a causal graph representing the data-generating process shared across different domains/distributions, enforcing sufficient graph-implied conditional independencies can identify domain-general (non-spurious) feature representations.…

Machine Learning · Computer Science 2024-04-26 Olawale Salaudeen , Sanmi Koyejo

Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Xingxuan Zhang , Linjun Zhou , Renzhe Xu , Peng Cui , Zheyan Shen , Haoxin Liu

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

Information Theory · Computer Science 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal

We propose a novel regularizer to improve the training of Generative Adversarial Networks (GANs). The motivation is that when the discriminator D spreads out its model capacity in the right way, the learning signals given to the generator G…

Machine Learning · Computer Science 2018-05-11 Yanshuai Cao , Gavin Weiguang Ding , Kry Yik-Chau Lui , Ruitong Huang

We propose a notion of causal influence that describes the `intrinsic' part of the contribution of a node on a target node in a DAG. By recursively writing each node as a function of the upstream noise terms, we separate the intrinsic…

Artificial Intelligence · Computer Science 2024-06-07 Dominik Janzing , Patrick Blöbaum , Atalanti A. Mastakouri , Philipp M. Faller , Lenon Minorics , Kailash Budhathoki

In Domain Generalization (DG) settings, models trained independently on a given set of training domains have notoriously chaotic performance on distribution shifted test domains, and stochasticity in optimization (e.g. seed) plays a big…

Machine Learning · Computer Science 2022-10-14 Devansh Arpit , Huan Wang , Yingbo Zhou , Caiming Xiong

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit…

Machine Learning · Computer Science 2025-06-16 Deliang Jin , Gang Chen , Shuo Feng , Yufeng Ling , Haoran Zhu

Experience replay, the reuse of past data to improve sample efficiency, is ubiquitous in reinforcement learning. Though a variety of smart sampling schemes have been introduced to improve performance, uniform sampling by far remains the…

Machine Learning · Computer Science 2024-10-22 Parham Mohammad Panahi , Andrew Patterson , Martha White , Adam White

Exploratory analysis of time series data can yield a better understanding of complex dynamical systems. Granger causality is a practical framework for analysing interactions in sequential data, applied in a wide range of domains. In this…

Machine Learning · Computer Science 2021-01-20 Ričards Marcinkevičs , Julia E. Vogt