English
Related papers

Related papers: Mixstyle-Entropy: Domain Generalization with Causa…

200 papers

Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Many spatial phenomena exhibit treatment interference where treatments at one location may affect the response at other locations. Because interference violates the stable unit treatment value assumption, standard methods for causal…

Methodology · Statistics 2020-07-02 Andrew Giffin , Brian Reich , Shu Yang , Ana Rappold

Deep neural networks (DNNs) play a crucial role in the field of machine learning, demonstrating state-of-the-art performance across various application domains. However, despite their success, DNN-based models may occasionally exhibit…

Machine Learning · Computer Science 2024-07-02 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Inferring causal relationships in observational time series data is an important task when interventions cannot be performed. Granger causality is a popular framework to infer potential causal mechanisms between different time series. The…

Machine Learning · Computer Science 2022-07-22 Zexuan Yin , Paolo Barucca

Recent face presentation attack detection (PAD) leverages domain adaptation (DA) and domain generalization (DG) techniques to address performance degradation on unknown domains. However, DA-based PAD methods require access to unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Meiling Fang , Naser Damer

Supervised fine-tuning (SFT) is fundamental to adapting large language models, yet training on complete datasets incurs prohibitive costs with diminishing returns. Existing data selection methods suffer from severe domain specificity:…

Computation and Language · Computer Science 2026-02-02 Junyou Su , He Zhu , Xiao Luo , Liyu Zhang , Hong-Yu Zhou , Yun Chen , Peng Li , Yang Liu , Guanhua Chen

We study the problem of experiment design to learn causal structures from interventional data. We consider an active learning setting in which the experimenter decides to intervene on one of the variables in the system in each step and uses…

Artificial Intelligence · Computer Science 2020-09-09 Amir Amirinezhad , Saber Salehkaleybar , Matin Hashemi

Domain Generalization (DG) is a critical area that focuses on developing models capable of performing well on data from unseen distributions, which is essential for real-world applications. Existing approaches primarily concentrate on…

Machine Learning · Computer Science 2026-01-28 Xudong Han , Senkang Hu , Yihang Tao , Yu Guo , Philip Birch , Sam Tak Wu Kwong , Yuguang Fang

Causal discovery from observational data is challenging, especially with large datasets and complex relationships. Traditional methods often struggle with scalability and capturing global structural information. To overcome these…

Machine Learning · Computer Science 2025-07-29 Rezaur Rashid , Gabriel Terejanu

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

Machine Learning · Computer Science 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Causal inference is crucial for humans to explore the world, which can be modeled to enable an agent to efficiently explore the environment in reinforcement learning. Existing research indicates that establishing the causality between…

Machine Learning · Computer Science 2025-08-14 Yan Yu , Yaodong Yang , Zhengbo Lu , Chengdong Ma , Wengang Zhou , Houqiang Li

Deep neural networks (DNNs) are increasingly being deployed in high-stakes applications, from self-driving cars to biometric authentication. However, their unpredictable and unreliable behaviors in real-world settings require new approaches…

Cryptography and Security · Computer Science 2025-10-01 Firas Ben Hmida , Abderrahmen Amich , Ata Kaboudi , Birhanu Eshete

In this work, we propose a notion of practical learnability grounded in finite sample settings, and develop a conjugate learning theoretical framework based on convex conjugate duality to characterize this learnability property. Building on…

Machine Learning · Statistics 2026-02-20 Binchuan Qi

Learning in uncertain, noisy, or adversarial environments is a challenging task for deep neural networks (DNNs). We propose a new theoretically grounded and efficient approach for robust learning that builds upon Bayesian estimation and…

Machine Learning · Computer Science 2021-11-12 Giuseppina Carannante , Dimah Dera , Ghulam Rasool , Nidhal C. Bouaynaya , Lyudmila Mihaylova

Domain Generalization (DG) studies the capability of a deep learning model to generalize to out-of-training distributions. In the last decade, literature has been massively filled with training methodologies that claim to obtain more…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Simone Angarano , Mauro Martini , Francesco Salvetti , Vittorio Mazzia , Marcello Chiaberge

Deep reinforcement learning (RL) agents often fail to generalize to unseen environments (yet semantically similar to trained agents), particularly when they are trained on high-dimensional state spaces, such as images. In this paper, we…

Machine Learning · Computer Science 2020-02-18 Kimin Lee , Kibok Lee , Jinwoo Shin , Honglak Lee

To deal with the domain shift between training and test samples, current methods have primarily focused on learning generalizable features during training and ignore the specificity of unseen samples that are also critical during the test.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Controllers trained with Reinforcement Learning tend to be very specialized and thus generalize poorly when their testing environment differs from their training one. We propose a Model-Based approach to increase generalization where both…

Machine Learning · Computer Science 2025-04-15 Valentin Charvet , Sebastian Stein , Roderick Murray-Smith

We propose deep parameter interpolation (DPI), a general-purpose method for transforming an existing deep neural network architecture into one that accepts an additional scalar input. Recent deep generative models, including diffusion…

Image and Video Processing · Electrical Eng. & Systems 2025-11-27 Chicago Y. Park , Michael T. McCann , Cristina Garcia-Cardona , Brendt Wohlberg , Ulugbek S. Kamilov

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

Machine Learning · Computer Science 2025-04-30 Xavier Thomas , Deepti Ghadiyaram