English
Related papers

Related papers: Causality-oriented robustness: exploiting general …

200 papers

This paper develops a Bayesian framework for robust causal inference from longitudinal observational data. Many contemporary methods rely on structural assumptions, such as factor models, to adjust for unobserved confounding, but they can…

Methodology · Statistics 2025-11-20 Angelos Alexopoulos , Nikolaos Demiris

Machine learning algorithms with empirical risk minimization are vulnerable under distributional shifts due to the greedy adoption of all the correlations found in training data. There is an emerging literature on tackling this problem by…

Machine Learning · Computer Science 2022-11-22 Jiashuo Liu , Zheyan Shen , Peng Cui , Linjun Zhou , Kun Kuang , Bo Li

Distributionally robust optimization (DRO) has been introduced for solving stochastic programs where the distribution of the random parameters is unknown and must be estimated by samples from that distribution. A key element of DRO is the…

Optimization and Control · Mathematics 2019-01-09 Xi Chen , Qihang Lin , Guanglin Xu

Deep learning vulnerability detection has shown promising results in recent years. However, an important challenge that still blocks it from being very useful in practice is that the model is not robust under perturbation and it cannot…

Software Engineering · Computer Science 2024-01-17 Md Mahbubur Rahman , Ira Ceka , Chengzhi Mao , Saikat Chakraborty , Baishakhi Ray , Wei Le

In this paper, we develop a generic methodology to encode hierarchical causality structure among observed variables into a neural network in order to improve its predictive performance. The proposed methodology, called causality-informed…

Machine Learning · Computer Science 2024-12-25 Xiaoge Zhang , Xiao-Lin Wang , Fenglei Fan , Yiu-Ming Cheung , Indranil Bose

Causal inference requires evaluating models on balanced distributions between treatment and control groups, while training data often exhibits imbalance due to historical decision-making policies. Most conventional statistical methods…

Machine Learning · Statistics 2025-11-21 Akira Tanimoto

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

Machine Learning · Computer Science 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Recent work has shown promising results in causal discovery by leveraging interventional data with gradient-based methods, even when the intervened variables are unknown. However, previous work assumes that the correspondence between…

Machine Learning · Computer Science 2022-07-12 Gonçalo R. A. Faria , André F. T. Martins , Mário A. T. Figueiredo

Domain generalization aims at learning a universal model that performs well on unseen target domains, incorporating knowledge from multiple source domains. In this research, we consider the scenario where different domain shifts occur among…

Machine Learning · Computer Science 2024-03-26 Jingge Wang , Liyan Xie , Yao Xie , Shao-Lun Huang , Yang Li

Improving generalization and achieving highly predictive, robust machine learning models necessitates learning the underlying causal structure of the variables of interest. A prominent and effective method for this is learning invariant…

Machine Learning · Computer Science 2024-11-12 Jawad Chowdhury , Gabriel Terejanu

Granger causality is widely used for causal structure discovery in complex systems from multivariate time series data. Traditional Granger causality tests based on linear models often fail to detect even mild non-linear causal…

Machine Learning · Computer Science 2025-10-23 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

Adversarial training is the de facto most promising defense against adversarial examples. Yet, its passive nature inevitably prevents it from being immune to unknown attackers. To achieve a proactive defense, we need a more fundamental…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Kaihua Tang , Mingyuan Tao , Hanwang Zhang

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

A key task in actuarial modelling involves modelling the distributional properties of losses. Classic (distributional) regression approaches like Generalized Linear Models (GLMs; Nelder and Wedderburn, 1972) are commonly used, but…

Machine Learning · Statistics 2024-06-04 Benjamin Avanzi , Eric Dong , Patrick J. Laub , Bernard Wong

Despite recent success in using the invariance principle for out-of-distribution (OOD) generalization on Euclidean data (e.g., images), studies on graph data are still limited. Different from images, the complex nature of graphs poses…

Machine Learning · Computer Science 2022-10-12 Yongqiang Chen , Yonggang Zhang , Yatao Bian , Han Yang , Kaili Ma , Binghui Xie , Tongliang Liu , Bo Han , James Cheng

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

A major challenge in studying robustness in deep learning is defining the set of ``meaningless'' perturbations to which a given Neural Network (NN) should be invariant. Most work on robustness implicitly uses a human as the reference model…

Machine Learning · Computer Science 2022-06-27 Vedant Nanda , Till Speicher , Camila Kolling , John P. Dickerson , Krishna P. Gummadi , Adrian Weller

We provide a functional view of distributional robustness motivated by robust statistics and functional analysis. This results in two practical computational approaches for approximate distributionally robust nonlinear optimization based on…

Systems and Control · Electrical Eng. & Systems 2021-10-27 Yassine Nemmour , Bernhard Schölkopf , Jia-Jie Zhu

Cooperative multi-agent reinforcement learning (MARL) commonly adopts centralized training with decentralized execution, where value-factorization methods enforce the individual-global-maximum (IGM) principle so that decentralized greedy…

Artificial Intelligence · Computer Science 2026-02-13 Chengrui Qu , Christopher Yeh , Kishan Panaganti , Eric Mazumdar , Adam Wierman