English
Related papers

Related papers: Deconfounding and Causal Regularization for Stabil…

200 papers

Over the past two decades, several consistent procedures have been designed to infer causal conclusions from observational data. We prove that if the true causal network might be an arbitrary, linear Gaussian network or a discrete Bayes…

Machine Learning · Computer Science 2012-03-19 Kevin T. Kelly , Conor Mayo-Wilson

Modern science increasingly relies on ever-growing observational datasets and automated inference pipelines, under the implicit belief that accumulating more data makes scientific conclusions more reliable. Here we show that this belief can…

Machine Learning · Computer Science 2026-02-06 Zhipeng Zhang , Kai Li

A fundamental question in causal inference is whether it is possible to reliably infer manipulation effects from observational data. There are a variety of senses of asymptotic reliability in the statistical literature, among which the most…

Artificial Intelligence · Computer Science 2012-12-12 Jiji Zhang , Peter L. Spirtes

Recent explainability related studies have shown that state-of-the-art DNNs do not always adopt correct evidences to make decisions. It not only hampers their generalization but also makes them less likely to be trusted by end-users. In…

Machine Learning · Computer Science 2019-08-16 Mengnan Du , Ninghao Liu , Fan Yang , Xia Hu

A common assumption in causal inference from observational data is that there is no hidden confounding. Yet it is, in general, impossible to verify this assumption from a single dataset. Under the assumption of independent causal mechanisms…

Methodology · Statistics 2023-11-07 Rickard K. A. Karlsson , Jesse H. Krijthe

We study the problem of deriving policies, or rules, that when enacted on a complex system, cause a desired outcome. Absent the ability to perform controlled experiments, such rules have to be inferred from past observations of the system's…

Machine Learning · Computer Science 2020-09-09 Kailash Budhathoki , Mario Boley , Jilles Vreeken

Generative (diffusion) priors demonstrate remarkable performance in addressing inverse problems in imaging. Yet, for scientific and medical imaging, it is crucial that reconstruction techniques remain stable and reliable under imperfect…

Image and Video Processing · Electrical Eng. & Systems 2026-05-12 Alexander Denker , Johannes Hertrich , Sebastian Neumayer

Understanding causal dependencies in observational data is critical for informing decision-making. These relationships are often modeled as Bayesian Networks (BNs) and Directed Acyclic Graphs (DAGs). Existing methods, such as NOTEARS and…

Machine Learning · Computer Science 2026-04-03 Hao Zhu , Di Zhou , Donna Slonim

In this paper, we study the inverse problem for a class of abstract ultraparabolic equations which is well-known to be ill-posed. We employ some elementary results of semi-group theory to present the formula of solution, then show the…

Analysis of PDEs · Mathematics 2015-12-10 Vo Anh Khoa , Le Trong Lan , Nguyen Huy Tuan , Tran The Hung

In application domains such as healthcare, we want accurate predictive models that are also causally interpretable. In pursuit of such models, we propose a causal regularizer to steer predictive models towards causally-interpretable…

Machine Learning · Computer Science 2017-02-24 Mohammad Taha Bahadori , Krzysztof Chalupka , Edward Choi , Robert Chen , Walter F. Stewart , Jimeng Sun

Failures of fairness or robustness in machine learning predictive settings can be due to undesired dependencies between covariates, outcomes and auxiliary factors of variation. A common strategy to mitigate these failures is data balancing,…

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

Machine Learning · Computer Science 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné

The deployment of pre-trained perception models in novel environments often leads to performance degradation due to distributional shifts. Although recent artificial intelligence approaches for metacognition use logical rules to…

The widespread dissemination of fake news on social media poses significant risks, necessitating timely and accurate detection. However, existing methods struggle with unseen news due to their reliance on training data from past events and…

Social and Information Networks · Computer Science 2025-03-07 Shuzhi Gong , Richard Sinnott , Jianzhong Qi , Cecile Paris

Given only aggregate choice data and limited information about how menus are distributed across the population, we describe what can be inferred robustly about the distribution of preferences (or more general decision rules). We strengthen…

Theoretical Economics · Economics 2024-05-16 Larry G Epstein , Kaushil Patel

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

We propose a new iterative unfolding method for experimental data, making use of a regularization function. The use of this function allows one to build an improved normalization procedure for Monte Carlo spectra, unbiased by the presence…

Data Analysis, Statistics and Probability · Physics 2009-07-23 Bogdan Malaescu

Recent advancements in machine learning have emphasized the need for transparency in model predictions, particularly as interpretability diminishes when using increasingly complex architectures. In this paper, we propose leveraging…

Machine Learning · Computer Science 2025-07-18 Chenrui Zhu , Louenas Bounia , Vu Linh Nguyen , Sébastien Destercke , Arthur Hoarau

Standard training techniques for neural networks involve multiple sources of randomness, e.g., initialization, mini-batch ordering and in some cases data augmentation. Given that neural networks are heavily over-parameterized in practice,…

Machine Learning · Computer Science 2021-02-08 Srinadh Bhojanapalli , Kimberly Wilber , Andreas Veit , Ankit Singh Rawat , Seungyeon Kim , Aditya Menon , Sanjiv Kumar

Consistency regularization on label predictions becomes a fundamental technique in semi-supervised learning, but it still requires a large number of training iterations for high performance. In this study, we analyze that the consistency…

Machine Learning · Computer Science 2022-06-10 Doyup Lee , Sungwoong Kim , Ildoo Kim , Yeongjae Cheon , Minsu Cho , Wook-Shin Han