English
Related papers

Related papers: Deconfounding and Causal Regularization for Stabil…

200 papers

In this paper, we argue that mutual distillation between reinforcement learning policies serves as an implicit regularization, preventing them from overfitting to irrelevant features. We highlight two separate contributions: (i)…

Machine Learning · Computer Science 2025-09-25 Zhengpeng Xie , Jiahang Cao , Changwei Wang , Fan Yang , Marco Hutter , Qiang Zhang , Jianxiong Zhang , Renjing Xu

The characteristic feature of inverse problems is their instability with respect to data perturbations. In order to stabilize the inversion process, regularization methods have to be developed and applied. In this work we introduce and…

Numerical Analysis · Mathematics 2022-08-22 Andrea Ebner , Jürgen Frikel , Dirk Lorenz , Johannes Schwab , Markus Haltmeier

The development of robust and reliable modeling approaches for crystallization processes is often challenging because of non-idealities in real data arising from various sources of uncertainty. This study investigated the effectiveness of…

Computational Engineering, Finance, and Science · Computer Science 2026-02-10 Dingqi Nai , Huayu Li , Martha Grover , Andrew Medford

In this work, we propose an approach for assessing sensitivity to unobserved confounding in studies with multiple outcomes. We demonstrate how prior knowledge unique to the multi-outcome setting can be leveraged to strengthen causal…

Methodology · Statistics 2023-01-26 Jiajing Zheng , Jiaxi Wu , Alexander D'Amour , Alexander Franks

One of the bottlenecks in robotic intelligence is the instability of neural network models, which, unlike control models, lack a well-defined convergence domain and stability. This leads to risks when applying intelligence in the physical…

Robotics · Computer Science 2025-03-20 Zihao Liu , Xing Liu , Yizhai Zhang , Zhengxiong Liu , Panfeng Huang

As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robust a model is to changes in setting or population, which…

Machine Learning · Computer Science 2021-03-16 Adarsh Subbaswamy , Roy Adams , Suchi Saria

Discovering the causality from observational data is a crucial task in various scientific domains. With increasing awareness of privacy, data are not allowed to be exposed, and it is very hard to learn causal graphs from dispersed data,…

Machine Learning · Computer Science 2023-12-12 Dezhi Yang , Xintong He , Jun Wang , Guoxian Yu , Carlotta Domeniconi , Jinglin Zhang

Modern machine learning methods often require more data for training than a single expert can provide. Therefore, it has become a standard procedure to collect data from external sources, e.g. via crowdsourcing. Unfortunately, the quality…

Machine Learning · Computer Science 2019-05-20 Nikola Konstantinov , Christoph Lampert

Tensor decomposition methods allow us to learn the parameters of latent variable models through decomposition of low-order moments of data. A significant limitation of these algorithms is that there exists no general method to regularize…

Machine Learning · Statistics 2019-05-28 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

Consistency training regularizes a model by enforcing predictions of original and perturbed inputs to be similar. Previous studies have proposed various augmentation methods for the perturbation but are limited in that they are agnostic to…

Computation and Language · Computer Science 2022-04-29 Jungsoo Park , Gyuwan Kim , Jaewoo Kang

Counterfactual explanations (CFEs) are essential for interpreting black-box models, yet they often become invalid when models are slightly changed. Existing methods for generating robust CFEs are often limited to specific types of models,…

Machine Learning · Computer Science 2026-04-21 Marcin Kostrzewa , Maciej Zięba , Jerzy Stefanowski

Understanding causal relationships among the variables of a system is paramount to explain and control its behavior. For many real-world systems, however, the true causal graph is not readily available and one must resort to predictions…

Machine Learning · Statistics 2024-12-20 Elias Eulig , Atalanti A. Mastakouri , Patrick Blöbaum , Michaela Hardt , Dominik Janzing

A major challenge in estimating treatment effects in observational studies is the reliance on untestable conditions such as the assumption of no unmeasured confounding. In this work, we propose an algorithm that can falsify the assumption…

Methodology · Statistics 2025-06-03 Rickard K. A. Karlsson , Jesse H. Krijthe

We study the stability of regularization by projection for solving linear inverse problems if the forward operator is given indirectly but specified via some input-output training pairs. We extend the approach in "Data driven regularization…

Numerical Analysis · Mathematics 2025-08-12 Martin Hanke , Otmar Scherzer

Concept drift -- the change of the distribution over time -- poses significant challenges for learning systems and is of central interest for monitoring. Understanding drift is thus paramount, and drift localization -- determining which…

Machine Learning · Computer Science 2026-04-22 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Discrete diffusion models have seen a surge of attention with applications on naturally discrete data such as language and graphs. Although discrete-time discrete diffusion has been established for a while, only recently Campbell et al.…

Machine Learning · Computer Science 2024-08-13 Lingxiao Zhao , Xueying Ding , Lijun Yu , Leman Akoglu

Lack of factual correctness is an issue that still plagues state-of-the-art summarization systems despite their impressive progress on generating seemingly fluent summaries. In this paper, we show that factual inconsistency can be caused by…

Computation and Language · Computer Science 2024-01-22 Asish Ghoshal , Arash Einolghozati , Ankit Arun , Haoran Li , Lili Yu , Vera Gor , Yashar Mehdad , Scott Wen-tau Yih , Asli Celikyilmaz

This article introduces a causal discovery method to learn nonlinear relationships in a directed acyclic graph with correlated Gaussian errors due to confounding. First, we derive model identifiability under the sublinear growth assumption.…

Methodology · Statistics 2025-05-01 Chunlin Li , Xiaotong Shen , Wei Pan

A common approach to mechanistic interpretability is to causally manipulate model representations via targeted interventions in order to understand what those representations encode. Here we ask whether such interventions create…

Machine Learning · Computer Science 2026-04-24 Satchel Grant , Simon Jerome Han , Alexa R. Tartaglini , Christopher Potts

Fair classification has been a topic of intense study in machine learning, and several algorithms have been proposed towards this important task. However, in a recent study, Friedler et al. observed that fair classification algorithms may…

Machine Learning · Computer Science 2020-09-10 Lingxiao Huang , Nisheeth K. Vishnoi