English
Related papers

Related papers: Distributionally Robust Causal Abstractions

200 papers

We present a novel data-driven distributionally robust Model Predictive Control formulation for unknown discrete-time linear time-invariant systems affected by unknown and possibly unbounded additive uncertainties. We use off-line collected…

Optimization and Control · Mathematics 2022-09-20 Francesco Micheli , Tyler Summers , John Lygeros

Catastrophic forgetting of previously learned knowledge while learning new tasks is a widely observed limitation of contemporary neural networks. Although many continual learning methods are proposed to mitigate this drawback, the main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Wojciech Masarczyk , Kamil Deja , Tomasz Trzciński

Abstraction is a powerful idea widely used in science, to model, reason and explain the behavior of systems in a more tractable search space, by omitting irrelevant details. While notions of abstraction have matured for deterministic…

Artificial Intelligence · Computer Science 2020-01-14 Vaishak Belle

Uncertainties in the real world mean that is impossible for system designers to anticipate and explicitly design for all scenarios that a robot might encounter. Thus, robots designed like this are fragile and fail outside of…

Robotics · Computer Science 2023-10-02 Ricardo Cannizzaro , Jonathan Routley , Lars Kunze

Mathematical models of the real world are simplified representations of complex systems. A caveat to using mathematical models is that predicted causal effects and conditional independences may not be robust under model extensions, limiting…

Methodology · Statistics 2022-08-30 Tineke Blom , Joris M. Mooij

Algorithmic robust statistics has traditionally focused on the contamination model where a small fraction of the samples are arbitrarily corrupted. We consider a recent contamination model that combines two kinds of corruptions: (i) small…

Data Structures and Algorithms · Computer Science 2024-10-23 Thanasis Pittas , Ankit Pensia

Causal Bayesian networks are 'causal' models since they make predictions about interventional distributions. To connect such causal model predictions to real-world outcomes, we must determine which actions in the world correspond to which…

Machine Learning · Statistics 2025-02-04 Frederik Hytting Jørgensen , Luigi Gresele , Sebastian Weichwald

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

Machine Learning · Computer Science 2021-01-06 Jaeho Lee , Maxim Raginsky

The deployment of pre-trained perception models in novel environments often leads to performance degradation due to distributional shifts. Although recent artificial intelligence approaches for metacognition use logical rules to…

We consider a residuals-based distributionally robust optimization (DRO) model, where the underlying uncertainty depends on both covariate information and our decisions. We adopt both parametric and nonparametric regression models to learn…

Optimization and Control · Mathematics 2026-05-21 Qing Zhu , Xian Yu , Guzin Bayraksan

Logistic regression models are widely used in the social and behavioral sciences and in high-stakes domains, due to their simplicity and interpretability properties. At the same time, such domains are permeated by distribution shifts, where…

Machine Learning · Computer Science 2025-03-18 Qingshi Sun , Nathan Justin , Andres Gomez , Phebe Vayanos

Causal structure discovery from observational data is fundamental to the causal understanding of autonomous systems such as medical decision support systems, advertising campaigns and self-driving cars. This is essential to solve well-known…

Distributionally robust supervised learning (DRSL) is emerging as a key paradigm for building reliable machine learning systems for real-world applications -- reflecting the need for classifiers and predictive models that are robust to the…

Machine Learning · Computer Science 2022-01-26 Yaodong Yu , Tianyi Lin , Eric Mazumdar , Michael I. Jordan

Causal discovery from data with unmeasured confounding factors is a challenging problem. This paper proposes an approach based on the f-GAN framework, learning the binary causal structure independent of specific weight values. We…

Machine Learning · Computer Science 2026-01-06 Mujin Zhou , Junzhe Zhang

Optimal control of complex environments with robotic systems faces two complementary and intertwined challenges: efficient organization of sensory state information and far-sighted action planning. Because the reinforcement learning…

Machine Learning · Computer Science 2026-01-30 Abdullah Akgül , Gulcin Baykal , Manuel Haußmann , Mustafa Mert Çelikok , Melih Kandemir

Abstraction reasoning is a long-standing challenge in artificial intelligence. Recent studies suggest that many of the deep architectures that have triumphed over other domains failed to work well in abstract reasoning. In this paper, we…

Artificial Intelligence · Computer Science 2019-12-03 Kecheng Zheng , Zheng-jun Zha , Wei Wei

Real-world learning tasks often encounter uncertainty due to covariate shift and noisy or inconsistent labels. However, existing robust learning methods merge these effects into a single distributional uncertainty set. In this work, we…

Methodology · Statistics 2026-03-17 Varun Venkatesh , Eyke Hüllermeier , Bernd Bischl , Mina Rezaei

We explore the use of class-conditional autoregressive (CA) models to perform image classification on MNIST-10. Autoregressive models assign probability to an entire input by combining probabilities from each individual feature; hence…

Machine Learning · Computer Science 2022-04-01 Nathan Elazar

Wasserstein distributionally robust optimization (WDRO) optimizes against worst-case distributional shifts within a specified uncertainty set, leading to enhanced generalization on unseen adversarial examples, compared to standard…

Machine Learning · Computer Science 2025-03-07 Shuang Liu , Yihan Wang , Yifan Zhu , Yibo Miao , Xiao-Shan Gao

Data used to train machine learning models can be adversarial--maliciously constructed by adversaries to fool the model. Challenge also arises by privacy, confidentiality, or due to legal constraints when data are geographically gathered…

Machine Learning · Computer Science 2020-07-09 Alireza Sadeghi , Gang Wang , Meng Ma , Georgios B. Giannakis