English
Related papers

Related papers: Deconfounding and Causal Regularization for Stabil…

200 papers

Understanding the laws that govern a phenomenon is the core of scientific progress. This is especially true when the goal is to model the interplay between different aspects in a causal fashion. Indeed, causal inference itself is…

Artificial Intelligence · Computer Science 2025-08-27 Alessio Zanga , Elif Ozkirimli , Fabio Stella

We study the stability of posterior predictive inferences to the specification of the likelihood model and perturbations of the data generating process. In modern big data analyses, useful broad structural judgements may be elicited from…

Methodology · Statistics 2024-04-30 Jack Jewson , Jim Q. Smith , Chris Holmes

In this paper, we consider a stabilization problem of an uncertain system in a networked control setting. Due to the network, the measurements are quantized to finite-bit signals and may be randomly lost in the communication. We study…

Systems and Control · Computer Science 2017-03-07 Kunihisa Okano , Hideaki Ishii

The dynamics of belief and knowledge is one of the major components of any autonomous system that should be able to incorporate new pieces of information. In this paper, we argue that to apply rationality result of belief dynamics theory to…

Logic in Computer Science · Computer Science 2014-07-22 Radhakrishnan Delhibabu , Gerhard Lakemeyer

Concept-based explanation approach is a popular model interpertability tool because it expresses the reasons for a model's predictions in terms of concepts that are meaningful for the domain experts. In this work, we study the problem of…

Machine Learning · Computer Science 2021-05-25 Mohammad Taha Bahadori , David E. Heckerman

We consider problems in which a system receives external \emph{perturbations} from time to time. For instance, the system can be a train network in which particular lines are repeatedly disrupted without warning, having an effect on…

Machine Learning · Computer Science 2019-08-21 Nicolo Colombo , Ricardo Silva , Soong M Kang , Arthur Gretton

Counterfactual explanations inform ways to achieve a desired outcome from a machine learning model. However, such explanations are not robust to certain real-world changes in the underlying model (e.g., retraining the model, changing…

Machine Learning · Computer Science 2022-07-19 Sanghamitra Dutta , Jason Long , Saumitra Mishra , Cecilia Tilli , Daniele Magazzeni

Conditional diffusion probabilistic models can model the distribution of natural images and can generate diverse and realistic samples based on given conditions. However, oftentimes their results can be unrealistic with observable color…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Kangfu Mei , Nithin Gopalakrishnan Nair , Vishal M. Patel

Most existing debiasing methods for multimodal models, including causal intervention and inference methods, utilize approximate heuristics to represent the biases, such as shallow features from early stages of training or unimodal features…

Machine Learning · Computer Science 2023-11-29 Vaidehi Patil , Adyasha Maharana , Mohit Bansal

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce…

Optimization and Control · Mathematics 2019-07-15 Soroosh Shafieezadeh-Abadeh , Daniel Kuhn , Peyman Mohajerin Esfahani

Estimating individual and average treatment effects from observational data is an important problem in many domains such as healthcare and e-commerce. In this paper, we advocate balance regularization of multi-head neural network…

Machine Learning · Computer Science 2020-11-24 Mehrdad Farajtabar , Andrew Lee , Yuanjian Feng , Vishal Gupta , Peter Dolan , Harish Chandran , Martin Szummer

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Calibration and uncertainty estimation are crucial topics in high-risk environments. We introduce a new diversity regularizer for classification tasks that uses out-of-distribution samples and increases the overall accuracy, calibration and…

Machine Learning · Computer Science 2022-10-21 Hendrik Alexander Mehrtens , Camila González , Anirban Mukhopadhyay

We present a simple regularization of adversarial perturbations based upon the perceptual loss. While the resulting perturbations remain imperceptible to the human eye, they differ from existing adversarial perturbations in that they are…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Andrew Elliott , Stephen Law , Chris Russell

Rapidly changing business environments expose companies to high levels of uncertainty. This uncertainty manifests itself in significant changes that tend to occur over the lifetime of a process and possibly affect its performance. It is…

Artificial Intelligence · Computer Science 2021-09-14 Jan Niklas Adams , Sebastiaan J. van Zelst , Lara Quack , Kathrin Hausmann , Wil M. P. van der Aalst , Thomas Rose

From the statistical learning perspective, complexity control via explicit regularization is a necessity for improving the generalization of over-parameterized models. However, the impressive generalization performance of neural networks…

Machine Learning · Computer Science 2021-02-09 Taejong Joo , Uijung Chung

Regularization is one of the crucial ingredients of deep learning, yet the term regularization has various definitions, and regularization methods are often studied separately from each other. In our work we present a systematic, unifying…

Machine Learning · Computer Science 2017-10-31 Jan Kukačka , Vladimir Golkov , Daniel Cremers

Causal discovery aims to infer causal relationships among variables from observational data, typically represented by a directed acyclic graph (DAG). Most existing methods assume independent and identically distributed observations, an…

Methodology · Statistics 2026-03-27 Alex Chen , Qing Zhou

The calibration of predictive distributions has been widely studied in deep learning, but the same cannot be said about the more specific epistemic uncertainty as produced by Deep Ensembles, Bayesian Deep Networks, or Evidential Deep…

Machine Learning · Computer Science 2024-07-18 Mohammed Fellaji , Frédéric Pennerath , Brieuc Conan-Guez , Miguel Couceiro

Generative foundation models like Stable Diffusion comprise a diverse spectrum of knowledge in computer vision with the potential for transfer learning, e.g., via generating data to train student models for downstream tasks. This could…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Leonhard Hennicke , Christian Medeiros Adriano , Holger Giese , Jan Mathias Koehler , Lukas Schott