English
Related papers

Related papers: On Predictive Explanation of Data Anomalies

200 papers

Explainability of black-box machine learning models is crucial, in particular when deployed in critical applications such as medicine or autonomous cars. Existing approaches produce explanations for the predictions of models, however, how…

Machine Learning · Computer Science 2021-11-18 Jonas Schulz , Rafael Poyiadzi , Raul Santos-Rodriguez

Accurate and automated detection of anomalous samples in a natural image dataset can be accomplished with a probabilistic model for end-to-end modeling of images. Such images have heterogeneous complexity, however, and a probabilistic model…

Machine Learning · Computer Science 2018-09-05 Takashi Matsubara , Kenta Hama , Ryosuke Tachibana , Kuniaki Uehara

In this paper we introduce a novel way of estimating prediction uncertainty in deep networks through the use of uncertainty surrogates. These surrogates are features of the penultimate layer of a deep network that are forced to match…

Machine Learning · Computer Science 2021-04-19 Radhakrishna Achanta , Natasa Tagasovska

Surrogates provide a cheap solution evaluation and offer significant leverage for optimizing computationally expensive problems. Usually, surrogates only approximate the original function. Recently, the perfect linear surrogates were…

Artificial Intelligence · Computer Science 2026-04-14 M. W. Przewozniczek , F. Chicano , R. Tinós , M. M. Komarnicki

In complex large-scale systems such as climate, important effects are caused by a combination of confounding processes that are not fully observable. The identification of sources from observations of system state is vital for attribution…

Machine Learning · Statistics 2023-03-22 Joseph Hart , Mamikon Gulian , Indu Manickam , Laura Swiler

Inverse modeling for computing a high-dimensional spatially-varying property field from indirect sparse and noisy observations is a challenging problem. This is due to the complex physical system of interest often expressed in the form of…

Computational Physics · Physics 2021-02-22 Govinda Anantha Padmanabha , Nicholas Zabaras

We present a combined numerical and data-driven workflow for efficient prediction of nonlinear, instationary convection-diffusion-reaction dynamics on a two-dimensional phenotypic domain, motivated by macroscopic modeling of cancer cell…

Computational Engineering, Finance, and Science · Computer Science 2026-02-02 Michael Urs Lars Kastor , Jan Rottmayer , Anna Hundertmark , Nicolas Ralph Gauger

Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex…

Machine Learning · Computer Science 2020-10-20 Haoyi Fan , Fengbin Zhang , Ruidong Wang , Liang Xi , Zuoyong Li

The paper proposes and investigates an approach for surrogate-assisted performance prediction of data-driven knowledge discovery algorithms. The approach is based on the identification of surrogate models for prediction of the target…

Machine Learning · Computer Science 2022-01-25 Anastasia A. Funkner , Aleksey N. Yakovlev , Sergey V. Kovalchuk

A fundamental problem in the field of unsupervised machine learning is the detection of anomalies corresponding to rare and unusual observations of interest; reasons include for their rejection, accommodation or further investigation.…

Machine Learning · Computer Science 2022-05-16 Nassir Mohammad

This paper demonstrates how Automated Machine Learning (AutoML) methods can be used as effective surrogate models in engineering design problems. To do so, we consider the challenging problem of structurally-performant bicycle frame design…

Machine Learning · Computer Science 2022-12-06 Lyle Regenwetter , Colin Weaver , Faez Ahmed

We present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributions, we put forth a…

Machine Learning · Statistics 2019-01-16 Yibo Yang , Paris Perdikaris

Inference on unknown quantities in dynamical systems via observational data is essential for providing meaningful insight, furnishing accurate predictions, enabling robust control, and establishing appropriate designs for future…

Methodology · Statistics 2018-02-06 M. Chung , M. Binois , R. B. Gramacy , D. J. Moquin , A. P. Smith , A. M. Smith

Predictive estimation, which comprises model calibration, model prediction, and validation, is a common objective when performing inverse uncertainty quantification (UQ) in diverse scientific applications. These techniques typically require…

Numerical Analysis · Mathematics 2024-07-17 Ningxin Yang , Truong Le , Lidija Zdravković , David M. Potts

The development of a reliable and robust surrogate model is often constrained by the dimensionality of the problem. For a system with high-dimensional inputs/outputs (I/O), conventional approaches usually use a low-dimensional manifold to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-01 Xihaier Luo , Ahsan Kareem

The method of surrogate data provides a framework for testing observed data against a hierarchy of alternative hypotheses. The aim of applying this method is to exclude the possibility that the data are consistent with simple linear…

Chaotic Dynamics · Physics 2007-05-23 Xiaodong Luo , Jie Zhang , Junfeng Sun , Michael Small , Irene Moroz

Detecting and explaining anomalies is a challenging effort. This holds especially true when data exhibits strong dependencies and single measurements need to be assessed and analyzed in their respective context. In this work, we consider…

Surrogate models are used to reduce the burden of expensive-to-evaluate objective functions in optimization. By creating models which map genomes to objective values, these models can estimate the performance of unknown inputs, and so be…

Neural and Evolutionary Computing · Computer Science 2019-07-17 Alexander Hagg , Martin Zaefferer , Jörg Stork , Adam Gaier

We introduce the concept of decision-focused surrogate modeling for solving computationally challenging nonlinear optimization problems in real-time settings. The proposed data-driven framework seeks to learn a simpler, e.g. convex,…

Optimization and Control · Mathematics 2023-12-27 Rishabh Gupta , Qi Zhang

We introduce Proteus, a novel self-designing approximate range filter, which configures itself based on sampled data in order to optimize its false positive rate (FPR) for a given space requirement. Proteus unifies the probabilistic and…