English
Related papers

Related papers: Mutual Information for Explainable Deep Learning o…

200 papers

Machine learning models play a vital role in time series forecasting. These models, however, often overlook an important element: point uncertainty estimates. Incorporating these estimates is crucial for effective risk management, informed…

Machine Learning · Computer Science 2024-09-11 Leonid Erlygin , Vladimir Zholobov , Valeriia Baklanova , Evgeny Sokolovskiy , Alexey Zaytsev

We introduce a novel approach for end-to-end black-box optimization of high energy physics (HEP) detectors using local deep learning (DL) surrogates. These surrogates approximate a scalar objective function that encapsulates the complex…

Machine Learning · Computer Science 2025-03-19 Kinga Anna Wozniak , Stephen Mulligan , Jan Kieseler , Markus Klute , Francois Fleuret , Tobias Golling

Fast machine learning-based surrogate models are trained to emulate slow, high-fidelity engineering simulation models to accelerate engineering design tasks. This introduces uncertainty as the surrogate is only an approximation of the…

Machine Learning · Statistics 2020-10-08 Paul Westermann , Ralph Evins

Estimating mutual information accurately is pivotal across diverse applications, from machine learning to communications and biology, enabling us to gain insights into the inner mechanisms of complex systems. Yet, dealing with…

Machine Learning · Computer Science 2024-11-12 Nunzio A. Letizia , Nicola Novello , Andrea M. Tonello

Building design optimization often depends on physics-based simulation tools such as EnergyPlus, which, although accurate, are computationally expensive and slow. Surrogate models provide a faster alternative, yet most are…

Machine Learning · Computer Science 2026-03-13 Piragash Manmatharasan , Girma Bitsuamlak , Katarina Grolinger

The increasing use of stochastic models for describing complex phenomena warrants surrogate models that capture the reference model characteristics at a fraction of the computational cost, foregoing potentially expensive Monte Carlo…

Machine Learning · Computer Science 2024-06-10 Neil Kichler , Sher Afghan , Uwe Naumann

The computational burden of running a complex computer model can make optimization impractical. Gaussian Processes (GPs) are statistical surrogates (also known as emulators) that alleviate this issue since they cheaply replace the computer…

Computation · Statistics 2019-09-11 Theodoros Mathikolonis , Serge Guillas

Multimodal sentiment analysis (MSA) is a fundamental complex research problem due to the heterogeneity gap between different modalities and the ambiguity of human emotional expression. Although there have been many successful attempts to…

Machine Learning · Computer Science 2022-07-05 Jiahao Zheng , Sen Zhang , Xiaoping Wang , Zhigang Zeng

The use of surrogate models instead of computationally expensive simulation codes is very convenient in engineering. Roughly speaking, there are two kinds of surrogate models: the deterministic and the probabilistic ones. These last are…

Applications · Statistics 2015-12-24 Malek Ben Salem , Olivier Roustant , Fabrice Gamboa , Lionel Tomaso

A machine-learning-based framework for modeling the error introduced by surrogate models of parameterized dynamical systems is proposed. The framework entails the use of high-dimensional regression techniques (e.g., random forests, LASSO)…

Numerical Analysis · Computer Science 2017-06-02 Sumeet Trehan , Kevin Carlberg , Louis J. Durlofsky

We introduce a method to construct a stochastic surrogate model from the results of dimensionality reduction in forward uncertainty quantification. The hypothesis is that the high-dimensional input augmented by the output of a computational…

Applications · Statistics 2026-02-12 Jungho Kim , Sang-ri Yi , Ziqi Wang

Variational AutoEncoder (VAE) for Sequential Recommendation (SR), which learns a continuous distribution for each user-item interaction sequence rather than a determinate embedding, is robust against data deficiency and achieves significant…

Information Retrieval · Computer Science 2025-02-25 Beibei Li , Tao Xiang , Beihong Jin , Yiyuan Zheng , Rui Zhao

Running a reliability analysis on engineering problems involving complex numerical models can be computationally very expensive, requiring advanced simulation methods to reduce the overall numerical cost. Gaussian process based active…

Machine Learning · Statistics 2020-12-01 Morgane Menz , Sylvain Dubreuil , Jérôme Morio , Christian Gogu , Nathalie Bartoli , Marie Chiron

Oilfield development related decisions are made using reservoir simulation-based optimization study in which different production scenarios and well controls are compared. Such simulations are computationally expensive and so surrogate…

Machine Learning · Computer Science 2022-03-01 Ajitabh Kumar

In the continual effort to improve product quality and decrease operations costs, computational modeling is increasingly being deployed to determine feasibility of product designs or configurations. Surrogate modeling of these computer…

Machine Learning · Statistics 2021-11-10 Nathan Wycoff , Mickaël Binois , Robert B. Gramacy

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that…

Numerical Analysis · Mathematics 2025-03-19 Shane A. McQuarrie , Anirban Chaudhuri , Karen E. Willcox , Mengwu Guo

Our examination of existing deep generative models (DGMs), including VAEs and GANs, reveals two problems. First, their capability in handling discrete observations and latent codes is unsatisfactory, though there are interesting efforts.…

Machine Learning · Computer Science 2025-05-27 Wenbo He , Zhijian Ou

Predicting the behavior of complex systems in engineering often involves significant uncertainty about operating conditions, such as external loads, environmental effects, and manufacturing variability. As a result, uncertainty…

Computation · Statistics 2025-07-17 S. Marelli , S. Schär , B. Sudret

Complex computational models are often designed to simulate real-world physical phenomena in many scientific disciplines. However, these simulation models tend to be computationally very expensive and involve a large number of simulation…

Human-Computer Interaction · Computer Science 2019-10-18 Subhashis Hazarika , Haoyu Li , Ko-Chih Wang , Han-Wei Shen , Ching-Shan Chou

The formulation of Bayesian inverse problems involves choosing prior distributions; choices that seem equally reasonable may lead to significantly different conclusions. We develop a computational approach to better understand the impact of…

Computation · Statistics 2026-01-08 John E. Darges , Alen Alexanderian , Pierre A. Gremaud