English
Related papers

Related papers: Gradient-enhanced global sensitivity analysis with…

200 papers

Here, we introduce a fully local index named "sensitivity" for each neuron to control chaoticity or gradient globally in a neural network (NN). We also propose a learning method to adjust it named "sensitivity adjustment learning (SAL)".…

Neural and Evolutionary Computing · Computer Science 2021-07-20 Katsunari Shibata , Takuya Ejima , Yuki Tokumaru , Toshitaka Matsuki

In this paper, we introduce new indices adapted to outputs valued in general metric spaces. This new class of indices encompasses the classical ones; in particular, the so-called Sobol indices and the Cram{\'e}r-von-Mises indices.…

Statistics Theory · Mathematics 2021-01-21 Fabrice Gamboa , Thierry Klein , Agnès Lagnoux , Leonardo Moreno

Variance based global sensitivity analysis measures the relevance of inputs to a single output using Sobol' indices. This paper extends the definition in a natural way to multiple outputs, directly measuring the relevance of inputs to the…

Statistics Theory · Mathematics 2025-03-25 Robert A. Milton , Solomon F. Brown

We present some approaches to the perturbative analysis of the classical and quantum gravity. First we introduce a graphical representation for a global SO(n) tensor $(\pl)^d h_\ab$, which generally appears in the weak field expansion…

High Energy Physics - Theory · Physics 2009-10-31 Shoichi Ichinose , Noriaki Ikeda

A spline chaos expansion, referred to as SCE, is introduced for uncertainty quantification analysis. The expansion provides a means for representing an output random variable of interest with respect to multivariate orthonormal basis…

Numerical Analysis · Mathematics 2019-11-12 Sharif Rahman

Robust correlation estimation is essential in high-dimensional settings, particularly when data are contaminated by outliers or exhibit heavy-tailed behavior. Many robust loss functions of practical interest-such as those involving…

Applications · Statistics 2025-06-19 Priyam Das

This paper introduces a weighted generalized inverse framework for Fourier extensions, designed to suppress spurious oscillations in the extended region while maintaining high approximation accuracy on the original interval. By formulating…

Numerical Analysis · Mathematics 2026-01-13 Zhenyu Zhao , Yanfei Wang , Anatoly G. Yagola , Xusheng Li

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially…

Machine Learning · Statistics 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Graph-based causal discovery methods aim to capture conditional independencies consistent with the observed data and differentiate causal relationships from indirect or induced ones. Successful construction of graphical models of data…

Machine Learning · Statistics 2021-01-08 Boris Hayete , Fred Gruber , Anna Decker , Raymond Yan

Graph Neural Networks (GNNs) have emerged as the predominant method for analyzing graph-structured data. However, canonical GNNs have limited expressive power and generalization capability, thus triggering the development of more expressive…

Machine Learning · Computer Science 2024-08-07 Danial Saber , Amirali Salehi-Abari

Graph invariant learning (GIL) seeks invariant relations between graphs and labels under distribution shifts. Recent works try to extract an invariant subgraph to improve out-of-distribution (OOD) generalization, yet existing approaches…

Machine Learning · Computer Science 2026-01-22 Junchi Yan , Fangyu Ding , Jiawei Sun , Zhaoping Hu , Yunyi Zhou , Lei Zhu

Invariant graph representation learning aims to learn the invariance among data from different environments for out-of-distribution generalization on graphs. As the graph environment partitions are usually expensive to obtain, augmenting…

Machine Learning · Computer Science 2023-10-31 Yongqiang Chen , Yatao Bian , Kaiwen Zhou , Binghui Xie , Bo Han , James Cheng

Global sensitivity analysis (GSA) is a recommended step in the use of computer simulation models. GSA quantifies the relative importance of model inputs on outputs (Factor Ranking), identifies inputs that could be fixed, thus simplifying…

Methodology · Statistics 2025-10-27 Ken Newman , Shaini Naha , Leah Jackson-Blake , Cairistiona Topp , Miriam Glendell , Adam Butler

Probabilistic load forecasting is widely studied and underpins power system planning, operation, and risk-aware decision making. Deep learning forecasters have shown strong ability to capture complex temporal and contextual patterns,…

Machine Learning · Computer Science 2025-11-25 Haoran Li , Zhe Cheng , Muhao Guo , Yang Weng , Yannan Sun , Victor Tran , John Chainaranont

Stochastic-gradient sampling methods are often used to perform Bayesian inference on neural networks. It has been observed that the methods in which notions of differential geometry are included tend to have better performances, with the…

Machine Learning · Computer Science 2024-04-02 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Arto Klami

In this work, we combine the idea of data-driven polynomial chaos expansions with the weighted least-square approach to solve uncertainty quantification (UQ) problems. The idea of data-driven polynomial chaos is to use statistical moments…

Numerical Analysis · Mathematics 2019-02-20 Ling Guo , Yongle Liu , Tao Zhou

A new paradigm to estimate the gradient of a black-box scalar function is introduced, considering it as a member of a set of admissible gradients that are computed using existing function samples. Results on gradient estimate accuracy,…

Optimization and Control · Mathematics 2025-08-28 Lorenzo Sabug , Fredy Ruiz , Lorenzo Fagiano

In a variety of problems originating in supervised, unsupervised, and reinforcement learning, the loss function is defined by an expectation over a collection of random variables, which might be part of a probabilistic model or the external…

Machine Learning · Computer Science 2016-01-06 John Schulman , Nicolas Heess , Theophane Weber , Pieter Abbeel

Model predictive control is an advanced control approach for multivariable systems with constraints, which is reliant on an accurate dynamic model. Most real dynamic models are however affected by uncertainties, which can lead to…

Optimization and Control · Mathematics 2021-03-10 E. Bradford , L. Imsland

Simulating turbulent fluid flows is a computationally prohibitive task, as it requires the resolution of fine-scale structures and the capture of complex nonlinear interactions across multiple scales. This is particularly the case in direct…

Fluid Dynamics · Physics 2026-04-22 Ismaël Zighed , Nicolas Thome , Patrick Gallinari , Taraneh Sayadi