English
Related papers

Related papers: Active subspace methods and derivative-based Shapl…

200 papers

We present two analytical formulae for estimating the sensitivity -- namely, the gradient or Jacobian -- at given realizations of an arbitrary-dimensional random vector with respect to its distributional parameters. The first formula…

Machine Learning · Statistics 2025-08-14 Pi-Yueh Chuang , Ahmed Attia , Emil Constantinescu

It is now practically the norm for data to be very high dimensional in areas such as genetics, machine vision, image analysis and many others. When analyzing such data, parametric models are often too inflexible while nonparametric…

Methodology · Statistics 2011-05-31 Abhishek Bhattacharya , Garritt Page , David Dunson

We present an approach to analyze $C^1(\mathbb{R}^m)$ functions that addresses limitations present in the Active Subspaces (AS) method of Constantine et al.(2015; 2014). Under appropriate hypotheses, our Active Manifolds (AM) method…

Machine Learning · Statistics 2019-05-15 Robert A. Bridges , Anthony D. Gruber , Christopher Felder , Miki Verma , Chelsey Hoff

We propose randomized subspace gradient methods for high-dimensional constrained optimization. While there have been similarly purposed studies on unconstrained optimization problems, there have been few on constrained optimization problems…

Optimization and Control · Mathematics 2023-07-10 Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

Most engineering models contain several parameters, and the map from input parameters to model output can be viewed as a multivariate function. An active subspace is a low-dimensional subspace of the space of inputs that explains the…

Numerical Analysis · Mathematics 2014-02-18 Paul G. Constantine

Calibration of large-scale differential equation models to observational or experimental data is a widespread challenge throughout applied sciences and engineering. A crucial bottleneck in state-of-the art calibration methods is the…

Optimization and Control · Mathematics 2021-02-23 Jon Cockayne , Andrew B. Duncan

The goal of this presentation is to build an efficient non-parametric Bayes classifier in the presence of large numbers of predictors. When analyzing such data, parametric models are often too inflexible while non-parametric procedures tend…

Methodology · Statistics 2013-01-07 Abhishek Bhattacharya

Gradients can be employed for sensitivity analysis. Here, we leverage the advantages of the Loss Landscape to comprehend which independent variables impact the dependent variable. We seek to grasp the loss landscape by utilizing first,…

Machine Learning · Computer Science 2024-03-06 Salman Faroz

Gradient-based optimization methods are commonly used to identify local optima in high-dimensional spaces. When derivatives cannot be evaluated directly, stochastic estimators can provide approximate gradients. However, these estimators'…

Machine Learning · Computer Science 2026-02-03 Philipp Andelfinger , Wentong Cai

Global sensitivity analysis of complex numerical simulators is often limited by the small number of model evaluations that can be afforded. In such settings, surrogate models built from a limited set of simulations can substantially reduce…

Machine Learning · Statistics 2026-01-21 Guerlain Lambert , Céline Helbert , Claire Lauvernet

Many applications in machine learning or signal processing involve nonsmooth optimization problems. This nonsmoothness brings a low-dimensional structure to the optimal solutions. In this paper, we propose a randomized proximal gradient…

Optimization and Control · Mathematics 2020-04-29 Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick

In this paper, we address the estimation of the sensitivity indices called "Shapley eects". These sensitivity indices enable to handle dependent input variables. The Shapley eects are generally dicult to estimate, but they are easily…

Statistics Theory · Mathematics 2020-06-04 Baptiste Broto , François Bachoc , Marine Depecker , Jean-Marc Martinez

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of model outputs has…

Machine Learning · Statistics 2023-11-01 David S. Watson , Joshua O'Hara , Niek Tax , Richard Mudd , Ido Guy

Global sensitivity analysis aims at measuring the relative importance of different variables or groups of variables for the variability of a quantity of interest. Among several sensitivity indices, so-called Shapley effects have recently…

Computation · Statistics 2021-04-27 Takashi Goda

Differential sensitivity measures provide valuable tools for interpreting complex computational models used in applications ranging from simulation to algorithmic prediction. Taking the derivative of the model output in direction of a model…

Computation · Statistics 2024-10-03 Silvana M. Pesenti , Pietro Millossovich , Andreas Tsanakas

In this paper, a methodology to calculate the sensitivity of the least stable modes of fluid-structure interaction systems with respect to local forces is presented. We make use of the adjoint equations of the flow-structure coupled system…

Fluid Dynamics · Physics 2021-10-19 Daiane I. Dolci , Bruno S. Carmo

In this paper we develop a new approach to the design of direct numerical methods for multidimensional problems of the calculus of variations. The approach is based on a transformation of the problem with the use of a new class of…

Optimization and Control · Mathematics 2019-03-04 M. V. Dolgopolik

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

There exist many methods for sensitivity analysis readily available to the practitioner. While each seeks to help the modeler answer the same general question -- How do sources of uncertainty or changes in the model inputs relate to…

Methodology · Statistics 2025-06-16 Devin Francom , Abigael Nachtsheim

Sensitivity analysis is an important tool used in many domains of computational science to either gain insight into the mathematical model and interaction of its parameters or study the uncertainty propagation through the input-output…

Methodology · Statistics 2023-06-02 Juraj Kardos , Wouter Edeling , Diana Suleimenova , Derek Groen , Olaf Schenk