English
Related papers

Related papers: Derivative-based global sensitivity measures: gene…

200 papers

By concisely representing a joint function of many variables as the combination of small functions, discrete graphical models (GMs) provide a powerful framework to analyze stochastic and deterministic systems of interacting variables. One…

Optimization and Control · Mathematics 2021-11-25 Valentin Durante , George Katsirelos , Thomas Schiex

The scalability of Generalized Linear Models (GLMs) for large-scale, high-dimensional data often forces a trade-off between computational feasibility and statistical accuracy, particularly for inference on pre-specified parameters. While…

Methodology · Statistics 2025-12-09 Bo Fu , Dandan Jiang

Segmented models are widely used to describe non-stationary sequential data with discrete change points. Their estimation usually requires solving a mixed discrete-continuous optimization problem, where the segmentation is the discrete part…

Machine Learning · Computer Science 2021-01-19 Erik Scharwächter , Jonathan Lennartz , Emmanuel Müller

Spaces with locally varying scale of measurement, like multidimensional structures with differently scaled dimensions, are pretty common in statistics and machine learning. Nevertheless, it is still understood as an open question how to…

Machine Learning · Statistics 2024-03-05 Christoph Jansen , Georg Schollmeyer , Hannah Blocher , Julian Rodemann , Thomas Augustin

Probabilistic graphical models (PGMs) are powerful tools for representing statistical dependencies through graphs in high-dimensional systems. However, they are limited to pairwise interactions. In this work, we propose the simplicial…

Machine Learning · Statistics 2025-10-16 Lorenzo Marinucci , Gabriele D'Acunto , Paolo Di Lorenzo , Sergio Barbarossa

We introduce data structures for solving robust regression through stochastic gradient descent (SGD) by sampling gradients with probability proportional to their norm, i.e., importance sampling. Although SGD is widely used for large scale…

Machine Learning · Computer Science 2022-07-19 Sepideh Mahabadi , David P. Woodruff , Samson Zhou

Simulations are becoming ever more common as a tool for designing complex products. Sensitivity analysis techniques can be applied to these simulations to gain insight, or to reduce the complexity of the problem at hand. However, these…

Other Computer Science · Computer Science 2017-02-03 Tom Van Steenkiste , Joachim van der Herten , Ivo Couckuyt , Tom Dhaene

The problem of identifying change points in high-dimensional Gaussian graphical models (GGMs) in an online fashion is of interest, due to new applications in biology, economics and social sciences. The offline version of the problem, where…

Statistics Theory · Mathematics 2020-03-18 Hossein Keshavarz , George Michailidis

In many problems involving generalized linear models, the covariates are subject to measurement error. When the number of covariates p exceeds the sample size n, regularized methods like the lasso or Dantzig selector are required. Several…

Methodology · Statistics 2018-01-23 Øystein Sørensen , Arnoldo Frigessi , Magne Thoresen

The stochastic gradient descent (SGD) algorithm has been widely used in statistical estimation for large-scale data due to its computational and memory efficiency. While most existing works focus on the convergence of the objective function…

Machine Learning · Statistics 2023-11-02 Xi Chen , Jason D. Lee , Xin T. Tong , Yichen Zhang

Deep Gaussian processes (DGPs) can model complex marginal densities as well as complex mappings. Non-Gaussian marginals are essential for modelling real-world data, and can be generated from the DGP by incorporating uncorrelated variables…

Machine Learning · Statistics 2019-05-15 Hugh Salimbeni , Vincent Dutordoir , James Hensman , Marc Peter Deisenroth

Data collection is a fundamental problem in the scenario of big data, where the size of sampling sets plays a very important role, especially in the characterization of data structure. This paper considers the information collection process…

Information Theory · Computer Science 2018-01-23 Shanyun Liu , Rui She , Pingyi Fan

Every computer model depends on numerical input parameters that are chosen according to mostly conservative but rigorous numerical or empirical estimates. These parameters could for example be the step size for time integrators, a seed for…

Computational Physics · Physics 2020-09-11 Matthias Frey , Andreas Adelmann

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

Markov decision models (MDM) used in practical applications are most often less complex than the underlying `true' MDM. The reduction of model complexity is performed for several reasons. However, it is obviously of interest to know what…

Optimization and Control · Mathematics 2019-09-18 Patrick Kern , Axel Simroth , Henryk Zähle

In this paper, we study sensitivity indices for independent groups of variables and we look at the particular case of block-additive models. We show in this case that most of the Sobol indices are equal to zero and that Shapley effects can…

Statistics Theory · Mathematics 2018-12-12 Baptiste Broto , François Bachoc , Marine Depecker , Jean-Marc Martinez

We provide a novel method for sensitivity analysis of parametric robust Markov chains. These models incorporate parameters and sets of probability distributions to alleviate the often unrealistic assumption that precise probabilities are…

Machine Learning · Computer Science 2023-05-03 Thom Badings , Sebastian Junges , Ahmadreza Marandi , Ufuk Topcu , Nils Jansen

Variance-based sensitivity indices have established themselves as a reference among practitioners of sensitivity analysis of model output. It is not unusual to consider a variance-based sensitivity analysis as informative if it produces at…

In uncertainty quantification, a stochastic modelling is often applied, where parameters are substituted by random variables. We investigate linear dynamical systems of ordinary differential equations with a quantity of interest as output.…

Numerical Analysis · Mathematics 2019-09-23 Roland Pulch , Akil Narayan

Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear…

Methodology · Statistics 2017-03-22 Hachem Saddiki , Andrew C. Trapp , Patrick Flaherty