English
Related papers

Related papers: Quantifying dependencies for sensitivity analysis …

200 papers

Reliable measurement of dependence between variables is essential in many applications of statistics and machine learning. Current approaches for dependence estimation, especially density-based approaches, lack in precision, robustness…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Rishabh Singh , Jose C. Principe

We introduce a framework for obtaining tight mixing times for Markov chains based on what we call restricted modified log-Sobolev inequalities. Modified log-Sobolev inequalities (MLSI) quantify the rate of relative entropy contraction for…

Data Structures and Algorithms · Computer Science 2021-11-08 Nima Anari , Vishesh Jain , Frederic Koehler , Huy Tuan Pham , Thuy-Duong Vuong

In this paper, we derive copula-based and empirical dependency models (DMs) for simulating non-independent variables, and then propose a new way for determining the distribution of the model outputs conditional on every subset of inputs.…

Statistics Theory · Mathematics 2022-09-12 Matieyendou Lamboni

Some classical uncertainty quantification problems require the estimation of multiple expectations. Estimating all of them accurately is crucial and can have a major impact on the analysis to perform, and standard existing Monte Carlo…

Methodology · Statistics 2022-12-02 Julien Demange-Chryst , François Bachoc , Jérôme Morio

Deploying LLMs raises two coupled challenges: (1) monitoring--estimating where a model underperforms as traffic and domains drift--and (2) improvement--prioritizing data acquisition to close the largest performance gaps. We test whether an…

Computation and Language · Computer Science 2026-05-27 Pedro Memoli Buffa , Luciano Del Corro

Numerical modeling is essential for comprehending intricate physical phenomena in different domains. To handle complexity, sensitivity analysis, particularly screening, is crucial for identifying influential input parameters. Kernel-based…

Methodology · Statistics 2024-05-17 Guerlain Lambert , Céline Helbert , Claire Lauvernet

Traditional decision tree models, which rely exclusively on numerical variables, often face challenges in handling high-dimensional data and are limited in their ability to incorporate textual information effectively. To address these…

Machine Learning · Computer Science 2026-01-13 Lu Han , Xiuying Wang

In the manifold learning problem one seeks to discover a smooth low dimensional surface, i.e., a manifold embedded in a higher dimensional linear vector space, based on a set of measured sample points on the surface. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Jose Costa , Alfred Hero

The fidelity-based smooth min-relative entropy is a distinguishability measure that has appeared in a variety of contexts in prior work on quantum information, including resource theories like thermodynamics and coherence. Here we provide a…

Quantum Physics · Physics 2024-05-29 Theshani Nuradha , Mark M. Wilde

To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Hongjian Xiao , Danilo P. Mandic

This article proposes a new index for quantifying the degree of dependence between random vectors. The index takes values in [0,1] and equals zero if and only if the random vectors are sub-independent. Unlike mere uncorrelatedness,…

Statistics Theory · Mathematics 2026-05-19 Chuancun yin

Estimating entropy production from real observation data can be difficult due to finite resolution in both space and time and finite measurement statistics. We characterize the statistical error introduced by finite sample size and compare…

Statistical Mechanics · Physics 2025-04-09 Jonas H. Fritz , Benjamin Ertel , Udo Seifert

Sensitivity analysis is a process of computing sensitivity indices, which are certain measures of importance of parameters in influencing the outputs of mathematical models. Sensitivity indices computed in variance-based sensitivity…

Computation · Statistics 2013-10-04 Tomasz Badowski

In this paper, a robust non-parametric measure of statistical dependence, or correlation, between two random variables is presented. The proposed coefficient is a permutation-like statistic that quantifies how much the observed sample S_n :…

Methodology · Statistics 2020-07-27 Rami Mahdi

Choi et. al (2011) introduced a minimum spanning tree (MST)-based method called CLGrouping, for constructing tree-structured probabilistic graphical models, a statistical framework that is commonly used for inferring phylogenetic trees.…

Combinatorics · Mathematics 2017-01-12 Prabhav Kalaghatgi , Thomas Lengauer

The method of maximum entropy is quite a powerful tool to solve the generalized moment problem, which consists of determining the probability density of a random variable X from the knowledge of the expected values of a few functions of the…

Statistics Theory · Mathematics 2015-10-15 Henryk Gzyl

In global sensitivity analysis, the well known Sobol' sensitivity indices aim to quantify how the variance in the output of a mathematical model can be apportioned to the different variances of its input random variables. These indices are…

Statistics Theory · Mathematics 2018-01-11 Nazih Benoumechiara , Kevin Elie-Dit-Cosaque

One of the crucial steps in scientific studies is to specify dependent relationships among factors in a system of interest. Given little knowledge of a system, can we characterize the underlying dependent relationships through observation…

Information Theory · Computer Science 2012-12-24 Shohei Hidaka

Existing variance reduction techniques used in stochastic simulations for rare event analysis still require a substantial number of model evaluations to estimate small failure probabilities. In the context of complex, nonlinear finite…

Machine Learning · Computer Science 2025-08-04 Liuyun Xu , Seymour M. J. Spence

Sensor selection is critical for state estimation, control and monitoring of nonlinear processes. However, evaluating the performance of each possible combination of $m$ out of $n$ sensors is impractical unless $m$ and $n$ are small. In…

Systems and Control · Electrical Eng. & Systems 2022-08-02 Siyu Liu , Xunyuan Yin , Zhichao Pan , Jinfeng Liu