English
Related papers

Related papers: A scale-dependent notion of effective dimension

200 papers

Factor modeling is an essential tool for exploring intrinsic dependence structures among high-dimensional random variables. Much progress has been made for estimating the covariance matrix from a high-dimensional factor model. However, the…

Statistics Theory · Mathematics 2016-10-26 Quefeng Li , Guang Cheng , Jianqing Fan , Yuyan Wang

We introduce a new sufficient dimension reduction framework that targets a statistical functional of interest, and propose an efficient estimator for the semiparametric estimation problems of this type. The statistical functional covers a…

Statistics Theory · Mathematics 2014-03-24 Wei Luo , Bing Li , Xiangrong Yin

We show how to verify the metrological usefulness of quantum states based on the expectation values of an arbitrarily chosen set of observables. In particular, we estimate the quantum Fisher information as a figure of merit of metrological…

Quantum Physics · Physics 2017-04-25 Iagoba Apellaniz , Matthias Kleinmann , Otfried Gühne , Geza Toth

Scientists and engineers rely on accurate mathematical models to quantify the objects of their studies, which are often high-dimensional. Unfortunately, high-dimensional models are inherently difficult, i.e. when observations are sparse or…

Machine Learning · Computer Science 2018-02-13 Robert A. Bridges , Chris Felder , Chelsey Hoff

Dimension reduction lies at the heart of many statistical methods. In regression, dimension reduction has been linked to the notion of sufficiency whereby the relation of the response to a set of predictors is explained by a lower…

Methodology · Statistics 2020-06-02 Hyung Park , Eva Petkova , Thaddeus Tarpey , R. Todd Ogden

We study an abstract framework for interactive learning called interactive estimation in which the goal is to estimate a target from its "similarity'' to points queried by the learner. We introduce a combinatorial measure called…

Machine Learning · Computer Science 2023-06-13 Nataly Brukhim , Miroslav Dudik , Aldo Pacchiano , Robert Schapire

We define a scale-dependent effective mass anomalous dimension from the scaling of the mode number of the massless Dirac operator, which connects the perturbative $\gamma_m$ of an asymptotically-free system to the universal…

High Energy Physics - Lattice · Physics 2022-09-21 Anqi Cheng , Anna Hasenfratz , Gregory Petropoulos , David Schaich

Informative interim adaptations lead to random sample sizes. The random sample size becomes a component of the sufficient statistic and estimation based solely on observed samples or on the likelihood function does not use all available…

Methodology · Statistics 2022-10-25 Sergey Tarima , Nancy Flournoy

The Fisher information matrix can be used to characterize the local geometry of the parameter space of neural networks. It elucidates insightful theories and useful tools to understand and optimize neural networks. Given its high…

Machine Learning · Computer Science 2024-10-31 Alexander Soen , Ke Sun

We consider the statistical analysis of data on high-dimensional spheres and shape spaces. The work is of particular relevance to applications where high-dimensional data are available--a commonly encountered situation in many disciplines.…

Statistics Theory · Mathematics 2007-06-13 Ian L. Dryden

We propose a novel two-stage subsampling algorithm based on optimal design principles. In the first stage, we use a density-based clustering algorithm to identify an approximating design space for the predictors from an initial subsample.…

Methodology · Statistics 2024-03-20 Subhadra Dasgupta , Holger Dette

Quantifying the influence of infinitesimal changes in training data on model performance is crucial for understanding and improving machine learning models. In this work, we reformulate this problem as a weighted empirical risk minimization…

Machine Learning · Computer Science 2025-04-11 Omri Lev , Ashia C. Wilson

Research often necessitates of samples, yet obtaining large enough samples is not always possible. When it is, the researcher may use one of two methods for deciding upon the required sample size: rules-of-thumb, quick yet uncertain, and…

Methodology · Statistics 2016-04-08 Jose D. Perezgonzalez

We present an innovative approach to dimensional analysis, referred to as augmented dimensional analysis and based on a representation theorem for complete quantity functions with a scaling-covariant scalar representation. This new theorem,…

Mathematical Physics · Physics 2024-08-09 Dan Jonsson

The numerical dimension is a numerical measure of the positivity of a pseudo-effective divisor $L$. There are several proposed definitions of the numerical dimension due to Nakayama (2004) and Boucksom et al. (2004). We prove the equality…

Algebraic Geometry · Mathematics 2015-08-21 Brian Lehmann

Statistical models often include thousands of parameters. However, large models decrease the investigator's ability to interpret and communicate the estimated parameters. Reducing the dimensionality of the parameter space in the estimation…

Methodology · Statistics 2022-05-16 Eric Dunipace , Lorenzo Trippa

An algorithm for efficiently calculating the expected size of single-seed cascade dynamics on networks is proposed and tested. The expected size is a time-dependent quantity and so enables the identification of nodes who are the most…

Physics and Society · Physics 2025-05-01 James P. Gleeson , Ailbhe Cassidy , Daniel Giles , Ali Faqeeh

In this paper, we study an asymptotic approximation of the Fisher information for the estimation of a scalar parameter using quantized measurements. We show that, as the number of quantization intervals tends to infinity, the loss of Fisher…

Information Theory · Computer Science 2013-10-28 Rodrigo Cabral Farias , Jean-Marc Brossier

This article presents a pragmatic framework for making formal, utility-based decisions from statistical inferences. The method calculates an expected utility score for an intervention by combining Bayesian posterior probabilities of…

Methodology · Statistics 2025-11-11 Will G. Hopkins

We theoretically explore the relationship between sample-efficiency and adaptivity in reinforcement learning. An algorithm is sample-efficient if it uses a number of queries $n$ to the environment that is polynomial in the dimension $d$ of…

Machine Learning · Computer Science 2024-05-29 Emmeran Johnson , Ciara Pike-Burke , Patrick Rebeschini