English
Related papers

Related papers: Delta Theorem in the Age of High Dimensions

200 papers

This paper addresses differential inference in time-varying parametric probabilistic models, like graphical models with changing structures. Instead of estimating a high-dimensional model at each time point and estimating changes later, we…

Machine Learning · Statistics 2025-04-08 Daniel J. Williams , Leyang Wang , Qizhen Ying , Song Liu , Mladen Kolar

We introduce a new combinatorial structure: the superselector. We show that superselectors subsume several important combinatorial structures used in the past few years to solve problems in group testing, compressed sensing, multi-channel…

Data Structures and Algorithms · Computer Science 2010-10-07 Ferdinando Cicalese , Ugo Vaccaro

Linear mixed models (LMMs) are used extensively to model dependecies of observations in linear regression and are used extensively in many application areas. Parameter estimation for LMMs can be computationally prohibitive on big data.…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Kimberly Roche , Xiang Zhou , Sayan Mukherjee

For high dimensional data, some of the standard statistical techniques do not work well. So modification or further development of statistical methods are necessary. In this paper, we explore these modifications. We start with the important…

Statistical Finance · Quantitative Finance 2024-05-29 Arnab Chakrabarti , Rituparna Sen

The problem of estimation error in portfolio optimization is discussed, in the limit where the portfolio size N and the sample size T go to infinity such that their ratio is fixed. The estimation error strongly depends on the ratio N/T and…

Portfolio Management · Quantitative Finance 2009-11-13 Imre Kondor , Istvan Varga-Haszonits

To measure the degree of agreement between two observers that independently classify $n$ subjects within $K$ categories, it is common to use different kappa type coefficients, the most common of which is the $\kappa_C$ coefficient (Cohen's…

Statistics Theory · Mathematics 2026-02-24 A. Martín Andrés , M. Álvarez Hernández

In this paper, we give a general time-varying parameter model, where the multidimensional parameter possibly includes jumps. The quantity of interest is defined as the integrated value over time of the parameter process $\Theta = T^{-1}…

Statistical Finance · Quantitative Finance 2018-08-22 Yoann Potiron , Per Mykland

In this paper we consider an extension of the beta regression model proposed by Ferrari and Cribari-Neto (2004). We extend their model in two different ways, first, we let the regression structure be nonlinear, second, we allow a regression…

Methodology · Statistics 2009-10-24 Alexandre B. Simas , Wagner Barreto-Souza , Andréa V. Rocha

The need to measure the degree of agreement among R raters who independently classify n subjects within K nominal categories is frequent in many scientific areas. The most popular measures are Cohen's kappa (R = 2), Fleiss' kappa, Conger's…

Applications · Statistics 2022-02-01 A. Martín Andrés , M. Álvarez Hernández

Density ratio estimation in high dimensions can be reframed as integrating a certain quantity, the time score, over probability paths which interpolate between the two densities. In practice, the time score has to be estimated based on…

Machine Learning · Computer Science 2025-06-13 Hanlin Yu , Arto Klami , Aapo Hyvärinen , Anna Korba , Omar Chehab

In this paper, we study inference for high-dimensional data characterized by small sample sizes relative to the dimension of the data. In particular, we provide an infinite-dimensional framework to study statistical models that involve…

Statistics Theory · Mathematics 2010-02-25 Jim Kuelbs , Anand N. Vidyashankar

High-Dimensional Dynamic Factor Models are presented in detail: The main assumptions and their motivation, main results, illustrations by means of elementary examples. In particular, the role of singular ARMA models in the theory and…

Systems and Control · Electrical Eng. & Systems 2022-02-17 Marco Lippi , Manfred Deistler , Brian Anderson

We take a different look at the problem of testing the independence of two metric-space-valued random variables using the distance correlation. Instead of testing if the distance correlation vanishes exactly, we are interested in the…

Statistics Theory · Mathematics 2025-11-19 Holger Dette , Marius Kroll

Many statistical methodologies for high-dimensional data assume the population is normal. Although a few multivariate normality tests have been proposed, to the best of our knowledge, none of them can properly control the type I error when…

Methodology · Statistics 2021-05-04 Hao Chen , Yin Xia

We consider a one-dimensional symmetric Levy process that has local time. In the first part, we construct a self-adjoint extension of the generator of the process so that the constructed operator corresponds to the generator with the delta…

Probability · Mathematics 2025-01-13 Temirlan Abildaev

We study large deviations for some non-local parabolic type equations. We show that, under some assumptions on the non-local term, problems defined in a bounded domain converge with an exponential rate to the solution of the problem defined…

Analysis of PDEs · Mathematics 2008-12-01 Cristina Brändle , Emmanuel Chasseigne

We consider the task of meta-analysis in high-dimensional settings in which the data sources are similar but non-identical. To borrow strength across such heterogeneous datasets, we introduce a global parameter that emphasizes…

Methodology · Statistics 2022-07-01 Subha Maity , Yuekai Sun , Moulinath Banerjee

Empirically, large-scale deep learning models often satisfy a neural scaling law: the test error of the trained model improves polynomially as the model size and data size grow. However, conventional wisdom suggests the test error consists…

Machine Learning · Computer Science 2025-06-11 Licong Lin , Jingfeng Wu , Sham M. Kakade , Peter L. Bartlett , Jason D. Lee

Linear response theory has found many applications in statistical physics. One of these is to compute minimal-work protocols that drive nonequilibrium systems between different thermodynamic states, which are useful for designing engineered…

Statistical Mechanics · Physics 2026-01-19 Samuel. H. DAmbrosia , Adrianne Zhong , Michael R. DeWeese

We are interested in the problem of robust parametric estimation of a density from $n$ i.i.d. observations. By using a practice-oriented procedure based on robust tests, we build an estimator for which we establish non-asymptotic risk…

Statistics Theory · Mathematics 2016-03-31 Mathieu Sart