English
Related papers

Related papers: Delta Theorem in the Age of High Dimensions

200 papers

Data can be assumed to be continuous functions defined on an infinite-dimensional space for many phenomena. However, the infinite-dimensional data might be driven by a small number of latent variables. Hence, factor models are relevant for…

Methodology · Statistics 2022-05-18 Israel Martínez-Hernández , Jesús Gonzalo , Graciela González-Farías

Test-time scaling paradigms have significantly advanced the capabilities of large language models (LLMs) on complex tasks. Despite their empirical success, theoretical understanding of the sample efficiency of various test-time strategies…

Machine Learning · Computer Science 2025-06-13 Baihe Huang , Shanda Li , Tianhao Wu , Yiming Yang , Ameet Talwalkar , Kannan Ramchandran , Michael I. Jordan , Jiantao Jiao

As is known, factor analysis is a popular method to reduce dimension for high-dimensional data. For matrix data, the dimension reduction can be more effectively achieved through both row and column directions. In this paper, we introduce a…

Methodology · Statistics 2019-04-17 Xialu Liu , Elynn Chen

We present a new finite-sample analysis of M-estimators of locations in $\mathbb{R}^d$ using the tool of the influence function. In particular, we show that the deviations of an M-estimator can be controlled thanks to its influence function…

Statistics Theory · Mathematics 2022-08-23 Timothée Mathieu

To make inference about a group of parameters on high-dimensional data, we develop the method of estimator augmentation for the block Lasso, which is defined via the block norm. By augmenting a block Lasso estimator $\hat{\beta}$ with the…

Methodology · Statistics 2017-08-16 Qing Zhou , Seunghyun Min

In this paper, we consider an estimation problem concerning the matrix of correlation coefficients in context of high dimensional data settings. In particular, we revisit some results in Li and Rolsalsky [Li, D. and Rolsalsky, A. (2006).…

Statistics Theory · Mathematics 2017-06-22 Sévérien Nkurunziza , Yueleng Wang

This theoretical work considers the following conundrum: linear response theory is successfully used by scientists in numerous fields, but mathematicians have shown that typical low-dimensional dynamical systems violate the theory's…

Dynamical Systems · Mathematics 2018-08-01 Caroline L. Wormell , Georg A. Gottwald

We develop, discuss, and compare several inference techniques to constrain theory parameters in collider experiments. By harnessing the latent-space structure of particle physics processes, we extract extra information from the simulator.…

High Energy Physics - Phenomenology · Physics 2018-09-19 Johann Brehmer , Kyle Cranmer , Gilles Louppe , Juan Pavez

This paper aims to develop practical applications of the model for the highly technical measure-valued populations developed by the authors in \cite{FanEtal20}. We consider the problem of estimation of parameters in the general age and…

Statistics Theory · Mathematics 2025-06-30 Jie Yen Fan , Kais Hamza , Fima C. Klebaner , Ziwen Zhong

This note introduces a novel paradigm for conformal defects with continuously adjustable dimensions. Just as the standard $\varepsilon$ expansion interpolates between integer spacetime dimensions, a new parameter, $\delta$, is used to…

High Energy Physics - Theory · Physics 2025-09-04 Elia de Sabbata , Nadav Drukker , Andreas Stergiou

Traditional approaches to estimating beta in finance often involve rigid assumptions and fail to adequately capture beta dynamics, limiting their effectiveness in use cases like hedging. To address these limitations, we have developed a…

Statistical Finance · Quantitative Finance 2024-10-29 Yuxin Liu , Jimin Lin , Achintya Gopal

In this article, we propose some two-sample tests based on ball divergence and investigate their high dimensional behavior. First, we study their behavior for High Dimension, Low Sample Size (HDLSS) data, and under appropriate regularity…

Statistics Theory · Mathematics 2024-10-08 Bilol Banerjee , Anil K. Ghosh

Recent advances in statistics introduced versions of the central limit theorem for high-dimensional vectors, allowing for the construction of confidence regions for high-dimensional parameters. In this note, $s$-sparsely convex…

Statistics Theory · Mathematics 2021-05-20 Sven Klaassen

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

Optimization and Control · Mathematics 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

This paper deals with subspace estimation in the small sample size regime, where the number of samples is comparable in magnitude with the observation dimension. The traditional estimators, mostly based on the sample correlation matrix, are…

Methodology · Statistics 2015-06-19 Pascal Vallet , Xavier Mestre , Philippe Loubaton

This paper deals with the factor modeling for high-dimensional time series based on a dimension-reduction viewpoint. Under stationary settings, the inference is simple in the sense that both the number of factors and the factor loadings are…

Statistics Theory · Mathematics 2012-06-05 Clifford Lam , Qiwei Yao

The problem of learning one task using samples from another task is central to transfer learning. In this paper, we focus on answering the following question: when does combining the samples from two related tasks perform better than…

Machine Learning · Statistics 2025-06-11 Fan Yang , Hongyang R. Zhang , Sen Wu , Christopher Ré , Weijie J. Su

High-dimensional multivariate time series are challenging due to the dependent and high-dimensional nature of the data, but in many applications there is additional structure that can be exploited to reduce computing time along with…

Methodology · Statistics 2020-03-13 Michael Schweinberger , Sergii Babkin , Katherine Ensor

This paper focuses on testing for the presence of alpha in time-varying factor pricing models, specifically when the number of securities N is larger than the time dimension of the return series T. We introduce a maximum-type test that…

Methodology · Statistics 2023-07-19 Huifang MA , Long Feng , Zhaojun Wang

Accurate estimation for extent of cross{sectional dependence in large panel data analysis is paramount to further statistical analysis on the data under study. Grouping more data with weak relations (cross{sectional dependence) together…

Econometrics · Economics 2019-04-16 Jiti Gao , Guangming Pan , Yanrong Yang , Bo Zhang