English
Related papers

Related papers: Sample size effects in multivariate fitting of cor…

200 papers

We study large deviation probabilities for a sum of dependent random variables from a heavy-tailed factor model, assuming that the components are regularly varying. We identify conditions where both the factor and the idiosyncratic terms…

Probability · Mathematics 2007-12-05 Boualem Djehiche , Jens Svensson

In this paper we show that the apparent failure of QCD lattice perturbation theory to account for Monte Carlo measurements of perturbative quantities results from choosing the bare lattice coupling constant as the expansion parameter. Using…

High Energy Physics - Lattice · Physics 2009-10-22 G. P. Lepage , P. B. Mackenzie

Supporting sampling in the presence of joins is an important problem in data analysis, but is inherently challenging due to the need to avoid correlation between output tuples. Current solutions provide either correlated or non-correlated…

Databases · Computer Science 2017-02-15 Niranjan Kamat , Arnab Nandi

Several new methods have been proposed for performing valid inference after model selection. An older method is sampling splitting: use part of the data for model selection and part for inference. In this paper we revisit sample splitting…

Statistics Theory · Mathematics 2018-04-04 Alessandro Rinaldo , Larry Wasserman , Max G'Sell , Jing Lei

The comparison of a parameter in $k$ populations is a classical problem in statistics. Testing for the equality of means or variances are typical examples. Most procedures designed to deal with this problem assume that $k$ is fixed and that…

The quality of the narrow-width approximation is examined for partonic and convolved cross sections of sample processes. By comparison with accurate predictions significant limitations are revealed.

High Energy Physics - Phenomenology · Physics 2008-11-26 N. Kauer

We study the out-of-sample properties of robust empirical optimization problems with smooth $\phi$-divergence penalties and smooth concave objective functions, and develop a theory for data-driven calibration of the non-negative "robustness…

Machine Learning · Statistics 2020-05-20 Jun-Ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

We investigate the dynamics of increasing the number of model parameters versus the number of labeled examples across a wide variety of tasks. Our exploration reveals that while scaling parameters consistently yields performance…

Computation and Language · Computer Science 2021-10-12 Yuval Kirstain , Patrick Lewis , Sebastian Riedel , Omer Levy

This work introduces a comprehensive approach to assess the sensitivity of model outputs to changes in parameter values, constrained by the combination of prior beliefs and data. This novel approach identifies stiff parameter combinations…

There are many uses for linear fitting; the context here is interpolation and denoising of data, as when you have calibration data and you want to fit a smooth, flexible function to those data. Or you want to fit a flexible function to…

Data Analysis, Statistics and Probability · Physics 2021-09-22 David W. Hogg , Soledad Villar

Regression problems with bounded continuous outcomes frequently arise in real-world statistical and machine learning applications, such as the analysis of rates and proportions. A central challenge in this setting is predicting a response…

Machine Learning · Statistics 2025-07-21 Zhanli Wu , Fabrizio Leisen , F. Javier Rubio

Cumulative probability models (CPMs) are a robust alternative to linear models for continuous outcomes. However, they are not feasible for very large datasets due to elevated running time and memory usage, which depend on the sample size,…

Computation · Statistics 2022-07-15 Chun Li , Guo Chen , Bryan E. Shepherd

We consider the problem of estimating high-dimensional covariance matrices of $K$-populations or classes in the setting where the sample sizes are comparable to the data dimension. We propose estimating each class covariance matrix as a…

Methodology · Statistics 2022-02-08 Elias Raninen , David E. Tyler , Esa Ollila

Testing the independence between random vectors is a fundamental problem in statistics. Distance correlation, a recently popular dependence measure, is universally consistent for testing independence against all distributions with finite…

Methodology · Statistics 2024-08-22 Yuwei Ke , Hok Kan Ling , Yanglei Song

Penalized estimation principle is fundamental to high-dimensional problems. In the literature, it has been extensively and successfully applied to various models with only structural parameters. As a contrast, in this paper, we apply this…

Statistics Theory · Mathematics 2017-08-03 Jianqing Fan , Runlong Tang , Xiaofeng Shi

Sample-average approximations (SAA) are a practical means of finding approximate solutions of stochastic programming problems involving an extremely large (or infinite) number of scenarios. SAA can also be used to find estimates of a lower…

Other Statistics · Statistics 2014-05-08 Jiajie Chen , Cong Han Lim , Peter Z. G. Qian , Jeff Linderoth , Stephen J. Wright

We give improved constants for data dependent and variance sensitive confidence bounds, called empirical Bernstein bounds, and extend these inequalities to hold uniformly over classes of functionswhose growth function is polynomial in the…

Machine Learning · Statistics 2009-07-23 Andreas Maurer , Massimiliano Pontil

The precision of lattice QCD calculations is often hindered by the stochastic noise inherent in these methods. The control variates method can provide an effective noise reduction but are typically constructed using heuristic approaches,…

High Energy Physics - Lattice · Physics 2025-01-27 Hyunwoo Oh

A multivariate quantile regression model with a factor structure is proposed to study data with many responses of interest. The factor structure is allowed to vary with the quantile levels, which makes our framework more flexible than the…

Methodology · Statistics 2020-01-22 Shih-Kang Chao , Wolfgang Karl Härdle , Ming Yuan

With the violation of the assumption of homoskedasticity, least squares estimators of the variance become inefficient and statistical inference conducted with invalid standard errors leads to misleading rejection rates. Despite a vast…

Econometrics · Economics 2024-01-01 Annalivia Polselli