English
Related papers

Related papers: Bias-free model fitting of correlated data in inte…

200 papers

Detecting the components common or correlated across multiple data sets is challenging due to a large number of possible correlation structures among the components. Even more challenging is to determine the precise structure of these…

Information Theory · Computer Science 2019-02-01 Tanuj Hasija , Christian Lameiro , Timothy Marrinan , Peter J. Schreier

Uncoupled regression is the problem to learn a model from unlabeled data and the set of target values while the correspondence between them is unknown. Such a situation arises in predicting anonymized targets that involve sensitive…

Machine Learning · Computer Science 2019-06-04 Liyuan Xu , Junya Honda , Gang Niu , Masashi Sugiyama

Semiparametric regression offers a flexible framework for modeling non-linear relationships between a response and covariates. A prime example are generalized additive models where splines (say) are used to approximate non-linear functional…

Statistics Theory · Mathematics 2018-10-05 Francis K. C. Hui , Chong You , Han Lin Shang , Samuel Müller

The phenomenon of benign overfitting is one of the key mysteries uncovered by deep learning methodology: deep neural networks seem to predict well, even with a perfect fit to noisy training data. Motivated by this phenomenon, we consider…

Machine Learning · Statistics 2022-06-08 Peter L. Bartlett , Philip M. Long , Gábor Lugosi , Alexander Tsigler

We consider identification, inference and validation of linear panel data models when both factors and factor loadings are accounted for by a nonparametric function. This general specification encompasses rather popular models such as the…

Econometrics · Economics 2025-06-13 Juan M. Rodriguez-Poo , Alexandra Soberon , Stefan Sperlich

In this article we present very intuitive, easy to follow, yet mathematically rigorous, approach to the so called data fitting process. Rather than minimizing the distance between measured and simulated data points, we prefer to find such…

Data Analysis, Statistics and Probability · Physics 2017-08-07 Marek W. Gutowski

I present in this paper a method to calibrate data obtained from optical and infrared interferometers. I show that correlated noises and errors need to be taken into account for a very good estimate of individual error bars but also when…

Astrophysics · Physics 2009-11-07 G. Perrin

Solutions of the bivariate, linear errors-in-variables estimation problem with unspecified errors are expected to be invariant under interchange and scaling of the coordinates. The appealing model of normally distributed true values and…

Statistics Theory · Mathematics 2012-02-07 David Leonard

The bias-variance trade-off is a central concept in supervised learning. In classical statistics, increasing the complexity of a model (e.g., number of parameters) reduces bias but also increases variance. Until recently, it was commonly…

Machine Learning · Statistics 2022-03-25 Jason W. Rocks , Pankaj Mehta

Measuring and testing dependence between complex objects is of great importance in modern statistics. Most existing work relied on the distance between random variables, which inevitably required the moment conditions to guarantee the…

Methodology · Statistics 2023-04-19 Yilin Zhang , Songshan Yang

In the past decade the mathematical theory of machine learning has lagged far behind the triumphs of deep neural networks on practical challenges. However, the gap between theory and practice is gradually starting to close. In this paper I…

Machine Learning · Statistics 2021-06-01 Mikhail Belkin

We propose a method to overcome the usual limitation of current data processing techniques in optical and infrared long-baseline interferometry: most reduction pipelines assume uncorrelated statistical errors and ignore systematics. We use…

Instrumentation and Methods for Astrophysics · Physics 2019-01-23 Régis Lachaume , Markus Rabus , Andrés Jordán , Rafael Brahm , Tabetha Boyajian , Kaspar von Braun , Jean-Philippe Berger

A very common task in data visualization is to plot many data points with some measured y-value as a function of fixed x-values. Uncertainties on the y-values are typically presented as vertical error bars that represent either a…

Methodology · Statistics 2026-05-05 Lukas Koch

Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as…

Methodology · Statistics 2022-05-17 Wei Lan , Xuerong Chen , Tao Zou , Chih-Ling Tsai

Cosmological large-scale structure analyses based on two-point correlation functions often assume a Gaussian likelihood function with a fixed covariance matrix. We study the impact on cosmological parameter estimation of ignoring the…

Cosmology and Nongalactic Astrophysics · Physics 2019-03-21 Darsh Kodwani , David Alonso , Pedro Ferreira

The effect of correlations between model parameters and nuisance parameters is discussed, in the context of fitting model parameters to data. Modifications to the usual $\chi^2$ method are required. Fake data studies, as used at present,…

Data Analysis, Statistics and Probability · Physics 2013-09-25 Byron Roe

If nonlocality is to be inferred from a violation of Bell's inequality, an important assumption is that the measurement settings are freely chosen by the observers, or alternatively, that they are random and uncorrelated with the…

Quantum Physics · Physics 2013-05-29 Jonathan Barrett , Nicolas Gisin

Quantum metrology deals with improving the resolution of instruments that are otherwise limited by shot noise and it is therefore a promising avenue for enabling scientific breakthroughs. The advantage can be even more striking when quantum…

A useful property of independent samples is that their correlation remains the same after applying marginal transforms. This invariance property plays a fundamental role in statistical inference, but does not hold in general for dependent…

Statistics Theory · Mathematics 2024-08-16 Takaaki Koike , Liyuan Lin , Ruodu Wang

Quantile regression is a powerful tool for detecting exposure-outcome associations given covariates across different parts of the outcome's distribution, but has two major limitations when the aim is to infer the effect of an exposure.…