English
Related papers

Related papers: Bias-free model fitting of correlated data in inte…

200 papers

In some multivariate problems with missing data, pairs of variables exist that are never observed together. For example, some modern biological tools can produce data of this form. As a result of this structure, the covariance matrix is…

Methodology · Statistics 2013-08-13 Max Grazier G'Sell , Shai S. Shen-Orr , Robert Tibshirani

We report a possible solution to the trouble that the covariance fitting fails when the data is highly correlated and the covariance matrix has small eigenvalues. As an example, we choose the data analysis of highly correlated $B_K$ data on…

High Energy Physics - Lattice · Physics 2011-11-03 Boram Yoon , Yong-Chull Jang , Weonjong Lee , Chulwoo Jung

Interferometric observables are strongly correlated, yet it is common practice to ignore these correlations in the data analysis process. We develop an empirical model for the correlations present in Very Large Telescope Interferometer…

Instrumentation and Methods for Astrophysics · Physics 2021-01-04 Jens Kammerer , Antoine Mérand , Michael J. Ireland , Sylvestre Lacour

Testing the independence between random vectors is a fundamental problem in statistics. Distance correlation, a recently popular dependence measure, is universally consistent for testing independence against all distributions with finite…

Methodology · Statistics 2024-08-22 Yuwei Ke , Hok Kan Ling , Yanglei Song

A general structural equation model is fitted on a panel data set that consists of $I$ correlated samples. The correlated samples could be data from correlated populations or correlated observations from occasions of panel data. We consider…

Statistics Theory · Mathematics 2007-06-13 Savas Papadopoulos , Yasuo Amemiya

When data contains measurement errors, it is necessary to make assumptions relating the observed, erroneous data to the unobserved true phenomena of interest. These assumptions should be justifiable on substantive grounds, but are often…

Machine Learning · Statistics 2020-12-24 Noam Finkelstein , Roy Adams , Suchi Saria , Ilya Shpitser

Ideally, all analyses of normally distributed data should include the full covariance information between all data points. In practice, the full covariance matrix between all data points is not always available. Either because a result was…

Methodology · Statistics 2026-02-23 Lukas Koch

Kernel-phase is a data analysis method based on a generalization of the notion of closure-phase invented in the context of interferometry, but that applies to well corrected diffraction dominated images produced by an arbitrary aperture.…

Instrumentation and Methods for Astrophysics · Physics 2020-04-22 Frantz Martinache , Alban Ceau , Romain Laugier , Jens Kammerer , Mamadou N'Diaye , David Mary , Nick Cvetojevic , Coline Lopez

Confidence calibration is central to providing accurate and interpretable uncertainty estimates, especially under safety-critical scenarios. However, we find that existing calibration algorithms often overlook the issue of *proximity bias*,…

Machine Learning · Computer Science 2024-03-19 Miao Xiong , Ailin Deng , Pang Wei Koh , Jiaying Wu , Shen Li , Jianqing Xu , Bryan Hooi

This paper addresses the problem of measurement errors in causal inference and highlights several algebraic and graphical methods for eliminating systematic bias induced by such errors. In particulars, the paper discusses the control of…

Methodology · Statistics 2012-03-19 Judea Pearl

The possibility of strong biases in a multicomponent Maximum Likelihood fits with component-dependent templates has been demonstrated in some toy problems. We discuss here in detail a problem of practical interest, particle identification…

Data Analysis, Statistics and Probability · Physics 2017-08-23 P. Catastini , G. Punzi

The final step of most large-scale structure analyses involves the comparison of power spectra or correlation functions to theoretical models. It is clear that the theoretical models have parameter dependence, but frequently the…

Cosmology and Nongalactic Astrophysics · Physics 2016-01-13 Martin White , Nikhil Padmanabhan

Recovering a source signal from indirect measurements often requires estimating latent parameters, such as wireless channel states or MRI coil sensitivities, that cannot be directly observed. Here, we introduce Physics-Embedded Inverse…

Signal Processing · Electrical Eng. & Systems 2026-04-20 Le Cheng , Xiaoran Liu , Lingjin Kong , Haitao Zhao , Jun Xiong , Fanglin Gu , Xiaoying Zhang , Baoquan Ren , Jibo Wei , Hao Yin

We discuss fitting correlated data - with the example of hadron mass spectroscopy in mind. The main conclusion is that the method of minimising correlated $\chi^2$ is unreliable if the data sample is too small.

High Energy Physics - Lattice · Physics 2008-11-26 C. Michael

Missing data is a common problem in clinical data collection, which causes difficulty in the statistical analysis of such data. In this article, we consider the problem under a framework of a semiparametric partially linear model when…

Methodology · Statistics 2022-06-13 Zishu Zhan , Xiangjie Li , Jingxiao Zhang

Consistent experiment data are crucial to adjust parameters of physics models and to determine best estimates of observables. However, often experiment data are not consistent due to unrecognized systematic errors. Standard methods of…

Nuclear Theory · Physics 2018-03-05 Georg Schnabel

We introduce a general framework for regression in the errors-in-variables regime, allowing for full flexibility about the dimensionality of the data, observational error probability density types, the (nonlinear) model type and the…

Methodology · Statistics 2024-11-19 Wolfgang Hoegele , Sarah Brockhaus

Operating matter-wave interferometers as quantum detectors for fundamental physics or inertial sensors with unprecedented accuracies relies on noise rejection, often implemented by correlating multiple sensors. They can be spatially…

Quantum Physics · Physics 2026-05-11 Daniel Derr , Dominik Pfeiffer , Ludwig Lind , Gerhard Birkl , Enno Giese

In this manuscript we study the modeling of experimental data and its impact on the resulting integral experimental covariance and correlation matrices. By investigating a set of three low enriched and water moderated UO2 fuel rod arrays we…

Data Analysis, Statistics and Probability · Physics 2016-02-25 Elisabeth Peters , Fabian Sommer , Maik Stuke

It is common to conduct causal inference in matched observational studies by proceeding as though treatment assignments within matched sets are assigned uniformly at random and using this distribution as the basis for inference. This…

Methodology · Statistics 2023-11-14 Samuel D. Pimentel , Yaxuan Huang
‹ Prev 1 2 3 10 Next ›