English
Related papers

Related papers: A method for filling gaps in solar irradiance and …

200 papers

Evaluating treatment effects is critical in clinical trials but sometimes involves lengthy, invasive, or costly follow-up procedures. In these cases, surrogate markers, which provide intermediate measures of the long-term treatment effect,…

Methodology · Statistics 2026-03-24 Sarah C. Lotspeich , P. D. Anh. Nguyen , Layla Parast

Spurious measurements frequently occur in surface data from technical components. Excluding or ignoring these spurious points may lead to incorrect surface characterization if these points inherit features of the surface. Therefore, data…

Methodology · Statistics 2025-04-10 Arsalan Jawaid , Samuel Schmidt , Marvin Lotz , Jörg Seewig

Often in real-world datasets, especially in high dimensional data, some feature values are missing. Since most data analysis and statistical methods do not handle gracefully missing values, the first step in the analysis requires the…

Machine Learning · Statistics 2016-12-08 Yehezkel S. Resheff , Daphna Weinshall

Consumer cameras, particularly onboard smartphones and UAVs, are now commonly used as scientific instruments. However, their data processing pipelines are not optimized for quantitative radiometry and their calibration is more complex than…

Instrumentation and Detectors · Physics 2019-06-25 Olivier Burggraaff , Norbert Schmidt , Jaime Zamorano , Klaas Pauly , Sergio Pascual , Carlos Tapia , Evangelos Spyrakos , Frans Snik

Flux calibration of spectra in reverberation mapping (RM) is most often performed by assuming the flux constancy of some specified narrow emission lines, which stem from an extended region that is sometimes partially spatially resolved, in…

Instrumentation and Methods for Astrophysics · Physics 2015-06-19 Yan-Rong Li , Jian-Min Wang , Chen Hu , Pu Du , Jin-Ming Bai

In this work we present a new algorithm for data deconvolution that allows the retrieval of the target function with super-resolution with a simple approach that after a precis e measurement of the instrument response function (IRF), the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Sandra Martínez , Oscar E. Martínez

A new algorithm is developed to jointly recover a temporal sequence of images from noisy and under-sampled Fourier data. Specifically, we consider the case where each data set is missing vital information that prevents its (individual)…

Numerical Analysis · Mathematics 2022-05-13 Yao Xiao , Jan Glaubitz , Anne Gelb , Guohui Song

With their ability to handle an increased amount of information, multivariate and multichannel signals can be used to solve problems normally not solvable with signals obtained from a single source. One such problem is the decomposition…

Information Theory · Computer Science 2019-04-02 Ljubisa Stankovic , Milos Brajovic , Milos Dakovic , Danilo Mandic

Errors are prevalent in time series data, such as GPS trajectories or sensor readings. Existing methods focus more on anomaly detection but not on repairing the detected anomalies. By simply filtering out the dirty data via anomaly…

Databases · Computer Science 2020-03-30 Aoqian Zhang , Shaoxu Song , Jianmin Wang , Philip S. Yu

Missing data theory deals with the statistical methods in the occurrence of missing data. Missing data occurs when some values are not stored or observed for variables of interest. However, most of the statistical theory assumes that data…

When training predictive models on data with missing entries, the most widely used and versatile approach is a pipeline technique where we first impute missing entries and then compute predictions. In this paper, we view prediction with…

Machine Learning · Computer Science 2025-02-25 Dimitris Bertsimas , Arthur Delarue , Jean Pauphilet

Missing data is a major challenge in clinical research. In electronic medical records, often a large fraction of the values in laboratory tests and vital signs are missing. The missingness can lead to biased estimates and limit our ability…

Machine Learning · Computer Science 2023-04-18 Omer Noy , Ron Shamir

This paper proposes an imputation procedure that uses the factors estimated from a tall block along with the re-rotated loadings estimated from a wide block to impute missing values in a panel of data. Assuming that a strong factor…

Econometrics · Economics 2021-08-13 Jushan Bai , Serena Ng

The derivation of radial velocities from large numbers of spectra that typically result from survey work, requires automation. However, except for the classical cases of slowly rotating late-type spectra, existing methods of measuring…

Instrumentation and Methods for Astrophysics · Physics 2014-05-20 M. David , R. Blomme , Y. Frémat , Y. Damerdji , C. Delle Luche , E. Gosset , D. Katz , Y. Viala

Context. Solar wavefront sensing has been a challenge for astrophysical instrumentalists, due to the low contrast between the Sun and the sky background compared to night-time observations, which limits the performance of adaptive optics…

Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as…

Methodology · Statistics 2022-05-17 Wei Lan , Xuerong Chen , Tao Zou , Chih-Ling Tsai

We present an approach to inform decisions about nonresponse follow-up sampling. The basic idea is (i) to create completed samples by imputing nonrespondents' data under various assumptions about the nonresponse mechanisms, (ii) take…

Methodology · Statistics 2022-09-16 Thais Paiva , Jerry Reiter

The use of Fourier methods in wave-front reconstruction can significantly reduce the computation time for large telescopes with a high number of degrees of freedom. However, Fourier algorithms for discrete data require a rectangular data…

Instrumentation and Methods for Astrophysics · Physics 2017-06-07 Charlotte Z. Bond , Carlos M. Correia , Jean-François Sauvage , Benoit Neichel , Thierry Fusco

The integrity of time series data in smart grids is often compromised by missing values due to sensor failures, transmission errors, or disruptions. Gaps in smart meter data can bias consumption analyses and hinder reliable predictions,…

Artificial Intelligence · Computer Science 2025-02-21 Amir Sartipi , Joaquín Delgado Fernández , Sergio Potenciano Menci , Alessio Magitteri

Recent advances have demonstrated the possibility of solving the deconvolution problem without prior knowledge of the noise distribution. In this paper, we study the repeated measurements model, where information is derived from multiple…

Statistics Theory · Mathematics 2024-09-04 Jérémie Capitao-Miniconi , Elisabeth Gassiat , Luc Lehéricy