English
Related papers

Related papers: Regression for Astronomical Data with Realistic Di…

200 papers

A persistent challenge in astronomical machine learning is a systematic bias where predictions compress the dynamic range of true values-high values are consistently predicted too low while low values are predicted too high. Understanding…

Instrumentation and Methods for Astrophysics · Physics 2025-07-17 Yuan-Sen Ting

Strong foreground contamination in high resolution CMB data requires masking which introduces statistical anisotropies and renders a full maximum likelihood analysis numerically intractable. Standard analysis methods like the pseudo-C_l…

Cosmology and Nongalactic Astrophysics · Physics 2014-03-26 H. F. Gruetjen , E. P. S. Shellard

Mixture of autoregressions (MoAR) models provide a model-based approach to the clustering of time series data. The maximum likelihood (ML) estimation of MoAR models requires the evaluation of products of large numbers of densities of normal…

Computation · Statistics 2016-10-19 Hien D Nguyen , Geoffrey J McLachlan , Pierre Orban , Pierre Bellec , Andrew L Janke

Estimating the frequencies of multiple sinusoids in the presence of AWGN and when the data record is short is commonly accomplished by subspace-based methods such as ESPRIT, MUSIC, Min-Norm, etc. These methods do not assume that the data…

Signal Processing · Electrical Eng. & Systems 2020-08-31 P. Vishnu , C. S. Ramalingam

Massive vector field datasets are common in multi-spectral optical and radar sensors, among many other emerging areas of application. We develop a novel stochastic functional (data) analysis approach for detecting anomalies based on the…

Machine Learning · Statistics 2026-04-30 Julio E Castrillon-Candas , Michael Rosenbaum , Mark Kon

Maximum Likelihood (ML) offers attractive alternatives to Generalized Method of Moments (GMM) estimators for dynamic panel data models. However, to date no identification-robust inference methods exist that can be used in conjunction with…

Econometrics · Economics 2025-12-16 Hugo Kruiniger

We study mixture of linear regression (random coefficient) models, which capture population heterogeneity by allowing the regression coefficients to follow an unknown distribution $G^*$. In contrast to common parametric methods that fix the…

Methodology · Statistics 2025-07-01 Hansheng Jiang , Adityanand Guntuboyina

Ground-based optical surveys such as PanSTARRS, DES, and LSST, will produce large catalogs to limiting magnitudes of r > 24. Star-galaxy separation poses a major challenge to such surveys because galaxies---even very compact…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 Ross Fadely , David W. Hogg , Beth Willman

A fundamental problem in modern supervised learning is computing reliable conditional prediction intervals in high-dimensional settings: existing methods often rely on restrictive modelling assumptions, do not scale as predictor dimension…

Machine Learning · Statistics 2026-02-24 Daniel Salnikov , Dan Leonte , Kevin Michalewicz

I discuss an issue arising in analyzing data from astronomical surveys: accounting for measurement uncertainties in the properties of individual sources detected in a survey when making inferences about the entire population of sources.…

Astrophysics · Physics 2009-11-10 Thomas J. Loredo

Estimating spatial regression models on large, irregularly structured datasets poses significant computational hurdles. While Pairwise Likelihood (PL) methods offer a pathway to simplify these estimations, the efficient selection of…

Methodology · Statistics 2025-07-11 Giuseppe Arbia , Vincenzo Nardelli , Niccolo Salvini

Existing approaches remain largely constrained by traditional distance metrics, limiting their effectiveness in handling random data. In this work, we introduce the first k-means variant in the literature that operates within a…

We present a Gaussian regression method for time series with missing data and stationary residuals of unknown power spectral density (PSD). The missing data are efficiently estimated by their conditional expectation as in universal Kriging,…

General Relativity and Quantum Cosmology · Physics 2016-08-31 Quentin Baghi , Gilles Métris , Joël Bergé , Bruno Christophe , Pierre Touboul , Manuel Rodrigues

Missing data are inevitable in longitudinal studies. Traditional methods, such as the full information maximum likelihood (FIML), are commonly used to handle ignorable missing data. However, they may lead to biased model estimation due to…

Applications · Statistics 2024-01-01 Dandan Tang , Xin Tong

This paper presents a novel method for statistical inference in high-dimensional binary models with unspecified structure, where we leverage a (potentially misspecified) sparsity-constrained working generalized linear model (GLM) to…

Methodology · Statistics 2025-10-03 Xiaotian Hou , Peng Wang , Minge Xie , Linjun Zhang

Large Language Model (LLM) inference systems present significant challenges in statistical performance characterization due to dynamic workload variations, diverse hardware architectures, and complex interactions between model size, batch…

Performance · Computer Science 2025-05-15 Kaustabha Ray , Nelson Mimura Gonzalez , Bruno Wassermann , Rachel Tzoref-Brill , Dean H. Lorenz

We consider the problem of inferring a causality structure from multiple binary time series by using the Kinetic Ising Model in datasets where a fraction of observations is missing. We take our steps from a recent work on Mean Field methods…

Data Analysis, Statistics and Probability · Physics 2019-07-03 Carlo Campajola , Fabrizio Lillo , Daniele Tantari

Building on previous Bayesian approaches, we introduce a novel formulation of probabilistic cross-identification, where detections are directly associated to (hypothesized) astronomical objects in a globally optimal way. We show that this…

Instrumentation and Methods for Astrophysics · Physics 2022-07-25 Tu Nguyen , Amitabh Basu , Támas Budavári

Traditional meta-analysis assumes that the effect sizes estimated in individual studies follow a Gaussian distribution. However, this distributional assumption is not always satisfied in practice, leading to potentially biased results. In…

Methodology · Statistics 2024-04-23 Wei Liang , Haicheng Huang , Hongsheng Dai , Yinghui Wei

With recent advances in modelling stars using high-precision asteroseismology, the systematic effects associated with our assumptions of stellar helium abundance ($Y$) and the mixing-length theory parameter ($\alpha_\mathrm{MLT}$) are…