English
Related papers

Related papers: Linear Regression for Astronomical Data with Measu…

200 papers

We consider a general monotone regression estimation where we allow for independent and dependent regressors. We propose a modification of the classical isotonic least squares estimator and establish its rate of convergence for the…

Statistics Theory · Mathematics 2018-05-07 Konstantinos Fokianos , Anne Leucht , Michael H. Neumann

We applied three statistical classification techniques - linear discriminant analysis (LDA), logistic regression and random forests - to three astronomical datasets associated with searches for interstellar masers. We compared the…

Instrumentation and Methods for Astrophysics · Physics 2016-04-27 Ellen M. Manning , Barbara R. Holland , Simon P. Ellingsen , Shari L. Breen , Xi Chen , Melissa Humphries

Classical shadows (CS) offer a resource-efficient means to estimate quantum observables, circumventing the need for exhaustive state tomography. Here, we clarify and explore the connection between CS techniques and least squares (LS) and…

Quantum Physics · Physics 2024-12-11 Zhihui Zhu , Joseph M. Lukens , Brian T. Kirby

We present a new method for measuring the scale dependence of the intrinsic alignment (IA) contamination to the galaxy-galaxy lensing signal, which takes advantage of multiple shear estimation methods applied to the same source galaxy…

Cosmology and Nongalactic Astrophysics · Physics 2018-07-01 C. Danielle Leonard , Rachel Mandelbaum

Atmospheric lidar observations provide a unique capability to directly observe the vertical column of cloud and aerosol scattering properties. Detector and solar background noise, however, hinder the ability of lidar systems to provide…

Optimization and Control · Mathematics 2016-06-21 Willem J. Marais , Robert E. Holz , Yu Hen Hu , Ralph E. Kuehn , Edwin E. Eloranta , Rebecca M. Willett

With advancements in sensor technology, a heterogeneous set of data, containing samples of scalar, waveform signal, image, or even structured point cloud are becoming increasingly popular. Developing a statistical model, representing the…

Methodology · Statistics 2020-04-28 Mostafa Reisi Gahrooei , Hao Yan , Kamran Paynabar , Jianjun Shi

We consider the linear regression model with observation error in the design. In this setting, we allow the number of covariates to be much larger than the sample size. Several new estimation methods have been recently introduced for this…

Statistics Theory · Mathematics 2016-07-05 Alexandre Belloni , Mathieu Rosenbaum , Alexandre Tsybakov

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

Statistics Theory · Mathematics 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the…

Instrumentation and Methods for Astrophysics · Physics 2015-05-13 J. T. VanderPlas , A. J. Connolly

We review the methodology for measurements of two point functions of the cosmological observables, both power spectra and correlation functions. For pseudo-$C_\ell$ estimators, we will argue that the window weighted overdensity field can…

Cosmology and Nongalactic Astrophysics · Physics 2021-08-27 Sukhdeep Singh

The $\ell_1$-penalized method, or the Lasso, has emerged as an important tool for the analysis of large data sets. Many important results have been obtained for the Lasso in linear regression which have led to a deeper understanding of…

Machine Learning · Statistics 2011-12-30 Jian Huang , Cun-Hui Zhang

Measuring the two-point correlation function of the galaxies in the Universe gives access to the underlying dark matter distribution, which is related to cosmological parameters and to the physics of the primordial Universe. The estimation…

The principles of measuring the shapes of galaxies by a model-fitting approach are discussed in the context of shape-measurement for surveys of weak gravitational lensing. It is argued that such an approach should be optimal, allowing…

Astrophysics · Physics 2009-11-13 L. Miller , T. D. Kitching , C. Heymans , A. F. Heavens , L. Van Waerbeke

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

Machine Learning · Statistics 2012-06-22 Tingni Sun , Cun-Hui Zhang

Ordinary least square (OLS), maximum likelihood (ML) and robust methods are the widely used methods to estimate the parameters of a linear regression model. It is well known that these methods perform well under some distributional…

Other Statistics · Statistics 2018-01-29 Şenay Özdemir , Olcay Arslan

Different options can be used in order to measure the shear from observations in the context of weak lensing. Here we introduce new methods where the isotropy assumption for the distribution of the source galaxies is implemented directly on…

Astrophysics · Physics 2008-02-03 Marco Lombardi , Giuseppe Bertin

Stage-IV galaxy surveys will measure correlations at small cosmological scales with high signal-to-noise ratio. One of the main challenges of extracting information from small scales is devising accurate models, as well as characterizing…

Cosmology and Nongalactic Astrophysics · Physics 2025-05-20 Abdias Aires , Nickolas Kokron , Rogerio Rosenfeld , Felipe Andrade-Oliveira , Vivian Miranda

The use of small unmanned aircraft systems (sUAS) for applications in the field of precision agriculture has demonstrated the need to produce temporally consistent imagery to allow for quantitative comparisons. In order for these aerial…

Image and Video Processing · Electrical Eng. & Systems 2018-04-26 Baabak Mamaghani , Geoffrey Sasaki , Ryan Connal , Kevin Kha , Jackson Knappen , Ryan Hartzell , Evan Marcellus , Timothy Bauch , Nina Raqueno , Carl Salvaggio

We address covariance estimation in the sense of minimum mean-squared error (MMSE) for Gaussian samples. Specifically, we consider shrinkage methods which are suitable for high dimensional problems with a small number of samples (large p…

Methodology · Statistics 2015-05-13 Yilun Chen , Ami Wiesel , Yonina C. Eldar , Alfred O. Hero

In statistics, series of ordinary least squares problems (OLS) are used to study the linear correlation among sets of variables of interest; in many studies, the number of such variables is at least in the millions, and the corresponding…

Computational Engineering, Finance, and Science · Computer Science 2015-04-30 Alvaro Frank , Diego Fabregat-Traver , Paolo Bientinesi