English
Related papers

Related papers: Why Machine Learning Models Systematically Underes…

200 papers

Attenuation bias -- the systematic underestimation of regression coefficients due to measurement errors in input variables -- affects astronomical data-driven models. For linear regression, this problem was solved by treating the true input…

Instrumentation and Methods for Astrophysics · Physics 2026-03-30 Yuan-Sen Ting

We tackle the problem of bias mitigation of algorithmic decisions in a setting where both the output of the algorithm and the sensitive variable are continuous. Most of prior work deals with discrete sensitive variables, meaning that the…

This paper addresses a regression problem in which output label values are the results of sensing the magnitude of a phenomenon. A low value of such labels can mean either that the actual magnitude of the phenomenon was low or that the…

Machine Learning · Computer Science 2023-06-01 Takayuki Katsuki , Takayuki Osogami

Cosmological parameter estimation from forthcoming experiments promise to reach much greater precision than current constraints. As statistical errors shrink, the required control over systematic errors increases. Therefore, models or…

Cosmology and Nongalactic Astrophysics · Physics 2020-10-07 José Luis Bernal , Nicola Bellomo , Alvise Raccanelli , Licia Verde

The random error of radioastronomical measurements is usually computed in the weak-signal limit, which assumes that the system temperature is sensibly the same on and off source, or with and without a spectral line. This assumption is often…

Astrophysics · Physics 2009-11-07 H. Liszt

Machine Learning algorithms are good tools for both classification and prediction purposes. These algorithms can further be used for scientific discoveries from the enormous data being collected in our era. We present ways of discovering…

Instrumentation and Methods for Astrophysics · Physics 2021-02-26 Shraddha Surana , Yogesh Wadadekar , Divya Oberoi

This textbook provides a systematic treatment of statistical machine learning for astronomical research through the lens of Bayesian inference, developing a unified framework that reveals connections between modern data analysis techniques…

Instrumentation and Methods for Astrophysics · Physics 2025-06-17 Yuan-Sen Ting

Machine learning has been widely applied to clearly defined problems of astronomy and astrophysics. However, deep learning and its conceptual differences to classical machine learning have been largely overlooked in these fields. The broad…

Instrumentation and Methods for Astrophysics · Physics 2024-10-15 Nima Sedaghat , Martino Romaniello , Jonathan E. Carrick , François-Xavier Pineau

Weak lensing experiments are a powerful probe of cosmology through their measurement of the mass distribution of the universe. A challenge for this technique is to control systematic errors that occur when measuring the shapes of distant…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-04 Alexandre Refregier , Tomasz Kacprzak , Adam Amara , Sarah Bridle , Barnaby Rowe

Deep learning has generated diverse perspectives in astronomy, with ongoing discussions between proponents and skeptics motivating this review. We examine how neural networks complement classical statistics, extending our data analytical…

Instrumentation and Methods for Astrophysics · Physics 2026-05-07 Yuan-Sen Ting

Anomaly detection presents a unique challenge in machine learning, due to the scarcity of labeled anomaly data. Recent work attempts to mitigate such problems by augmenting training of deep anomaly detection models with additional labeled…

Machine Learning · Computer Science 2021-05-18 Ziyu Ye , Yuxin Chen , Haitao Zheng

In machine learning, a bias occurs whenever training sets are not representative for the test data, which results in unreliable models. The most common biases in data are arguably class imbalance and covariate shift. In this work, we aim to…

Machine Learning · Computer Science 2018-04-04 Patrick Glauner , Radu State , Petko Valtchev , Diogo Duarte

Despite the great promise of machine-learning algorithms to classify and predict astrophysical parameters for the vast numbers of astrophysical sources and transients observed in large-scale surveys, the peculiarities of the training data…

Instrumentation and Methods for Astrophysics · Physics 2015-05-28 Joseph W. Richards , Dan L. Starr , Henrik Brink , Adam A. Miller , Joshua S. Bloom , Nathaniel R. Butler , J. Berian James , James P. Long , John Rice

I discuss the effects of measurement error on regression and density estimation. I review the statistical methods that have been developed to correct for measurement error that are most popular in astronomical data analysis, discussing…

Instrumentation and Methods for Astrophysics · Physics 2011-12-09 Brandon C. Kelly

Context: New spectroscopic surveys will increase the number of astronomical objects requiring characterization by over tenfold.. Machine learning tools are required to address this data deluge in a fast and accurate fashion. Most machine…

Parameter estimation of binary-black-hole merger events in gravitational-wave data relies on matched-filtering techniques, which, in turn, depend on accurate model waveforms. Here we characterize the systematic biases introduced in…

General Relativity and Quantum Cosmology · Physics 2013-05-08 Tyson B. Littenberg , John G. Baker , Alessandra Buonanno , Bernard J. Kelly

It is known that modeling uncertainties and astrophysical foregrounds can potentially introduce appreciable bias in the deduced values of cosmological parameters. While it is commonly assumed that these uncertainties will be accounted for…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-12 Meir Shimon , Nissan Itzhaki , Yoel Rephaeli

Anomalies drive scientific discovery -- they are associated with the cutting edge of the research frontier, and thus typically exploit data in the low signal-to-noise regime. In astronomy, the prevalence of systematics --- both "known…

Cosmology and Nongalactic Astrophysics · Physics 2014-10-16 Hiranya V. Peiris

The first half of this paper explores the origin of systematic biases in the measurement of weak gravitational lensing. Compared to previous work, we expand the investigation of PSF instability and fold in for the first time the effects of…

Machine learning techniques are increasingly being applied in high-energy nuclear physics data analysis thanks to their outstanding performance. One key challenge in such applications is the construction of training samples that can…

Nuclear Experiment · Physics 2025-11-14 Yan Wang , Rangrong Ma , Kaifeng Shen , Zebo Tang , Wangmei Zha
‹ Prev 1 2 3 10 Next ›