English
Related papers

Related papers: On the optimal stacking of noisy observations

200 papers

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

Statistics Theory · Mathematics 2019-06-26 Matthew J. Holland

The gradient boosting machine is one of the powerful tools for solving regression problems. In order to cope with its shortcomings, an approach for constructing ensembles of gradient boosting models is proposed. The main idea behind the…

Machine Learning · Computer Science 2020-10-14 Andrei V. Konstantinov , Lev V. Utkin

We analyze the effect of synchronization on distributed stochastic gradient algorithms. By exploiting an analogy with dynamical models of biological quorum sensing - where synchronization between agents is induced through communication with…

Optimization and Control · Mathematics 2020-12-18 Nicholas M. Boffi , Jean-Jacques E. Slotine

Gauss-Newton methods and their stochastic version have been widely used in machine learning and signal processing. Their nonsmooth counterparts, modified Gauss-Newton or prox-linear algorithms, can lead to contrasting outcomes when compared…

Optimization and Control · Mathematics 2023-05-19 Krishna Pillutla , Vincent Roulet , Sham Kakade , Zaid Harchaoui

Ensembling methods are well known for improving prediction accuracy. However, they are limited in the sense that they cannot discriminate among component models effectively. In this paper, we propose stacking with auxiliary features that…

Computation and Language · Computer Science 2016-05-30 Nazneen Fatema Rajani , Raymond J. Mooney

Many real-world classification problems are cost-sensitive in nature, such that the misclassification costs vary between data instances. Cost-sensitive learning adapts classification algorithms to account for differences in…

Machine Learning · Computer Science 2023-01-05 Natalie Lawrance , Marie-Anne Guerry , George Petrides

Suppose that we wish to estimate a vector $\mathbf{x} \in \mathbb{C}^n$ from a small number of noisy linear measurements of the form $\mathbf{y} = \mathbf{A x} + \mathbf{z}$, where $\mathbf{z}$ represents measurement noise. When the vector…

Information Theory · Computer Science 2016-09-21 Mark A. Davenport , Andrew K. Massimino , Deanna Needell , Tina Woolf

Systems in nature are stochastic as well as nonlinear. In traditional applications, engineered filters aim to minimize the stochastic effects caused by process and measurement noise. Conversely, a previous study showed that the process…

Systems and Control · Electrical Eng. & Systems 2024-07-11 Burak Boyacıoğlu , Mahnoush Babaei , Amanuel H. Mamo , Sarah Bergbreiter , Thomas L. Daniel , Kristi A. Morgansen

The motivation of this work is to improve the performance of standard stacking approaches or ensembles, which are composed of simple, heterogeneous base models, through the integration of the generation and selection stages for regression…

Machine Learning · Statistics 2014-03-31 Roberto Aldave , Jean-Pierre Dussault

A recent literature considers causal inference using noisy proxies for unobserved confounding factors. The proxies are divided into two sets that are independent conditional on the confounders. One set of proxies are `negative control…

Econometrics · Economics 2021-10-11 Ben Deaner

Stacking is a general approach for combining multiple models toward greater predictive accuracy. It has found various application across different domains, ensuing from its meta-learning nature. Our understanding, nevertheless, on how and…

Machine Learning · Computer Science 2019-01-29 Nino Arsov , Martin Pavlovski , Ljupco Kocarev

Data assimilation combines forecasts from a numerical model with observations. Most of the current data assimilation algorithms consider the model and observation error terms as additive Gaussian noise, specified by their covariance…

Multireference alignment (MRA) problem is to estimate an underlying signal from a large number of noisy circularly-shifted observations. The existing methods are always proposed under the hypothesis of a single Gaussian noise. However, the…

Optimization and Control · Mathematics 2021-07-23 Cuicui Zhao , Jun Liu , Xinqi Gong

Detecting anomalies in large sets of observations is crucial in various applications, such as epidemiological studies, gene expression studies, and systems monitoring. We consider settings where the units of interest result in multiple…

Methodology · Statistics 2025-12-22 Ivo V. Stoepker , Rui M. Castro , Ery Arias-Castro

In practice, data often contain discrete variables. But most of the popular nonparametric estimation methods have been developed in a purely continuous framework. A common trick among practitioners is to make discrete variables continuous…

Methodology · Statistics 2018-01-08 Thomas Nagler

Multi-view data provides complementary information on the same set of observations, with multi-omics and multimodal sensor data being common examples. Analyzing such data typically requires distinguishing between shared (joint) and unique…

Machine Learning · Statistics 2025-08-14 Renat Sergazinov , Armeen Taeb , Irina Gaynanova

Aggregation of noisy observations involves a difficult tradeoff between observation quality, which can be increased by increasing the number of observations, and aggregation quality which decreases if the number of observations is too…

Information Theory · Computer Science 2015-05-13 Tatsuto Murayama , Peter Davis

Statistical inference for a linear stochastic hyperbolic equation with two unknown parameters is studied. Based on observation of coordinates of the solution or their linear combination, minimum contrast estimators are introduced. Strong…

Probability · Mathematics 2018-06-21 Josef Janák

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

Machine Learning · Statistics 2012-06-22 Tingni Sun , Cun-Hui Zhang

This paper proposes feasible asymptotically efficient estimators for a certain class of Gaussian noises with self-similar and stationary properties, which includes the fractional Gaussian noise, under high frequency observations. In this…

Statistics Theory · Mathematics 2016-11-23 Masaaki Fukasawa , Tetsuya Takabatake