English
Related papers

Related papers: Backfitting for large scale crossed random effects…

200 papers

We propose an adaptive importance sampling scheme for Gaussian approximations of intractable posteriors. Optimization-based approximations like variational inference can be too inaccurate while existing Monte Carlo methods can be too slow.…

Computation · Statistics 2025-02-04 Willem van den Boom , Andrea Cremaschi , Alexandre H. Thiery

This paper considers the task of linear regression with shuffled labels, i.e., $\mathbf Y = \mathbf \Pi \mathbf X \mathbf B + \mathbf W$, where $\mathbf Y \in \mathbb R^{n\times m}, \mathbf Pi \in \mathbb R^{n\times n}, \mathbf X\in \mathbb…

Machine Learning · Statistics 2023-10-03 Hang Zhang , Ping Li

An ensemble method is introduced that utilizes randomization and loss function gradients to compute a prediction. Multiple weakly-correlated estimators approximate the gradient at randomly sampled points on the error surface and are…

Machine Learning · Computer Science 2020-09-15 Nicholas Smith

As the amount and complexity of available data increases, the need for robust statistical learning becomes more pressing. To enhance resilience against model misspecification, the generalized posterior inference method adjusts the…

Computation · Statistics 2024-09-04 Masahiro Tanaka

It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated…

Machine Learning · Statistics 2018-06-08 Michael Hornstein , Roger Fan , Kerby Shedden , Shuheng Zhou

We introduce the chi-square test neural network: a single hidden layer backpropagation neural network using chi-square test theorem to redefine the cost function and the error function. The weights and thresholds are modified using standard…

Machine Learning · Computer Science 2018-09-05 Yuan Wu , Lingling Li , Lian Li

Recently, many machine learning and statistical models such as non-linear regressions, the Single Index, Multi-index, Varying Coefficient Index Models and Two-layer Neural Networks can be reduced to or be seen as a special case of a new…

Machine Learning · Computer Science 2020-10-20 Di Wang , Xiangyu Guo , Chaowen Guan , Shi Li , Jinhui Xu

The additive model is one of the most popular semiparametric models. The backfitting estimation (Buja, Hastie and Tibshirani, 1989, \textit{Ann. Statist.}) for the model is intuitively easy to understand and theoretically most efficient…

Statistics Theory · Mathematics 2009-03-23 Yingcun Xia

Fitting generative models to sequential data typically involves two recursive computations through time, one forward and one backward. The latter could be a computation of the loss gradient (as in backpropagation through time), or an…

Machine Learning · Computer Science 2023-10-23 Azwar Abdulsalam , Joseph G. Makin

Overfitting, which happens when the number of parameters in a model is too large compared to the number of data points available for determining these parameters, is a serious and growing problem in survival analysis. While modern medicine…

Applications · Statistics 2017-09-13 ACC Coolen , JE Barrett , P Paga , CJ Perez-Vicente

We study the problem of evaluating the excess risk of large-scale empirical risk minimization under the square loss. Leveraging the idea of wild refitting and resampling, we assume only black-box access to the training algorithm and develop…

Machine Learning · Computer Science 2026-04-03 Haichen Hu , David Simchi-Levi

Generalized Bayesian Inference (GBI) tempers a loss with a temperature $\beta > 0$ to mitigate overconfidence and improve robustness under model misspecification, but existing GBI methods typically rely on costly MCMC or SDE-based samplers…

Machine Learning · Statistics 2026-05-25 Shiyi Sun , Geoff K. Nicholls , Jeong Eun Lee

Nested-error regression models are widely used for analyzing clustered data. For example, they are often applied to two-stage sample surveys, and in biology and econometrics. Prediction is usually the main goal of such analyses, and…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Tapabrata Maiti

In the total least squares problem, one is given an $m \times n$ matrix $A$, and an $m \times d$ matrix $B$, and one seeks to "correct" both $A$ and $B$, obtaining matrices $\hat{A}$ and $\hat{B}$, so that there exists an $X$ satisfying the…

Data Structures and Algorithms · Computer Science 2019-09-30 Huaian Diao , Zhao Song , David P. Woodruff , Xin Yang

We consider a budget-constrained bandit problem where each arm pull incurs a random cost, and yields a random reward in return. The objective is to maximize the total expected reward under a budget constraint on the total cost. The model is…

Machine Learning · Computer Science 2020-03-03 Semih Cayci , Atilla Eryilmaz , R. Srikant

Informative interim adaptations lead to random sample sizes. The random sample size becomes a component of the sufficient statistic and estimation based solely on observed samples or on the likelihood function does not use all available…

Methodology · Statistics 2022-10-25 Sergey Tarima , Nancy Flournoy

In data mining applications, feature selection is an essential process since it reduces a model's complexity. The cost of obtaining the feature values must be taken into consideration in many domains. In this paper, we study the…

Machine Learning · Computer Science 2013-06-04 Hong Zhao , Fan Min , William Zhu

The discovery of the backpropagation algorithm ranks among one of the most important moments in the history of machine learning, and has made possible the training of large-scale neural networks through its ability to compute gradients at…

Quantum Physics · Physics 2025-10-08 Joseph Bowles , David Wierichs , Chae-Yeun Park

We study the fundamental problems of Gaussian mean estimation and linear regression with Gaussian covariates in the presence of Huber contamination. Our main contribution is the design of the first sample near-optimal and almost linear-time…

Data Structures and Algorithms · Computer Science 2023-12-05 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

Ensemble methods that average over a collection of independent predictors that are each limited to a subsampling of both the examples and features of the training data command a significant presence in machine learning, such as the…

Machine Learning · Statistics 2020-03-26 Daniel LeJeune , Hamid Javadi , Richard G. Baraniuk