English
Related papers

Related papers: A Moment-assisted Approach for Improving Subsampli…

200 papers

We consider estimating the transition probability matrix of a finite-state finite-observation alphabet hidden Markov model with known observation probabilities. The main contribution is a two-step algorithm; a method of moments estimator…

Systems and Control · Computer Science 2017-11-22 Robert Mattila , Cristian R. Rojas , Vikram Krishnamurthy , Bo Wahlberg

Digital monitoring studies collect real-time high frequency data via mobile sensors in the subjects' natural environment. This data can be used to model the impact of changes in physiology on recurrent event outcomes such as smoking, drug…

Methodology · Statistics 2022-04-15 Walter Dempsey

For classification problems with significant class imbalance, subsampling can reduce computational costs at the price of inflated variance in estimating model parameters. We propose a method for subsampling efficiently for logistic…

Computation · Statistics 2014-09-24 William Fithian , Trevor Hastie

The estimation of normalizing constants is a fundamental step in probabilistic model comparison. Sequential Monte Carlo methods may be used for this task and have the advantage of being inherently parallelizable. However, the standard…

Machine Learning · Statistics 2016-08-16 Marco Fraccaro , Ulrich Paquet , Ole Winther

Subsampling methods aim to select a subsample as a surrogate for the observed sample. Such methods have been used pervasively in large-scale data analytics, active learning, and privacy-preserving analysis in recent decades. Instead of…

Machine Learning · Statistics 2022-06-03 Jingyi Zhang , Cheng Meng , Jun Yu , Mengrui Zhang , Wenxuan Zhong , Ping Ma

We explore efficient estimation of statistical quantities, particularly rare event probabilities, for stochastic reaction networks. Consequently, we propose an importance sampling (IS) approach to improve the Monte Carlo (MC) estimator…

Numerical Analysis · Mathematics 2024-03-12 Chiheb Ben Hammouda , Nadhir Ben Rached , Raúl Tempone , Sophia Wiechert

We introduce two types of estimators of the finite-dimensional parameters in the case of observations of inhomogeneous Poisson processes. These are the estimators of the method of moments and multi-step MLE. It is shown that the estimators…

Statistics Theory · Mathematics 2018-06-19 Ali S. Dabye , Alix A. Gounoung , Yury A. Kutoyants

Data rebalancing techniques, including oversampling and undersampling, are a common approach to addressing the challenges of imbalanced data. To tackle unresolved problems related to both oversampling and undersampling, we propose a new…

Machine Learning · Computer Science 2025-07-11 Karen Medlin , Sven Leyffer , Krishnan Raghavan

Estimating the probability that a sum of random variables (RVs) exceeds a given threshold is a well-known challenging problem. Closed-form expression of the sum distribution is usually intractable and presents an open problem. A crude Monte…

Information Theory · Computer Science 2014-09-23 Nadhir Ben Rached , Fatma Benkhelifa , Abla Kammoun , Mohamed-Slim Alouini , Raul Tempone

Model averaging (MA) and ensembling play a crucial role in statistical and machine learning practice. When multiple candidate models are considered, MA techniques can be used to weight and combine them, often resulting in improved…

Statistics Theory · Mathematics 2025-05-06 Jingfu Peng

When dealing with datasets containing a billion instances or with simulations that require a supercomputer to execute, computational resources become part of the equation. We can improve the efficiency of learning and inference by…

Machine Learning · Computer Science 2014-03-06 Max Welling

Moment restrictions and their conditional counterparts emerge in many areas of machine learning and statistics ranging from causal inference to reinforcement learning. Estimators for these tasks, generally called methods of moments, include…

Machine Learning · Computer Science 2023-06-14 Heiner Kremer , Yassine Nemmour , Bernhard Schölkopf , Jia-Jie Zhu

We develop a generalized method of moments (GMM) approach for fast parameter estimation in a new class of Dirichlet latent variable models with mixed data types. Parameter estimation via GMM has been demonstrated to have computational and…

Statistics Theory · Mathematics 2016-03-24 Shiwen Zhao , Barbara E. Engelhardt , Sayan Mukherjee , David B. Dunson

Multi-contrast Magnetic Resonance Imaging (MRI) acquisitions from a single scan have tremendous potential to streamline exams and reduce imaging time. However, maintaining clinically feasible scan time necessitates significant…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Ke Wang , Enhao Gong , Yuxin Zhang , Suchadrima Banerjee , Greg Zaharchuk , John Pauly

Estimating rare events in complex systems is a key challenge in reliability analysis. The challenge grows in multimodal problems, where traditional methods often rely on a small set of design points and risk overlooking critical failure…

Computation · Statistics 2025-08-04 Sara Helal , Victor Elvira

As a powerful tool for longitudinal data analysis, the generalized estimating equations have been widely studied in the academic community. However, in large-scale settings, this approach faces pronounced computational and storage…

Computation · Statistics 2025-08-29 Chunjing Li , Jiahui Zhang , Xiaohui Yuan

Multi-arm multi-stage (MAMS) trials have gained popularity, due to their improved efficiency in evaluating multiple treatments. A traditional MAMS trial often decreases the expected sample size of the trial compared to just running a…

The computation of the maximum likelihood (ML) estimator for heteroscedastic regression models is considered. The traditional Newton algorithms for the problem require matrix multiplications and inversions, which are bottlenecks in modern…

Computation · Statistics 2016-08-24 Hien D. Nguyen , Luke R. Lloyd-Jones , Geoffrey J. McLachlan

We investigate optimal subsampling for quantile regression. We derive the asymptotic distribution of a general subsampling estimator and then derive two versions of optimal subsampling probabilities. One version minimizes the trace of the…

Computation · Statistics 2020-01-29 HaiYing Wang , Yanyuan Ma

In this article, we consider an imputation method to handle missing response values based on semiparametric quantile regression estimation. In the proposed method, the missing response values are generated using the estimated conditional…

Statistics Theory · Mathematics 2014-04-15 Senniang Chen , Cindy L Yu