English
Related papers

Related papers: Efficient moment calculations for variance compone…

200 papers

Shrinkage estimators that possess the ability to produce sparse solutions have become increasingly important to the analysis of today's complex datasets. Examples include the LASSO, the Elastic-Net and their adaptive counterparts.…

Methodology · Statistics 2017-02-09 Hongmei Liu , J. Sunil Rao

Modeling univariate block maxima by the generalized extreme value distribution constitutes one of the most widely applied approaches in extreme value statistics. It has recently been found that, for an underlying stationary time series,…

Statistics Theory · Mathematics 2021-11-01 Axel Bücher , Leandra Zanger

Markov chain Monte Carlo methods are often deemed too computationally intensive to be of any practical use for big data applications, and in particular for inference on datasets containing a large number $n$ of individual data points, also…

Methodology · Statistics 2015-05-13 Rémi Bardenet , Arnaud Doucet , Chris Holmes

Linear mixed models (LMMs), which incorporate fixed and random effects, are key tools for analyzing heterogeneous data, such as in personalized medicine. Nowadays, this type of data is increasingly wide, sometimes containing thousands of…

Machine Learning · Statistics 2026-05-15 Ryan Thompson , Matt P. Wand , Joanna J. J. Wang

We propose a Monte Carlo algorithm to sample from high dimensional probability distributions that combines Markov chain Monte Carlo and importance sampling. We provide a careful theoretical analysis, including guarantees on robustness to…

Computation · Statistics 2019-09-18 Giacomo Zanella , Gareth Roberts

Monte Carlo algorithms, such as Markov chain Monte Carlo (MCMC) and Hamiltonian Monte Carlo (HMC), are routinely used for Bayesian inference in generalized linear models; however, these algorithms are prohibitively slow in massive data…

Computation · Statistics 2020-08-31 Nariankadu D. Shyamalkumar , Sanvesh Srivastava

Hierarchical models allow for heterogeneous behaviours in a population while simultaneously borrowing estimation strength across all subpopulations. Unfortunately, existing likelihood-based methods for fitting hierarchical models have high…

Methodology · Statistics 2015-12-16 Patrick O. Perry

Process monitoring and control requires detection of structural changes in a data stream in real time. This article introduces an efficient sequential Monte Carlo algorithm designed for learning unknown changepoints in continuous time. The…

Applications · Statistics 2015-09-29 Melissa J. M. Turcotte , Nicholas A. Heard

We consider the problem of estimating the number of distinct elements in a large data set (or, equivalently, the support size of the distribution induced by the data set) from a random sample of its elements. The problem occurs in many…

Machine Learning · Computer Science 2021-06-17 Talya Eden , Piotr Indyk , Shyam Narayanan , Ronitt Rubinfeld , Sandeep Silwal , Tal Wagner

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

Estimation of crossed random effects models commonly requires computational costs that grow faster than linearly in the sample size $N$, often as fast as $\Omega(N^{3/2})$, making them unsuitable for large data sets. For non-Gaussian…

Methodology · Statistics 2025-05-01 Ruggero Bellio , Swarnadip Ghosh , Art B. Owen , Cristiano Varin

In this article, we consider computing expectations w.r.t. probability measures which are subject to discretization error. Examples include partially observed diffusion processes or inverse problems, where one may have to discretize time…

Computation · Statistics 2021-02-25 Jeremy Heng , Ajay Jasra , Kody J. H. Law , Alexander Tarakanov

Variational quantum algorithms are poised to have significant impact on high-dimensional optimization, with applications in classical combinatorics, quantum chemistry, and condensed matter. Nevertheless, the optimization landscape of these…

Quantum Physics · Physics 2022-02-02 Taylor L. Patti , Omar Shehab , Khadijeh Najafi , Susanne F. Yelin

Comparison data arises in many important contexts, e.g. shopping, web clicks, or sports competitions. Typically we are given a dataset of comparisons and wish to train a model to make predictions about the outcome of unseen comparisons. In…

Machine Learning · Statistics 2018-07-25 Stephen Ragain , Alexander Peysakhovich , Johan Ugander

Inferring parameter distributions of complex industrial systems from noisy time series data requires methods to deal with the uncertainty of the underlying data and the used simulation model. Bayesian inference is well suited for these…

Applications · Statistics 2021-06-18 David N. John , Livia Stohrer , Claudia Schillings , Michael Schick , Vincent Heuveline

When constructing parametric models to predict the cost of future claims, several important details have to be taken into account: (i) models should be designed to accommodate deductibles, policy limits, and coinsurance factors, (ii)…

Methodology · Statistics 2024-02-22 Chudamani Poudyal , Qian Zhao , Vytaras Brazauskas

Generalized method of moments estimators based on higher-order moment conditions derived from independent shocks can be used to identify and estimate the simultaneous interaction in structural vector autoregressions. This study highlights…

Econometrics · Economics 2023-10-13 Sascha A. Keweloh

The methods of statistical physics are widely used for modelling complex networks. Building on the recently proposed Equilibrium Expectation approach, we derive a simple and efficient algorithm for maximum likelihood estimation (MLE) of…

Computation · Statistics 2020-02-12 Alexander Borisenko , Maksym Byshkin , Alessandro Lomi

Full likelihood-based inference for high-dimensional multivariate extreme value distributions, or max-stable processes, is feasible when incorporating occurrence times of the maxima; without this information, $d$-dimensional likelihood…

Methodology · Statistics 2015-04-01 J. L. Wadsworth

We seek to extract a small number of representative scenarios from large panel data that are consistent with sample moments. Among two novel algorithms, the first identifies scenarios that have not been observed before, and comes with a…

Machine Learning · Statistics 2024-11-06 Michael Multerer , Paul Schneider , Rohan Sen