English
Related papers

Related papers: Statistical inference in massive datasets by empir…

200 papers

This paper develops a general methodology to conduct statistical inference for observations indexed by multiple sets of entities. We propose a novel multiway empirical likelihood statistic that converges to a chi-square distribution under…

Methodology · Statistics 2024-08-12 Harold D Chiang , Yukitoshi Matsushita , Taisuke Otsu

Consider $M$-estimation in a semiparametric model that is characterized by a Euclidean parameter of interest and an infinite-dimensional nuisance parameter. As a general purpose approach to statistical inferences, the bootstrap has found…

Statistics Theory · Mathematics 2011-02-04 Guang Cheng , Jianhua Z. Huang

Multiple data sources are becoming increasingly available for statistical analyses in the era of big data. As an important example in finite-population inference, we consider an imputation approach to combining a probability sample with big…

Methodology · Statistics 2018-07-10 Shu Yang , Jae Kwang Kim

Many statistical problems involve data from thousands of parallel cases. Each case has some associated effect size, and most cases will have no effect. It is often important to estimate the effect size and the local or tail-area false…

Applications · Statistics 2010-10-08 Omkar Muralidharan

We propose a method to overcome the usual limitation of current data processing techniques in optical and infrared long-baseline interferometry: most reduction pipelines assume uncorrelated statistical errors and ignore systematics. We use…

Instrumentation and Methods for Astrophysics · Physics 2019-01-23 Régis Lachaume , Markus Rabus , Andrés Jordán , Rafael Brahm , Tabetha Boyajian , Kaspar von Braun , Jean-Philippe Berger

The rapid proliferation of high-quality synthetic data -- generated by advanced AI models or collected as auxiliary data from related tasks -- presents both opportunities and challenges for statistical inference. This paper introduces a…

Methodology · Statistics 2026-02-19 Meshi Bashari , Yonghoon Lee , Roy Maor Lotan , Edgar Dobriban , Yaniv Romano

Nonprobability (convenience) samples are increasingly sought to reduce the estimation variance for one or more population variables of interest that are estimated using a randomized survey (reference) sample by increasing the effective…

Likelihood-free methods are useful for parameter estimation of complex models with intractable likelihood functions for which it is easy to simulate data. Such models are prevalent in many disciplines including genetics, biology, ecology…

Methodology · Statistics 2022-03-29 Christopher Drovandi , David T Frazier

Identifying leading measurement units from a large collection is a common inference task in various domains of large-scale inference. Testing approaches, which measure evidence against a null hypothesis rather than effect magnitude, tend to…

Methodology · Statistics 2020-11-17 Nicholas C. Henderson , Michael A. Newton

Bootstrap is commonly used as a tool for non-parametric statistical inference to estimate meaningful parameters in Variable Selection Models. However, for massive dataset that has exponential growth rate, the computation of Bootstrap…

Computation · Statistics 2016-12-26 Zhibing He , Yichen Qin , Ben-Chang Shia , Yang Li

In this paper we introduce the concept of bootstrapped pivots for the sample and the population means. This is in contrast to the classical method of constructing bootstrapped confidence intervals for the population mean via estimating the…

Statistics Theory · Mathematics 2013-07-23 Miklos Csorgo , Masoud M Nasari

There is a growing interest in the so-called Bayesian Predictive Inference approach, which allows to perform Bayesian inference without specifying the likelihood and prior of the model, or the need of any MCMC. Instead, only a sequence of…

Statistics Theory · Mathematics 2025-09-30 Marco Battiston , Lorenzo Cappello

Traditional statistical inference considers relatively small data sets and the corresponding theoretical analysis focuses on the asymptotic behavior of a statistical estimator when the number of samples approaches infinity. However, many…

Methodology · Statistics 2013-01-03 Jon Wellner , Tong Zhang

Current statistics literature on statistical inference of random fields typically assumes that the fields are stationary or focuses on models of non-stationary Gaussian fields with parametric/semiparametric covariance families, which may…

Statistics Theory · Mathematics 2024-09-04 Yunyi Zhang , Zhou Zhou

Approximate Bayesian computation (ABC) and synthetic likelihood (SL) techniques have enabled the use of Bayesian inference for models that may be simulated, but for which the likelihood cannot be evaluated pointwise at values of an unknown…

Computation · Statistics 2018-01-19 Richard G. Everitt

We present a new fitting technique based on the parametric bootstrap method, which relies on the idea to produce artificial measurements using the estimated probability distribution of the experimental data. In order to investigate the main…

Data Analysis, Statistics and Probability · Physics 2020-03-18 Paolo Pedroni , Stefano Sconfietti

Computational capability often falls short when confronted with massive data, posing a common challenge in establishing a statistical model or statistical inference method dealing with big data. While subsampling techniques have been…

Methodology · Statistics 2024-10-31 Yixiao Ruan , Zan Li , Zhaohui Li , Dennis K. J. Lin , Qingpei Hu , Dan Yu

Subsampling techniques can reduce the computational costs of processing big data. Practical subsampling plans typically involve initial uniform sampling and refined sampling. With a subsample, big data inferences are generally built on the…

Methodology · Statistics 2022-09-13 Yan Fan , Yang Liu , Yukun Liu , Jing Qin

We propose a residual and wild bootstrap methodology for individual and simultaneous inference in high-dimensional linear models with possibly non-Gaussian and heteroscedastic errors. We establish asymptotic consistency for simultaneous…

Methodology · Statistics 2016-06-14 Ruben Dezeure , Peter Bühlmann , Cun-Hui Zhang

This paper introduces a local optimization-based approach to test statistical hypotheses and to construct confidence intervals. This approach can be viewed as an extension of bootstrap, and yields asymptotically valid tests and confidence…

Methodology · Statistics 2015-04-21 Shifeng Xiong
‹ Prev 1 4 5 6 7 8 10 Next ›