English
Related papers

Related papers: Structured Estimators: A New Perspective on Inform…

200 papers

We propose a new simulation-based estimation method, adversarial estimation, for structural models. The estimator is formulated as the solution to a minimax problem between a generator (which generates simulated observations using the…

Econometrics · Economics 2024-01-09 Tetsuya Kaji , Elena Manresa , Guillaume Pouliot

Full likelihood has been widely used in loss tomography because most believe it can produce accurate estimates although the full likelihood estimators proposed so far are complex in structure and expensive in execution. We in this paper…

Methodology · Statistics 2013-08-14 Weiping Zhu

We demonstrate that a popular class of nonparametric mutual information (MI) estimators based on k-nearest-neighbor graphs requires number of samples that scales exponentially with the true MI. Consequently, accurate estimation of MI…

Information Theory · Computer Science 2015-03-09 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

Variable selection for models including interactions between explanatory variables often needs to obey certain hierarchical constraints. The weak or strong structural hierarchy requires that the existence of an interaction term implies at…

Statistics Theory · Mathematics 2016-11-10 Yiyuan She , Zhifeng Wang , He Jiang

Composite likelihoods are a class of alternatives to the full likelihood which are widely used in many situations in which the likelihood itself is intractable. A composite likelihood may be computed without the need to specify the full…

Statistics Theory · Mathematics 2014-01-08 Helen Ogden

This paper introduces a new class of robust estimates for ARMA models. They are M-estimates, but the residuals are computed so the effect of one outlier is limited to the period where it occurs. These estimates are closely related to those…

Statistics Theory · Mathematics 2009-04-02 Nora Muler , Daniel Peña , Víctor J. Yohai

In many modern settings, data are acquired iteratively over time, rather than all at once. Such settings are known as online, as opposed to offline or batch. We introduce a simple technique for online parameter estimation, which can operate…

Computation · Statistics 2017-03-22 Hien D Nguyen

Estimating location is a central problem in functional data analysis, yet most current estimation procedures either unrealistically assume completely observed trajectories or lack robustness with respect to the many kinds of anomalies one…

Methodology · Statistics 2022-03-24 Ioannis Kalogridis , Stefan Van Aelst

Estimation is a critical component of synchronization in wireless and signal processing systems. There is a rich body of work on estimator derivation, optimization, and statistical characterization from analytic system models which are used…

Machine Learning · Computer Science 2017-07-21 Timothy J. O'Shea , Kiran Karra , T. Charles Clancy

The maximum a-posteriori (MAP) perturbation framework has emerged as a useful approach for inference and learning in high dimensional complex models. By maximizing a randomly perturbed potential function, MAP perturbations generate unbiased…

Machine Learning · Computer Science 2013-10-17 Francesco Orabona , Tamir Hazan , Anand D. Sarwate , Tommi Jaakkola

In the field of structural reliability, the Monte-Carlo estimator is considered as the reference probability estimator. However, it is still untractable for real engineering cases since it requires a high number of runs of the model. In…

Methodology · Statistics 2015-03-19 V. Dubourg , F. Deheeger , B. Sudret

We present \textit{universal} estimators for the statistical mean, variance, and scale (in particular, the interquartile range) under pure differential privacy. These estimators are universal in the sense that they work on an arbitrary,…

Cryptography and Security · Computer Science 2023-04-04 Wei Dong , Ke Yi

We study the existence, strong consistency and asymptotic normality of estimators obtained from estimating functions, that are p-dimensional martingale transforms. The problem is motivated by the analysis of evolutionary clustered data,…

Statistics Theory · Mathematics 2020-12-01 Laura Dumitrescu , Ioana Schiopu-Kratina

Good robust estimators can be tuned to combine a high breakdown point and a specified asymptotic efficiency at a central model. This happens in regression with MM- and tau-estimators among others. However, the finite-sample efficiency of…

Statistics Theory · Mathematics 2013-11-21 Ricardo Maronna , Víctor Yohai

In this paper, we propose and investigate closed-form point estimators for a weighted exponential family. We also develop a bias-reduced version of these proposed closed-form estimators through bootstrap methods. Estimators are assessed…

Methodology · Statistics 2024-05-28 Roberto Vila , Eduardo Nakano , Helton Saulo

The paper considers model selection in regression under the additional structural constraints on admissible models where the number of potential predictors might be even larger than the available sample size. We develop a Bayesian formalism…

Statistics Theory · Mathematics 2013-02-19 Felix Abramovich , Vadim Grinshtein

The restricted polynomially-tilted pairwise interaction (RPPI) distribution gives a flexible model for compositional data. It is particularly well-suited to situations where some of the marginal distributions of the components of a…

Methodology · Statistics 2023-05-15 Janice L. Scealy , Kassel L. Hingee , John T. Kent , Andrew T. A. Wood

Respondent-driven sampling is a widely-used network sampling technique, designed to sample from hard-to-reach populations. Estimation from the resulting samples is an area of active research, with software available to compute at least four…

Applications · Statistics 2010-12-21 Amber Tomas , Krista J. Gile

Score function estimation is the cornerstone of both training and sampling from diffusion generative models. Despite this fact, the most commonly used estimators are either biased neural network approximations or high variance Monte Carlo…

In large-scale classification problems, the data set always be faced with frequent updates when a part of the data is added to or removed from the original data set. In this case, conventional incremental learning, which updates an existing…

Machine Learning · Computer Science 2021-01-15 Kaichen Zhou , Shiji Song , Gao Huang , Wu Cheng , Quan Zhou