English
Related papers

Related papers: An MCMC Approach to Classical Estimation

200 papers

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

In this paper non-asymptotic exact exponential estimates are derived (under minimal conditions) for the tail of deviation of the MLE distribution in the so-called natural terms: natural function, natural distance, metric entropy, Banach…

Probability · Mathematics 2009-03-25 E. Ostrovsky , E. Rogover

A simple yet efficient method of linear regression estimation (LRE) is presented for quantum state tomography. In this method, quantum state reconstruction is converted into a parameter estimation problem of a linear regression model and…

Quantum Physics · Physics 2013-12-18 Bo Qi , Zhibo Hou , Li Li , Daoyi Dong , Guoyong Xiang , Guangcan Guo

In this note we obtain semiclassical resolvent estimates for non-trapping long range perturbations of the Laplacian on asymptotically Euclidean manifolds. Our proof is based on a positive commutator argument which differs from Mourre-type…

Analysis of PDEs · Mathematics 2009-10-31 Andras Vasy , Maciej Zworski

A generalized method of moments (GMM) estimator is unreliable for a large number of moment conditions, that is, it is comparable, or larger than the sample size. While classical GMM literature proposes several provisions to this problem,…

Computation · Statistics 2021-03-11 Masahiro Tanaka

Symbolic regression with polynomial neural networks and polynomial neural ordinary differential equations (ODEs) are two recent and powerful approaches for equation recovery of many science and engineering problems. However, these methods…

Machine Learning · Computer Science 2023-08-28 Colby Fronk , Jaewoong Yun , Prashant Singh , Linda Petzold

We propose the approximate Laplace approximation (ALA) to evaluate integrated likelihoods, a bottleneck in Bayesian model selection. The Laplace approximation (LA) is a popular tool that speeds up such computation and equips strong model…

Computation · Statistics 2021-10-07 David Rossell , Oriol Abril , Anirban Bhattacharya

This article investigates the weak approximation towards the invariant measure of semi-linear stochastic differential equations (SDEs) under non-globally Lipschitz coefficients. For this purpose, we propose a linear-theta-projected Euler…

Numerical Analysis · Mathematics 2024-03-28 Chenxu Pang , Xiaojie Wang , Yue Wu

We provide a semi-parametric analysis for the proportional likelihood ratio model, proposed by Luo & Tsai (2012). We study the tangent spaces for both the parameter of interest and the nuisance parameter, and obtain an explicit expression…

Statistics Theory · Mathematics 2019-07-15 Yair Goldberg , Malka Gorfine

Partial differential equation is a powerful tool to characterize various physics systems. In practice, measurement errors are often present and probability models are employed to account for such uncertainties. In this paper, we present a…

Probability · Mathematics 2016-05-23 Xiaoou Li , Jingchen Liu

In this paper, the maximum L$q$-likelihood estimator (ML$q$E), a new parameter estimator based on nonextensive entropy [Kibernetika 3 (1967) 30--35] is introduced. The properties of the ML$q$E are studied via asymptotic analysis and…

Statistics Theory · Mathematics 2010-02-25 Davide Ferrari , Yuhong Yang

We propose a numerical method to spline-interpolate discrete signals and then apply the integral transforms to the corresponding analytical spline functions. This represents a robust and computationally efficient technique for estimating…

Numerical Analysis · Mathematics 2023-04-27 Yupeng Zhang , Yueyang Shen , Rongqian Zhang , Yuyao Liu , Yunjie Guo , Daxuan Deng , Ivo D. Dinov

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

Statistics Theory · Mathematics 2025-06-03 Yannick Baraud , Guillaume Maillard

We propose a new family of error distributions for model-based quantile regression, which is constructed through a structured mixture of normal distributions. The construction enables fixing specific percentiles of the distribution while,…

Methodology · Statistics 2017-02-10 Yifei Yan , Athanasios Kottas

Gaussian processes (GPs) are popular as nonlinear regression models for expensive computer simulations, yet GP performance relies heavily on estimation of unknown covariance parameters. Maximum likelihood estimation (MLE) is common, but it…

Methodology · Statistics 2025-11-25 Ayumi Mutoh , Annie S. Booth , Jonathan W. Stallrich

In high-dimensional data analysis, penalized likelihood estimators are shown to provide superior results in both variable selection and parameter estimation. A new algorithm, APPLE, is proposed for calculating the Approximate Path for…

Machine Learning · Statistics 2013-05-07 Yi Yu , Yang Feng

The extreme value index is a fundamental parameter in univariate Extreme Value Theory (EVT). It captures the tail behavior of a distribution and is central in the extrapolation beyond observed data. Among other semi-parametric methods (such…

Statistics Theory · Mathematics 2017-05-02 Clément Dombry , Ana Ferreira

Langevin Monte Carlo (LMC) and its stochastic gradient versions are powerful algorithms for sampling from complex high-dimensional distributions. To sample from a distribution with density $\pi(\theta)\propto \exp(-U(\theta)) $, LMC…

Computation · Statistics 2023-09-25 Sifan Liu

Many models require integrals of high-dimensional functions: for instance, to obtain marginal likelihoods. Such integrals may be intractable, or too expensive to compute numerically. Instead, we can use the Laplace approximation (LA). The…

Methodology · Statistics 2024-11-05 Shaun McDonald , David Campbell

We consider the problem of approximate Bayesian parameter inference in non-linear state-space models with intractable likelihoods. Sequential Monte Carlo with approximate Bayesian computations (SMC-ABC) is one approach to approximate the…

Computation · Statistics 2017-06-14 Johan Dahlin , Mattias Villani , Thomas B. Schön