English
Related papers

Related papers: Bounds smaller than the Fisher information for gen…

200 papers

The least squares method allows fitting parameters of a mathematical model from experimental data. This article proposes a general approach of this method. After introducing the method and giving a formal definition, the transitivity of the…

Optimization and Control · Mathematics 2015-02-27 Benjamin Lenoir

Changes in parameters of a physical device can eventually lead to catastrophic failure. This paper discusses a parameter estimation method based on synchronization between a model and time series data. In particular, we examine the…

chao-dyn · Physics 2007-05-23 Justin Goodwin , Reggie Brown , Lutz Junge

The missing data issue often complicates the task of estimating generalized linear models (GLMs). We describe why the pseudo-marginal Metropolis-Hastings algorithm, used in this setting, is an effective strategy for parameter estimation.…

Methodology · Statistics 2019-07-23 Taylor R. Brown , Timothy L. McMurry , Alexander Langevin

In this paper we study the problem of statistical inference on the parameters of the semiparametric variance-mean mixtures. This class of mixtures has recently become rather popular in statistical and financial modelling. We design a…

Other Statistics · Statistics 2017-05-23 Denis Belomestny , Vladimir Panov

Regularization is a set of techniques that are used to improve the generalization ability of deep neural networks. In this paper, we introduce weight compander (WC), a novel effective method to improve generalization by reparameterizing…

Machine Learning · Computer Science 2023-06-30 Rinor Cakaj , Jens Mehnert , Bin Yang

An effective two-stage method for an estimation of parameters of the linear regression is considered. For this purpose we introduce a certain quasi-estimator that, in contrast to usual estimator, produces two alternative estimates. It is…

Statistics Theory · Mathematics 2010-10-06 Anatoly Gordinsky

Noise affects the performance of quantum technologies, hence the importance of elaborating operative figures of merit that can capture its impact in exact terms. In quantum metrology, the introduction of the Fisher information measurement…

Quantum Physics · Physics 2024-09-30 Francesco Albarelli , Ilaria Gianani , Marco G. Genoni , Marco Barbieri

In this paper, we develop a generalized Bayesian inference framework for a collection of signal-plus-noise matrix models arising in high-dimensional statistics and many applications. The framework is built upon an asymptotically unbiased…

Statistics Theory · Mathematics 2022-04-01 Fangzheng Xie , Dingbo Wu

Recent studies found that many channels are affected by additive noise that is impulsive in nature and is best explained by heavy-tailed symmetric alpha-stable distributions. Dealing with impulsive noise environments comes with an added…

Information Theory · Computer Science 2016-10-07 Jihad Fahs , Ibrahim Abou-Faycal

Boosting methods are widely used in statistical learning to deal with high-dimensional data due to their variable selection feature. However, those methods lack straightforward ways to construct estimators for the precision of the…

Methodology · Statistics 2021-06-10 Boyao Zhang , Colin Griesbach , Cora Kim , Nadia Müller-Voggel , Elisabeth Bergherr

Generalization theory has been established for sparse deep neural networks under high-dimensional regime. Beyond generalization, parameter estimation is also important since it is crucial for variable selection and interpretability of deep…

Machine Learning · Statistics 2024-06-27 Dongya Wu , Xin Li

The Fisher Information Matrix formalism is extended to cases where the data is divided into two parts (X,Y), where the expectation value of Y depends on X according to some theoretical model, and X and Y both have errors with arbitrary…

Cosmology and Nongalactic Astrophysics · Physics 2015-02-20 A. F. Heavens , M. Seikel , B. D. Nord , M. Aich , Y. Bouffanais , B. A. Bassett , M. P. Hobson

This paper describes the most accurate analytical frequentist assessment to date of the uncertainties in the estimation of physical parameters from gravitational waves generated by non spinning binary systems and Earth-based networks of…

General Relativity and Quantum Cosmology · Physics 2013-05-29 Salvatore Vitale , Michele Zanolin

Neural networks are becoming an increasingly important tool in applications. However, neural networks are not widely used in statistical genetics. In this paper, we propose a new neural networks method called expectile neural networks. When…

Statistics Theory · Mathematics 2020-11-04 Jinghang Lin , Xiaoxi Shen , Qing Lu

We investigate a semiparametric regression model where one gets noisy non linear non invertible functions of the observations. We focus on the application to bearings-only tracking. We first investigate the least squares estimator and prove…

Statistics Theory · Mathematics 2008-12-17 Elisabeth Gassiat , Benoit Landelle

In practice, there often exist unobserved variables, also termed hidden variables, associated with both the response and covariates. Existing works in the literature mostly focus on linear regression with hidden variables. However, when the…

Methodology · Statistics 2025-09-03 Inbeom Lee , Yang Ning

We propose a modified, high-dimensional version of a recent dimension estimation procedure that determines the dimension via the introduction of augmented noise variables into the data. Our asymptotic results show that the proposal is…

Statistics Theory · Mathematics 2025-02-07 Una Radojicic , Joni Virta

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

In scientific applications, multivariate observations often come in tandem with temporal or spatial covariates, with which the underlying signals vary smoothly. The standard approaches such as principal component analysis and factor…

Statistics Theory · Mathematics 2019-10-15 Mark Koudstaal , Dengdeng Yu , Dehan Kong , Fang Yao

Repeated use of a data sample via adaptively chosen queries can rapidly lead to overfitting, wherein the empirical evaluation of queries on the sample significantly deviates from their mean with respect to the underlying data distribution.…

Machine Learning · Computer Science 2024-04-26 Moshe Shenfeld , Katrina Ligett