English
Related papers

Related papers: Bounds for maximum likelihood regular and non-regu…

200 papers

We study the maximum achievable differential entropy at the output of a system assigning to each input X the sum X+N, with N a given noise with probability law absolutely continuous with respect to the Lebesgue measure and where the input…

Optimization and Control · Mathematics 2016-02-04 Francisco J. Piera

Fast Incremental Expectation Maximization (FIEM) is a version of the EM framework for large datasets. In this paper, we first recast FIEM and other incremental EM type algorithms in the {\em Stochastic Approximation within EM} framework.…

Machine Learning · Computer Science 2021-01-01 Gersende Fort , P. Gach , E. Moulines

In this paper, we tackle for the first time the problem of maximum likelihood (ML) estimation of the signal-to-noise ratio (SNR) parameter over time-varying single-input multiple-output (SIMO) channels. Both the data-aided (DA) and the…

Applications · Statistics 2014-11-19 Faouzi Bellili , Rabii Meftehi , Sofiene Affes , Alex Stephenne

Maximum likelihood estimates and corresponding confidence regions of the estimates are commonly used in statistical inference. In practice, people often construct approximate confidence regions with the Fisher information at given sample…

Statistics Theory · Mathematics 2021-07-13 Sihang Jiang

Wide-band Direction of Arrival (DOA) estimation with sensor arrays is an essential task in sonar, radar, acoustics, biomedical and multimedia applications. Many state of the art wide-band DOA estimators coherently process frequency binned…

Applications · Statistics 2018-03-02 Elio D. Di Claudio , Raffaele Parisi , Giovanni Jacovitti

This paper studies the problem of nonparametric estimation of a smooth function with data distributed across multiple machines. We assume an independent sample from a white noise model is collected at each machine, and an estimator of the…

Machine Learning · Statistics 2018-06-26 Yuancheng Zhu , John Lafferty

In this paper, an algorithm of multiple signal classification (MUSIC) is proposed for two-dimensional (2-D) direction of- arrival (DOA) and polarization estimation of non-circular signal in three-dimensional (3-D) millimeter wave polarized…

Signal Processing · Electrical Eng. & Systems 2017-12-18 Liangtian Wan , Kaihui Liu , Ying-Chang Liang , Tong Zhu

This work presents a novel and effective method for fitting multidimensional ellipsoids to scattered data in the contamination of noise and outliers. We approach the problem as a Bayesian parameter estimate process and maximize the…

Methodology · Statistics 2024-07-30 Zhao Mingyang , Jia Xiaohong , Ma Lei , Shi Yuke , Jiang Jingen , Li Qizhai , Yan Dong-Ming , Huang Tiejun

We develop a direction of arrival (DoA) and channel estimation algorithm for the one-bit quantized millimeter-wave (mmWave) massive multiple-input multiple-output (MIMO) system. By formulating the estimation problem as a noisy one-bit…

Signal Processing · Electrical Eng. & Systems 2019-09-24 Liangyuan Xu , Feifei Gao , Cheng Qian

Spike train signals recorded from a large population of neurons often exhibit low-dimensional spatio-temporal structure and modeled as conditional Poisson observations. The low-dimensional signals that capture internal brain states are…

Neurons and Cognition · Quantitative Biology 2024-08-19 Hyungju Jeon , Il Memming Park

The quantum Fisher information matrix (QFIM) is central to multiparameter quantum metrology, dictating the attainable sensitivity via the quantum Cram\'er-Rao bound. In this work, we investigate the ultimate precision limits for…

Locating a target is key in many applications, namely in high-stakes real-world scenarios, like detecting humans or obstacles in vehicular networks. In scenarios where precise statistics of the measurement noise are unavailable,…

Optimization and Control · Mathematics 2022-08-17 João Domingos , Cláudia Soares , João Xavier

We consider the problem of direction-of-arrival (DOA) estimation in unknown partially correlated noise environments where the noise covariance matrix is sparse. A sparse noise covariance matrix is a common model for a sparse array of…

Information Theory · Computer Science 2016-11-15 Mohammadreza Malek-Mohammadi , Magnus Jansson , Arash Owrang , Ali Koochakzadeh , Massoud Babaie-Zadeh

The problem of distributed estimation of a parametric physical field is stated as a maximum likelihood estimation problem. Sensor observations are distorted by additive white Gaussian noise. Prior to data transmission, each sensor quantizes…

Information Theory · Computer Science 2012-09-21 Natalia A. Schmid , Marwan Alkhweldi , Matthew C. Valenti

In this paper, an improved direction-of-arrival (DOA) estimation algorithm for circular and non-circular signals is proposed. Most state-of-the-art algorithms only deal with the DOA estimation problem for the maximal non-circularity rated…

Information Theory · Computer Science 2016-04-07 Liangtian Wan , Lihua Xie

In this letter, we consider the problem of direction-of-arrival (DOA) estimation with one-bit quantized array measurements. With analysis, it is shown that, under mild conditions the one-bit covariance matrix can be approximated by the sum…

Signal Processing · Electrical Eng. & Systems 2019-04-30 Xiaodong Huang , Bin Liao

The Fisher information matrix (FIM) is a fundamental quantity to represent the characteristics of a stochastic model, including deep neural networks (DNNs). The present study reveals novel statistics of FIM that are universal among a wide…

Machine Learning · Statistics 2019-10-10 Ryo Karakida , Shotaro Akaho , Shun-ichi Amari

We introduce a noise-aware extension to the parametric maximum-likelihood framework for component separation by modeling correlated $1/f^\alpha$ noise as a harmonic-space power law. This approach addresses a key limitation of existing…

Cosmology and Nongalactic Astrophysics · Physics 2025-11-07 Goureesankar Sathyanathan , Josquin Errard , Soumen Basak

The problem of estimating multiple loss parameters of an optical system using the most general ancilla-assisted parallel strategy is solved under energy constraints. An upper bound on the quantum Fisher information matrix is derived…

Quantum Physics · Physics 2018-12-12 Ranjith Nair

Distribution shift between the training domain and the test domain poses a key challenge for modern machine learning. An extensively studied instance is the \emph{covariate shift}, where the marginal distribution of covariates differs…

Statistics Theory · Mathematics 2025-11-17 Jeonghwan Lee , Cong Ma