English
Related papers

Related papers: Threshold Effects in Parameter Estimation from Com…

200 papers

Psychiatric neuroscience is increasingly aware of the need to define psychopathology in terms of abnormal neural computation. The central tool in this endeavour is the fitting of computational models to behavioural data. The most prominent…

Quantitative Methods · Quantitative Biology 2018-03-28 Abraham Nunes , Alexander Rudiuk

We investigate the effect of noise on Random Boolean Networks. Noise is implemented as a probability $p$ that a node does not obey its deterministic update rule. We define two order parameters, the long-time average of the Hamming distance…

Biological Physics · Physics 2009-11-13 Tiago P. Peixoto , Barbara Drossel

We consider the problem of subspace estimation in situations where the number of available snapshots and the observation dimension are comparable in magnitude. In this context, traditional subspace methods tend to fail because the…

Information Theory · Computer Science 2016-11-15 Pascal Vallet , Philippe Loubaton , Xavier Mestre

Compressed sensing is a technique to sample compressible signals below the Nyquist rate, whilst still allowing near optimal reconstruction of the signal. In this paper we present a theoretical analysis of the iterative hard thresholding…

Information Theory · Computer Science 2008-05-06 Thomas Blumensath , Mike E. Davies

This paper considers fundamental limits for solving sparse inverse problems in the presence of Poisson noise with physical constraints. Such problems arise in a variety of applications, including photon-limited imaging systems based on…

Statistics Theory · Mathematics 2014-03-27 Xin Jiang , Garvesh Raskutti , Rebecca Willett

Compressing word embeddings is important for deploying NLP models in memory-constrained settings. However, understanding what makes compressed embeddings perform well on downstream tasks is challenging---existing measures of compression…

Machine Learning · Computer Science 2020-01-16 Avner May , Jian Zhang , Tri Dao , Christopher Ré

The paper derives the theoretical Cramer-Rao lower bound for parameter estimation of a source (of emitting energy, gas, aerosol), monitored by a network of sensors providing binary measurements. The theoretical bound is studied in the…

Applications · Statistics 2014-05-30 Branko Ristic , Ajith Gunatilaka , Ralph Gailis

Gravitational waves have been instrumental in providing deep insights into the nature of gravity. Next-generation detectors, such as the Einstein Telescope, are predicted to have a higher detection rate given the increased sensitivity and…

Instrumentation and Methods for Astrophysics · Physics 2024-04-02 Yixuan Dang , Ziming Wang , Dicong Liang , Lijing Shao

A field known as Compressive Sensing (CS) has recently emerged to help address the growing challenges of capturing and processing high-dimensional signals and data sets. CS exploits the surprising fact that the information contained in a…

Machine Learning · Statistics 2010-02-08 Michael B. Wakin

Intrinsic transcriptional noise induced by operator fluctuations is investigated with a simple spin like stochastic model. The effects of transcriptional fluctuations in protein synthesis is probed by coupling transcription and translation…

Other Quantitative Biology · Quantitative Biology 2007-05-23 Guilherme da C. P. Innocentini , Jose E. M. Hornos

Channel Estimation is an essential component in applications such as radar and data communication. In multi path time varying environments, it is necessary to estimate time-shifts, scale-shifts (the wideband equivalent of Doppler-shifts),…

Information Theory · Computer Science 2009-06-05 Brian Carroll

In this paper, the Cramer Rao bound (CRB) for range estimation between two underwater nodes is calculated under a Gaussian noise assumption on the measurements. The nodes can measure their depths, their mutual time of flight, and they have…

Information Theory · Computer Science 2014-04-30 Hamid Ramezani , Raj Thilak Rajan , Geert Leus

In this expository note we describe a surprising phenomenon in overparameterized linear regression, where the dimension exceeds the number of samples: there is a regime where the test risk of the estimator found by gradient descent…

Machine Learning · Statistics 2019-12-17 Preetum Nakkiran

We focus on the problem of modulating a parameter onto a power-limited signal transmitted over a discrete-time Gaussian channel and estimating this parameter at the receiver. Considering the well-known threshold effect in non-linear…

Information Theory · Computer Science 2018-02-15 Neri Merhav

Changes in parameters of a physical device can eventually lead to catastrophic failure. This paper discusses a parameter estimation method based on synchronization between a model and time series data. In particular, we examine the…

chao-dyn · Physics 2007-05-23 Justin Goodwin , Reggie Brown , Lutz Junge

Hard-threshold estimators are popular in signal processing applications. We provide a detailed study of using hard-threshold estimators for estimating an unknown deterministic signal when additive white Gaussian noise corrupts observations.…

Statistics Theory · Mathematics 2008-01-24 Baris I. Erkmen , Vivek K. Goyal

In this paper, we analyze the impact of compressed sensing with complex random matrices on Fisher information and the Cram\'{e}r-Rao Bound (CRB) for estimating unknown parameters in the mean value function of a complex multivariate normal…

Statistics Theory · Mathematics 2023-07-19 Pooria Pakrooh , Ali Pezeshki , Louis L. Scharf , Douglas Cochran , Stephen D. Howard

Spike train signals recorded from a large population of neurons often exhibit low-dimensional spatio-temporal structure and modeled as conditional Poisson observations. The low-dimensional signals that capture internal brain states are…

Neurons and Cognition · Quantitative Biology 2024-08-19 Hyungju Jeon , Il Memming Park

This paper focusses on the sparse estimation in the situation where both the the sensing matrix and the measurement vector are corrupted by additive Gaussian noises. The performance bound of sparse estimation is analyzed and discussed in…

Information Theory · Computer Science 2015-06-12 Yujie Tang , Laming Chen , Yuantao Gu

Many algorithms and observed phenomena in deep learning appear to be affected by parameter symmetries -- transformations of neural network parameters that do not change the underlying neural network function. These include linear mode…

Machine Learning · Computer Science 2024-10-16 Derek Lim , Theo Moe Putterman , Robin Walters , Haggai Maron , Stefanie Jegelka