English
Related papers

Related papers: Threshold Effects in Parameter Estimation from Com…

200 papers

Compressive sensing is the newly emerging method in information technology that could impact array beamforming and the associated engineering applications. However, practical measurements are inevitably polluted by noise from external…

Information Theory · Computer Science 2013-07-12 Siyang Zhong , Xun Huang

Suprathreshold stochastic resonance (SSR) is a form of noise enhanced signal transmission that occurs in a parallel array of independently noisy identical threshold nonlinearities, including model neurons. Unlike most forms of stochastic…

Statistical Mechanics · Physics 2007-07-02 Mark D. McDonnell , Nigel G. Stocks , Derek Abbott

This paper examines the problem of estimating the parameters of a bandlimited signal from samples corrupted by random jitter (timing noise) and additive iid Gaussian noise, where the signal lies in the span of a finite basis. For the…

Applications · Statistics 2015-03-24 Daniel S. Weller , Vivek K Goyal

As shown recently (O.B.Isaeva et al., Phys.Rev E64, 055201), the phenomena intrinsic to dynamics of complex analytic maps under appropriate conditions may occur in physical systems. We study scaling regularities associated with the effect…

Chaotic Dynamics · Physics 2009-11-10 O. B. Isaeva , S. P. Kuznetsov , A. H. Osbaldestin

Purpose: To develop neural network (NN)-based quantitative MRI parameter estimators with minimal bias and a variance close to the Cram\'er-Rao bound. Theory and Methods: We generalize the mean squared error loss to control the bias and…

Medical Physics · Physics 2024-05-07 Andrew Mao , Sebastian Flassbeck , Jakob Assländer

In the threshold region, the cross section and the associated overlap integral obey the Wigner threshold law that results in the Wigner-cusp phenomenon. Due to flux conservation, a cusp anomaly in one channel manifests itself in other open…

Nuclear Theory · Physics 2008-11-26 N. Michel , W. Nazarewicz , M. Ploszajczak

We analyze gradient descent with randomly weighted data points in a linear regression model, under a generic weighting distribution. This includes various forms of stochastic gradient descent, importance sampling, but also extends to…

Machine Learning · Statistics 2025-12-12 Gabriel Clara , Yazan Mash'al

In image compression, with recent advances in generative modeling, the existence of a trade-off between the rate and the perceptual quality (realism) has been brought to light, where the realism is measured by the closeness of the output…

Information Theory · Computer Science 2024-04-02 Yassine Hamdi , Aaron B. Wagner , Deniz Gündüz

This paper considers estimation of a random variable in Poisson noise with signal scaling coefficient and dark current as explicit parameters of the noise model. Specifically, the paper focuses on properties of the conditional mean…

Information Theory · Computer Science 2020-04-01 Alex Dytso , H. Vincent Poor

In sparse signal processing, this study investigates the effect of the global shrinkage parameter $\tau$ of a horseshoe prior, one of the global-local shrinkage prior, on the linear regression. Statistical mechanics methods are employed to…

Disordered Systems and Neural Networks · Physics 2025-03-04 Yasushi Nagano , Koji Hukushima

The effects of noise and sampling on the ``Spectral Correlation Function'' (SCF) introduced by Rosolowsky et al. 1999 are studied using observational data, numerical simulations of magneto-hydrodynamic turbulence, and simple models of…

Astrophysics · Physics 2009-10-31 Paolo Padoan , Erik W. Rosolowsky , Alyssa A. Goodman

A continuous-time Wiener phase noise channel with an integrate-and-dump multi-sample receiver is studied. A lower bound to the capacity with an average input power constraint is derived, and a high signal-to-noise ratio (SNR) analysis is…

Information Theory · Computer Science 2015-03-12 Luca Barletta , Gerhard Kramer

We explore an error-bounded lossy compression approach for reducing scientific data associated with 2D/3D unstructured meshes. While existing lossy compressors offer a high compression ratio with bounded error for regular grid data,…

Graphics · Computer Science 2024-04-04 Congrong Ren , Xin Liang , Hanqi Guo

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

Information Theory · Computer Science 2025-06-10 Riccardo Rossetti , Galen Reeves

We study the phase transition phenomenon inherent in the shuffled (permuted) regression problem, which has found numerous applications in databases, privacy, data analysis, etc. In this study, we aim to precisely identify the locations of…

Machine Learning · Statistics 2023-11-01 Hang Zhang , Ping Li

Deep neural networks have shown promise for music audio signal processing applications, often surpassing prior approaches, particularly as end-to-end models in the waveform domain. Yet results to date have tended to be constrained by low…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 William Mitchell , Scott H. Hawley

We consider parameter estimation under sparse linear regression -- an extensively studied problem in high-dimensional statistics and compressed sensing. While the minimax framework has been one of the most fundamental approaches for…

Statistics Theory · Mathematics 2025-01-24 Shubhangi Ghosh , Yilin Guo , Haolei Weng , Arian Maleki

A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label…

Machine Learning · Statistics 2021-11-17 Nilesh Tripuraneni , Ben Adlam , Jeffrey Pennington

Modern scientific instruments produce vast amounts of data, which can overwhelm the processing ability of computer systems. Lossy compression of data is an intriguing solution, but comes with its own drawbacks, such as potential signal…

Hearing aids use dynamic range compression (DRC), a form of automatic gain control, to make quiet sounds louder and loud sounds quieter. Compression can improve listening comfort, but it can also cause distortion in noisy environments. It…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-28 Ryan M. Corey , Andrew C. Singer