Related papers: Threshold Effects in Parameter Estimation from Com…
We study the flow of information and the evolution of internal representations during deep neural network (DNN) training, aiming to demystify the compression aspect of the information bottleneck theory. The theory suggests that DNN training…
Complete awareness of the wireless environment, crucial for future intelligent networks, requires sensing all transmitted signals, not just the strongest. A fundamental barrier is estimating the target signal when it is buried under strong…
The co-sparse analysis model for signals assumes that the signal of interest can be multiplied by an analysis dictionary \Omega, leading to a sparse outcome. This model stands as an interesting alternative to the more classical synthesis…
This paper considers a sequential sensor scheduling and remote estimation problem with multiple communication channels. Departing from the classical remote estimation paradigm, which involves one communication channel (noiseless or noisy),…
We investigate the errors in modeling the redshift-space distortion (RSD) effect at large linear scales, using data from the Millennium simulation. While standard theoretical templates, such as the Kaiser formula and the TNS method, could…
This work presents a study on label noise in medical image segmentation by considering a noise model based on Gaussian field deformations. Such noise is of interest because it yields realistic looking segmentations and because it is…
Here we present a simple stochastic threshold model consisting of a deterministic slowly decaying term and a fast stochastic noise term. The process shows a pseudo-resonance, in the sense that for small and large intensities of the noise…
We propose a statistical framework for the problem of parameter estimation from a noisy optomechanical system. The Cram\'er-Rao lower bound on the estimation errors in the long-time limit is derived and compared with the errors of…
As is known, factor analysis is a popular method to reduce dimension for high-dimensional data. For matrix data, the dimension reduction can be more effectively achieved through both row and column directions. In this paper, we introduce a…
We establish the convergence rates and asymptotic distributions of the common break change-point estimators, obtained by least squares and maximum likelihood in panel data models and compare their asymptotic variances. Our model assumptions…
High-dimensional sparse modeling via regularization provides a powerful tool for analyzing large-scale data sets and obtaining meaningful, interpretable models. The use of nonconvex penalty functions shows advantage in selecting important…
While transmission expansions are planned to have positive impact on reliability of power grids, they could increase the risk and severity of some of the detrimental incidents in power grid mainly by virtue of changing system configuration,…
This paper describes performance bounds for compressed sensing (CS) where the underlying sparse or compressible (sparsely approximable) signal is a vector of nonnegative intensities whose measurements are corrupted by Poisson noise. In this…
This paper concerns the problem of 1-bit compressed sensing, where the goal is to estimate a sparse signal from a few of its binary measurements. We study a non-convex sparsity-constrained program and present a novel and concise analysis…
We consider the design of a linear sensing system with a fixed energy budget assuming that the sampling noise is the dominant noise source. The energy constraint implies that the signal energy per measurement decreases linearly with the…
A two-state system (TSS) under time-periodic perturbations (to be regarded as input signals) is studied in connection with self-tuning (ST) of threshold and stochastic resonance (SR). By ST, we observe the improvement of signal-to-noise…
We investigate how the final parameters found by stochastic gradient descent are influenced by over-parameterization. We generate families of models by increasing the number of channels in a base network, and then perform a large…
In this paper, the effects of interference on composite fading environments, where multipath fading coexists with shadowing, are investigated. Based on some mathematical convenient expressions for the sum of squared…
In image compression, with recent advances in generative modeling, the existence of a trade-off between the rate and the perceptual quality has been brought to light, where the perception is measured by the closeness of the output…
This work is motivated by the problem of image mis-registration in remote sensing and we are interested in determining the resulting loss in the accuracy of pattern classification. A statistical formulation is given where we propose to use…