English
Related papers

Related papers: Non-Linear Estimation of Convolutionally Encoded S…

200 papers

It is common practice to collect observations of feature and response pairs from different environments. A natural question is how to identify features that have consistent prediction power across environments. The invariant causal…

Information Theory · Computer Science 2022-07-01 Austin Goddard , Yu Xiang , Ilya Soloveychik

Asymptotic expressions of the mutual information between any discrete input and the corresponding output of the scalar additive white Gaussian noise channel are presented in the limit as the signal-to-noise ratio (SNR) tends to infinity.…

Information Theory · Computer Science 2014-04-23 Alex Alvarado , Fredrik Brannstrom , Erik Agrell , Tobias Koch

Quantum non-Gaussianity is a key resource for quantum advantage in continuous-variable systems. We introduce a general framework to quantify non-Gaussianity based on correlation generation: two copies of a state become correlated at a…

Quantum Physics · Physics 2025-08-28 Oliver Hahn , Ryuji Takagi

We propose a novel class of time-varying nonparanormal graphical models, which allows us to model high dimensional heavy-tailed systems and the evolution of their latent network structures. Under this model, we develop statistical tests for…

Machine Learning · Statistics 2018-02-14 Junwei Lu , Mladen Kolar , Han Liu

We present a Bayesian perspective on quantifying the uncertainty of graph signals estimated or reconstructed from imperfect observations. We show that many conventional methods of graph signal estimation, reconstruction and imputation, can…

Signal Processing · Electrical Eng. & Systems 2025-05-22 Lennard Rompelberg , Michael T. Schaub

We consider the problem of recovering linear image of unknown signal belonging to a given convex compact signal set from noisy observation of another linear image of the signal. We develop a simple generic efficiently computable nonlinear…

Statistics Theory · Mathematics 2019-04-12 Anatoli Juditsky , Arkadi Nemirovski

Probabilistic encoding introduces Gaussian noise into neural networks, enabling a smooth transition from deterministic to uncertain states and enhancing generalization ability. However, the randomness of Gaussian noise distorts point-based…

Machine Learning · Computer Science 2025-07-24 Pengjiu Xia , Yidian Huang , Wenchao Wei , Yuwen Tan

Approaches to signal representation and coding theory have traditionally focused on how to best represent signals using parsimonious representations that incur the lowest possible distortion. Classical examples include linear and non-linear…

Information Theory · Computer Science 2015-12-25 Petros T Boufounos , Shantanu Rane , Hassan Mansour

We consider the problem of learning a coefficient vector $x_{0}$ in $R^{N}$ from noisy linear observations $y=Fx_{0}+w$ in $R^{M}$ in the high dimensional limit $M,N$ to infinity with $\alpha=M/N$ fixed. We provide a rigorous derivation of…

Machine Learning · Statistics 2020-02-12 Cédric Gerbelot , Alia Abbara , Florent Krzakala

This paper develops an asymptotic likelihood theory for triangular arrays of stationary Gaussian time series depending on a multidimensional unknown parameter. We give sufficient conditions for the associated sequence of statistical models…

Statistics Theory · Mathematics 2025-11-14 Carsten H. Chong , Fabian Mies

Finding fast polarizing transforms is an important problem as polar codes suffer from slow finitelength performance. This paper considers non binary polar codes for transmission over the AWGN channel and designs polarizing transforms with…

Information Theory · Computer Science 2019-01-31 Sinan Kahraman

In this paper, we focus on activating only a few sensors, among many available, to estimate the state of a stochastic process of interest. This problem is important in applications such as target tracking and simultaneous localization and…

Systems and Control · Computer Science 2016-09-28 Vasileios Tzoumas , Nikolay A. Atanasov , Ali Jadbabaie , George J. Pappas

We show an alternative way of representing a Bayesian belief network by sensitivities and probability distributions. This representation is equivalent to the traditional representation by conditional probabilities, but makes dependencies…

Artificial Intelligence · Computer Science 2013-02-21 Alexander V. Kozlov , Jaswinder Pal Singh

The study presents a novel approach for stochastic nonlinear model updating in structural dynamics, employing a Bayesian framework integrated with Markov Chain Monte Carlo (MCMC) sampling for parameter estimation by using an approximated…

For stochastic models with intractable likelihood functions, approximate Bayesian computation offers a way of approximating the true posterior through repeated comparisons of observations with simulated model outputs in terms of a small set…

Machine Learning · Computer Science 2022-05-24 Carlo Albert , Simone Ulzega , Firat Ozdemir , Fernando Perez-Cruz , Antonietta Mira

We consider the problem of computing a binary linear transformation using unreliable components when all circuit components are unreliable. Two noise models of unreliable components are considered: probabilistic errors and permanent errors.…

Information Theory · Computer Science 2017-05-16 Yaoqing Yang , Pulkit Grover , Soummya Kar

In this paper, we propose a compositional nonparametric method in which a model is expressed as a labeled binary tree of $2k+1$ nodes, where each node is either a summation, a multiplication, or the application of one of the $q$ basis…

Machine Learning · Statistics 2019-05-28 Yixi Xu , Jean Honorio , Xiao Wang

We present the first neural probabilistic amplitude shaping that outperforms existing methods while accounting for all implementation losses, using a block-less, easily implementable sequential autoregressive encoder compatible with…

Machine Learning · Computer Science 2026-05-28 Mohammad Taha Askari , Lutz Lampe , Amirhossein Ghazisaeidi

Effective causal discovery is essential for learning the causal graph from observational data. The linear non-Gaussian acyclic model (LiNGAM) operates under the assumption of a linear data generating process with non-Gaussian noise in…

Machine Learning · Computer Science 2025-02-28 Hans Jarett J. Ong , Brian Godwin S. Lim , Renzo Roel P. Tan , Kazushi Ikeda

An approximation method is presented for probabilistic inference with continuous random variables. These problems can arise in many practical problems, in particular where there are "second order" probabilities. The approximation, based on…

Artificial Intelligence · Computer Science 2013-04-10 Ross D. Shachter