English
Related papers

Related papers: Power-Estimation Trade-off of Vector-valued Witsen…

200 papers

In this paper, the authors report a way to use concepts from statistical learning to gain an advantage in terms of error exponents while communicating over a discrete memoryless channel. The study utilizes the simulation capability of the…

Information Theory · Computer Science 2022-08-09 Aman Chawla , Salvatore Domenic Morgera

The variational autoencoder (VAE) is a generative model with continuous latent variables where a pair of probabilistic encoder (bottom-up) and decoder (top-down) is jointly learned by stochastic gradient variational Bayes. We first…

Machine Learning · Statistics 2016-04-19 Suwon Suh , Seungjin Choi

We study secure source-coding with causal disclosure, under the Gaussian distribution. The optimality of Gaussian auxiliary random variables is shown in various scenarios. We explicitly characterize the tradeoff between the rates of…

Information Theory · Computer Science 2015-06-16 Sanket Satpathy , Paul Cuff

We analyze the continuous variable (CV) dense coding protocol between a single sender and a single receiver when affected by noise in the shared and encoded states as well as when the decoding is imperfect. We derive a general formalism for…

Quantum Physics · Physics 2024-07-11 Mrinmoy Samanta , Ayan Patra , Rivu Gupta , Aditi Sen De

We consider the discretized version of a (continuous-time) two-factor model introduced by Benth and coauthors for the electricity markets. For this model, the underlying is the exponent of a sum of independent random variables. We provide…

Pricing of Securities · Quantitative Finance 2012-05-21 Stéphane Goutte , Nadia Oudjane , Francesco Russo

We take steps towards understanding the "posterior collapse (PC)" difficulty in variational autoencoders (VAEs),~i.e. a degenerate optimum in which the latent codes become independent of their corresponding inputs. We rely on calculus of…

Machine Learning · Computer Science 2019-08-01 Octavian-Eugen Ganea , Yashas Annadani , Gary Bécigneul

The problem of joint source-channel coding is considered for a stationary remote (noisy) Gaussian source and a Gaussian channel. The encoder and decoder are assumed to be causal and their combined operations are subject to a delay…

Information Theory · Computer Science 2012-03-29 Erik Johannesson , Anders Rantzer , Bo Bernhardsson , Andrey Ghulchak

We study matrix and tensor denoising when the underlying signal is \textbf{not} necessarily low-rank. In the tensor setting, we observe \[ Y = X^\ast + Z \in \mathbb{R}^{p_1 \times p_2 \times p_3}, \] where $X^\ast$ is an unknown signal…

The task of jointly communicating a message and reconstructing a common estimate of the channel state is examined for a fading Gaussian model with additive state interference. The state is an independent and identically distributed Gaussian…

Information Theory · Computer Science 2026-01-07 Viswanathan Ramachandran

We study the information-theoretic limits of joint communication and sensing when the sensing task is modeled as the estimation of a discrete channel state fixed during the transmission of an entire codeword. This setting captures scenarios…

Information Theory · Computer Science 2023-05-17 Meng-Che Chang , Shi-Yuan Wang , Tuna Erdoğan , Matthieu R. Bloch

We study nonclassical correlations beyond entanglement in a family of two-mode non-Gaussian states which represent the continuous-variable counterpart of two-qubit Werner states. We evaluate quantum discord and other quantumness measures…

Quantum Physics · Physics 2015-06-03 Richard Tatham , Ladislav Mišta , Gerardo Adesso , Natalia Korolkova

Power decoding, or "decoding by virtual interleaving", of Reed--Solomon codes is a method for unique decoding beyond half the minimum distance. We give a new variant of the Power decoding scheme, building upon the key equation of Gao. We…

Information Theory · Computer Science 2014-05-22 Johan S. R. Nielsen

Causal mediation analysis seeks to determine whether an independent variable affects a response variable directly or whether it does so indirectly, by way of a mediator. The existing statistical tests to determine the existence of an…

Methodology · Statistics 2023-09-28 John Kidd , Dan-Yu Lin

We study the measurement-induced non-Gaussian operation on the single- and two-mode \textit{Gaussian} squeezed vacuum states with beam splitters and on-off type photon detectors, with which \textit{mixed non-Gaussian} states are generally…

Quantum Physics · Physics 2009-11-11 Akira Kitagawa , Masahiro Takeoka , Kentaro Wakui , Masahide Sasaki

This paper considers the problem of channel coding with a given (possibly suboptimal) maximum-metric decoding rule. A cost-constrained random-coding ensemble with multiple auxiliary costs is introduced, and is shown to achieve error…

Information Theory · Computer Science 2014-03-05 Jonathan Scarlett , Alfonso Martinez , Albert Guillén i Fàbregas

Recently, audio-visual speech enhancement has been tackled in the unsupervised settings based on variational auto-encoders (VAEs), where during training only clean data is used to train a generative model for speech, which at test time is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Mostafa Sadeghi , Xavier Alameda-Pineda

We study a continuous variable (CV) dense-coding protocol, originally proposed to employ a two-mode squeezed state, using a general two-mode Gaussian state as a quantum channel. We particularly obtain conditions to manifest quantum…

Quantum Physics · Physics 2014-08-07 Jaehak Lee , Se-Wan Ji , Jiyong Park , Hyunchul Nha

The optimal causal coding of a partially observed Markov process is studied, where the cost to be minimized is a bounded, non-negative, additive, measurable single-letter function of the source and the receiver output. A structural result…

Information Theory · Computer Science 2012-08-24 Serdar Yüksel

Quantum measurement is a fundamental yet experimentally challenging ingredient of quantum information processing. Many recent studies on quantum dynamics focus on expectation values of nonlinear observables; however, their experimental…

Quantum Physics · Physics 2025-04-02 Hong-Yi Wang

This work develops problem statements related to encoders and autoencoders with the goal of elucidating variational formulations and establishing clear connections to information-theoretic concepts. Specifically, four problems with varying…

Information Theory · Computer Science 2021-07-15 Karthik Duraisamy