English
Related papers

Related papers: On optimal precoding in linear vector Gaussian cha…

200 papers

Efficient signal representation is essential for the functioning of living and artificial systems operating under resource constraints. A widely recognized framework for deriving such representations is the information bottleneck method,…

Molecular Networks · Quantitative Biology 2025-07-08 Vahe Galstyan , Age Tjalma , Pieter Rein ten Wolde

Scaling hyperparameter optimisation to very large datasets remains an open problem in the Gaussian process community. This paper focuses on iterative methods, which use linear system solvers, like conjugate gradients, alternating…

Machine Learning · Computer Science 2025-01-14 Jihao Andreas Lin , Shreyas Padhy , Bruno Mlodozeniec , Javier Antorán , José Miguel Hernández-Lobato

This paper studies implicit communication in linear quadratic Gaussian control systems. We show that the control system itself can serve as an implicit communication channel, enabling the controller to transmit messages through its inputs…

Information Theory · Computer Science 2025-11-19 Gongpu Chen , Deniz Gunduz

We examine the extent to which Gaussian relay networks can be approximated by deterministic networks, and present two results, one negative and one positive. The gap between the capacities of a Gaussian relay network and a corresponding…

Information Theory · Computer Science 2009-08-10 M. Anand , P. R. Kumar

In this paper, we consider a distributed remote source coding problem, where a sequence of observations of source vectors is available at the encoder. The problem is to specify the optimal rate for encoding the observations subject to a…

Information Theory · Computer Science 2014-06-05 Adel Zahedi , Jan Ostergaard , Soren Holdt Jensen , Patrick Naylor , Soren Bech

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

The arbitrarily varying channel (AVC) is a conservative way of modeling an unknown interference, and the corresponding capacity results are pessimistic. We reconsider the Gaussian AVC by relaxing the classical model and thereby weakening…

Information Theory · Computer Science 2012-09-14 Anand D. Sarwate , Michael Gastpar

For a networked control system, we consider the problem of encoder and controller design. We study a discrete-time linear plant with a finite horizon performance cost, comprising of a quadratic function of the states and controls, and an…

Optimization and Control · Mathematics 2016-02-22 Maben Rabi , Chithrupa Ramesh , Karl Henrik Johansson

We consider the problem of finding secrecy rate of a multiple-input multiple-output (MIMO) wire-tap channel. A transmitter, a legitimate receiver, and an eavesdropper are all equipped with multiple antennas. The channel states from the…

Information Theory · Computer Science 2014-11-04 Arash Khabbazibasmenj , Maksym A. Girnyk , Sergiy A. Vorobyov , Mikko Vehkaperä , Lars K. Rasmussen

We consider here how to separate multidimensional signals into two categories, such that the binary decision transmits the maximum possible information transmitted about those signals. Our motivation comes from the nervous system, where…

Neurons and Cognition · Quantitative Biology 2015-06-26 Tatyana Sharpee , William Bialek

This paper considers a vector Gaussian channel of fixed identity covariance matrix and binary input signalling as the mean of it. A linear transformation is performed on the vector input signal. The objective is to find the optimal scaling…

Information Theory · Computer Science 2024-12-06 Muhammad Fahad , Daniel R. Fuhrmann

Linear-Quadratic-Gaussian (LQG) control is concerned with the design of an optimal controller and estimator for linear Gaussian systems with imperfect state information. Standard LQG assumes the set of sensor measurements, to be fed to the…

Optimization and Control · Mathematics 2020-05-18 Vasileios Tzoumas , Luca Carlone , George J. Pappas , Ali Jadbabaie

In contrast to multi-label learning, label distribution learning characterizes the polysemy of examples by a label distribution to represent richer semantics. In the learning process of label distribution, the training data is collected…

Machine Learning · Computer Science 2022-09-29 Zhuoran Zheng , Xiuyi Jia

We construct optimal low-rank approximations for the Gaussian posterior distribution in linear Gaussian inverse problems with possibly infinite-dimensional separable Hilbert parameter spaces and finite-dimensional data spaces. We first…

Statistics Theory · Mathematics 2026-04-09 Giuseppe Carere , Han Cheng Lie

This paper considers reliable communications over a multiple-input multiple-output (MIMO) Gaussian channel, where the channel matrix is within a bounded channel uncertainty region around a nominal channel matrix, i.e., an instance of the…

Information Theory · Computer Science 2013-06-05 Yin Sun , C. Emre Koksal , Ness B. Shroff

Gaussian channels with memory and with noiseless feedback have been widely studied in the information theory literature. However, a coding scheme to achieve the feedback capacity is not available. In this paper, a coding scheme is proposed…

Information Theory · Computer Science 2007-07-13 Jialing Liu , Nicola Elia

We derive a Gaussian approximation result for the maximum of a sum of high-dimensional random vectors. Specifically, we establish conditions under which the distribution of the maximum is approximated by that of the maximum of a sum of the…

Statistics Theory · Mathematics 2018-01-24 Victor Chernozhukov , Denis Chetverikov , Kengo Kato

We consider the situation in which a continuous-time vector Gauss-Markov process is observed through a vector Gaussian channel (sensor) and estimated by the Kalman-Bucy filter. Unlike in standard filtering problems where a sensor model is…

Optimization and Control · Mathematics 2017-09-12 Takashi Tanaka , Mikael Skoglund , Valeri Ugrinovskii

The optimization of entanglement evolution for two-mode Gaussian pure states under one-side Gaussian map is studied. Even there isn't complete information about the one-side Gaussian noisy channel, one can still maximize the entanglement…

Quantum Physics · Physics 2015-05-14 Xiang-Bin Wang , Zong-Wen Yu , Jia-Zhong Hu

The digital telecommunications receiver is an important context for inference methodology, the key objective being to minimize the expected loss function in recovering the transmitted information. For that criterion, the optimal decision is…

Information Theory · Computer Science 2018-11-07 Viet Hung Tran