English
Related papers

Related papers: n-Channel Asymmetric Entropy-Constrained Multiple-…

200 papers

Autoencoder-based structures have dominated recent learned image compression methods. However, the inherent information loss associated with autoencoders limits their rate-distortion performance at high bit rates and restricts their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Hanyue Tu , Siqi Wu , Li Li , Wengang Zhou , Houqiang Li

Interference alignment (IA) is a cooperative transmission strategy that, under some conditions, achieves the interference channel's maximum number of degrees of freedom. Realizing IA gains, however, is contingent upon providing transmitters…

Information Theory · Computer Science 2013-04-15 Omar El Ayach , Angel Lozano , Robert W. Heath

In this paper, we address the problem of interference alignment (IA) over MIMO interference channels with limited channel state information (CSI) feedback based on quantization codebooks. Due to limited feedback and hence imperfect IA,…

Information Theory · Computer Science 2015-06-18 Xiaoming Chen , Chau Yuen

Consider communication over a binary-input memoryless output-symmetric channel with low density parity check (LDPC) codes and maximum a posteriori (MAP) decoding. The replica method of spin glass theory allows to conjecture an analytic…

Information Theory · Computer Science 2016-11-17 Shrinivas Kudekar , Nicolas Macris

This paper investigates artificial intelligence (AI) methodologies for the synthesis and transpilation of permutation circuits across generic topologies. Our approach uses Reinforcement Learning (RL) techniques to achieve near-optimal…

Quantum Physics · Physics 2025-09-22 Victor Villar , Juan Cruz-Benito , Ismael Faro , David Kremer

Lattice coding techniques may be used to derive achievable rate regions which outperform known independent, identically distributed (i.i.d.) random codes in multi-source relay networks and in particular the two-way relay channel. Gains stem…

Information Theory · Computer Science 2016-11-17 Yiwei Song , Natasha Devroye , Huai-Rong Shao , Chiu Ngo

Neural networks can be successfully used to improve several modules of advanced video coding schemes. In particular, compression of colour components was shown to greatly benefit from usage of machine learning models, thanks to the design…

Image and Video Processing · Electrical Eng. & Systems 2021-02-10 Marc Górriz , Saverio Blasi , Alan F. Smeaton , Noel E. O'Connor , Marta Mrak

Safety-critical autonomous systems must satisfy hard state constraints under tight computational and sensing budgets, yet learning-based controllers are often far more complex than safe operation requires. To formalize this gap, we study…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Ege Yuceel , Teodor Tchalakov , Sayan Mitra

In this paper we introduce learnable lattice vector quantization and demonstrate its effectiveness for learning discrete representations. Our method, termed LL-VQ-VAE, replaces the vector quantization layer in VQ-VAE with lattice-based…

Machine Learning · Computer Science 2023-10-17 Ahmed Khalil , Robert Piechocki , Raul Santos-Rodriguez

We introduce a novel generalization of entropy and conditional entropy from which most definitions from the literature can be derived as particular cases. Within this general framework, we investigate the problem of designing…

Information Theory · Computer Science 2018-11-27 MHR Khouzani , Pasquale Malacaria

Independent Component Analysis (ICA) is a fundamental unsupervised learning technique foruncovering latent structure in data by separating mixed signals into their independent sources. While substantial progress has been made in…

Machine Learning · Computer Science 2026-04-13 Yuwen Jiang

We present a novel approach for constrained Bayesian inference. Unlike current methods, our approach does not require convexity of the constraint set. We reduce the constrained variational inference to a parametric optimization over the…

Machine Learning · Computer Science 2013-09-27 Oluwasanmi Koyejo , Joydeep Ghosh

Image Coding for Machines (ICM) is becoming more important as research in computer vision progresses. ICM is a vital research field that pursues the use of images for image recognition models, facilitating efficient image transmission and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Takahiro Shindo , Taiju Watanabe , Yui Tatsumi , Hiroshi Watanabe

We consider the problem of lossy image compression with deep latent variable models. State-of-the-art methods build on hierarchical variational autoencoders (VAEs) and learn inference networks to predict a compressible latent representation…

Image and Video Processing · Electrical Eng. & Systems 2021-01-11 Yibo Yang , Robert Bamler , Stephan Mandt

Lattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent multiple linguistic…

Computation and Language · Computer Science 2019-06-05 Matthias Sperber , Graham Neubig , Ngoc-Quan Pham , Alex Waibel

An efficient interference alignment (IA) scheme is developed for $K$-user single-input single-output frequency selective fading interference channels. The main idea is to steer the transmit beamforming matrices such that at each receiver…

Information Theory · Computer Science 2009-06-23 Sang Won Choi , Syed A. Jafar , Sae-Young Chung

A generalization of the Gaussian dirty-paper problem to a multiple access setup is considered. There are two additive interference signals, one known to each transmitter but none to the receiver. The rates achievable using Costa's…

Information Theory · Computer Science 2009-04-14 Tal Philosof , Ram Zamir , Uri Erez , Ashish Khisti

Interference Alignment (IA) is the process of designing signals in such a way that they cast overlapping shadows at their unintended receivers, while remaining distinguishable at the intended ones. Our goal in this paper is to come up with…

Information Theory · Computer Science 2016-11-15 Hadi G. Ghauch , Constantinos B. Papadias

We introduce two variants of the information spectrum relative entropy defined by Tomamichel and Hayashi which have the particular advantage of satisfying the data-processing inequality, i.e. monotonicity under quantum operations. This…

Quantum Physics · Physics 2021-11-17 Nilanjana Datta , Felix Leditzky

We consider the problem of distributed mean estimation (DME), in which $n$ machines are each given a local $d$-dimensional vector $x_v \in \mathbb{R}^d$, and must cooperate to estimate the mean of their inputs $\mu = \frac 1n\sum_{v = 1}^n…

Machine Learning · Computer Science 2021-04-08 Peter Davies , Vijaykrishna Gurunathan , Niusha Moshrefi , Saleh Ashkboos , Dan Alistarh