English
Related papers

Related papers: Successive Refinement with Decoder Cooperation and…

200 papers

We construct a new kind of encoder, leveraging the expressive power of diffusion models. In a traditional variational autoencoder, the encoder and decoder jointly negotiate a latent representation of the input. This is made possible by the…

Machine Learning · Computer Science 2026-05-14 Akhil Premkumar , Sarah Lucioni

A two-part successive syndrome-check decoding of polar codes is proposed with the first part successively refining the received codeword and the second part checking its syndrome. A new formulation of the successive-cancellation (SC)…

Information Theory · Computer Science 2021-12-02 Seyyed Ali Hashemi , Marco Mondelli , John Cioffi , Andrea Goldsmith

Reliable transmission of arbitrarily correlated sources over multiple-access relay channels (MARCs) and multiple-access broadcast relay channels (MABRCs) is considered. In MARCs, only the destination is interested in a reconstruction of the…

Information Theory · Computer Science 2012-07-04 Yonathan Murin , Ron Dabora , Deniz Gündüz

The attention-based encoder-decoder framework has recently achieved impressive results for scene text recognition, and many variants have emerged with improvements in recognition quality. However, it performs poorly on contextless texts…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Xiaoyu Yue , Zhanghui Kuang , Chenhao Lin , Hongbin Sun , Wayne Zhang

Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks. We provide a simple yet rigorous explanation for this behaviour by introducing the concept of an optimal…

Artificial Intelligence · Computer Science 2018-05-10 Vitalii Zhelezniak , Dan Busbridge , April Shen , Samuel L. Smith , Nils Y. Hammerla

The problem of low complexity, close to optimal, channel decoding of linear codes with short to moderate block length is considered. It is shown that deep learning methods can be used to improve a standard belief propagation decoder,…

Information Theory · Computer Science 2018-03-14 Eliya Nachmani , Elad Marciano , Loren Lugosch , Warren J. Gross , David Burshtein , Yair Beery

Scaling and lossy coding are widely used in video transmission and storage. Previous methods for enhancing the resolution of such videos often ignore the inherent interference between resolution loss and compression artifacts, which…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Dewang Hou , Yang Zhao , Yuyao Ye , Jiayu Yang , Jian Zhang , Ronggang Wang

In fact, the broadcast nature of every transmitter makes it possible for other transceivers in the channel to overhear the broadcasted signal. The proposed idea in cooperative communication is to use these intermediate transceivers as relay…

Signal Processing · Electrical Eng. & Systems 2024-09-25 Ali Mehrban

We propose a novel joint decoding technique for distributed source-channel (DSC) coded systems for transmission of correlated binary Markov sources over additive white Gaussian noise (AWGN) channels. In the proposed scheme, relatively…

Information Theory · Computer Science 2013-08-02 Reza Asvadi , Tad Matsumoto , Markku Juntti

We investigate joint network and channel coding schemes for networks when relay nodes are not capable of performing channel coding operations. Rather, channel encoding is performed at the source node while channel decoding is done only at…

Information Theory · Computer Science 2011-12-12 Sarah J. Johnson , Lawrence Ong , Christopher M. Kellett

The problem of secure multiterminal source coding with side information at the eavesdropper is investigated. This scenario consists of a main encoder (referred to as Alice) that wishes to compress a single source but simultaneously…

Information Theory · Computer Science 2013-11-11 Joffrey Villard , Pablo Piantanida

The remarkable transmission of two bits of information via a single qubit entangled with another at the destination, is presented as an expansion of the unremarkable classical circuit that transmits the bits with two direct qubit-qubit…

Quantum Physics · Physics 2009-11-07 N. David Mermin

The recently proposed set-up of source coding with a side information "vending machine" allows the decoder to select actions in order to control the quality of the side information. The actions can depend on the message received from the…

Information Theory · Computer Science 2013-01-08 Osvaldo Simeone

In successive refinement of information, the decoder refines its representation of the source progressively as it receives more encoded bits. The rate-distortion region of successive refinement describes the minimum rates required to attain…

Information Theory · Computer Science 2018-11-22 Victoria Kostina , Ertem Tuncel

Standard methods for multi-label text classification largely rely on encoder-only pre-trained language models, whereas encoder-decoder models have proven more effective in other classification tasks. In this study, we compare four methods…

Computation and Language · Computer Science 2023-05-10 Yova Kementchedjhieva , Ilias Chalkidis

Scalable coding, which can adapt to channel bandwidth variation, performs well in today's complex network environment. However, most existing scalable compression methods face two challenges: reduced compression performance and insufficient…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Yongqi Zhai , Yi Ma , Luyang Tang , Wei Jiang , Ronggang Wang

In joint multiuser decoding, a receiver recovers a set of messages from a single noisy aggregate of many simultaneous transmissions. Classical decoders rely on rule-based mechanisms such as successive interference cancellation, joint belief…

Information Theory · Computer Science 2026-05-27 Taekyun Lee , Jiyoung Yun , Jeffrey G. Andrews , Hyeji Kim

Similarity-preserving hashing is a widely-used method for nearest neighbour search in large-scale image retrieval tasks. For most existing hashing methods, an image is first encoded as a vector of hand-engineering visual features, followed…

Computer Vision and Pattern Recognition · Computer Science 2019-08-17 Hanjiang Lai , Yan Pan , Ye Liu , Shuicheng Yan

In a cooperative coding scheme, network nodes work together to achieve higher transmission rates. To obtain a better understanding of cooperation, we consider a model in which two transmitters send rate-limited descriptions of their…

Information Theory · Computer Science 2015-04-20 Parham Noorzad , Michelle Effros , Michael Langberg

In continuation to earlier works where the problem of joint information embedding and lossless compression (of the composite signal) was studied in the absence \cite{MM03} and in the presence \cite{MM04} of attacks, here we consider the…

Information Theory · Computer Science 2007-07-13 Neri Merhav