English
Related papers

Related papers: Learning Binary Autoencoder-Based Codes with Progr…

200 papers

A new class of exact-repair regenerating codes is constructed by stitching together shorter erasure correction codes, where the stitching pattern can be viewed as block designs. The proposed codes have the "help-by-transfer" property where…

Information Theory · Computer Science 2017-08-04 Chao Tian , Birenjith Sasidharan , Vaneet Aggarwal , Vinay A. Vaishampayan , P. Vijay Kumar

We investigate the potential of adaptive blind equalizers based on variational inference for carrier recovery in optical communications. These equalizers are based on a low-complexity approximation of maximum likelihood channel estimation.…

Signal Processing · Electrical Eng. & Systems 2022-09-16 Vincent Lauinger , Fred Buchali , Laurent Schmalen

The idea of end-to-end learning of communications systems through neural network -based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates…

Information Theory · Computer Science 2018-12-06 Fayçal Ait Aoudia , Jakob Hoydis

This paper presents a new paradigm for image transmission through analog error correction codes. Conventional schemes rely on digitizing images through quantization (which inevitably causes significant bandwidth expansion) and transmitting…

Multimedia · Computer Science 2011-08-04 Yang Liu , Jing , Li , Kai Xie

We revisit recent methods that employ graph neural networks for decoding error correcting codes and employ messages that are computed in an autoregressive manner. The outgoing messages of the variable nodes are conditioned not only on the…

Information Theory · Computer Science 2021-03-23 Eliya Nachmani , Lior Wolf

We consider a binary classification problem when the data comes from a mixture of two rotationally symmetric distributions satisfying concentration and anti-concentration properties enjoyed by log-concave distributions among others. We show…

Machine Learning · Computer Science 2021-08-26 Spencer Frei , Difan Zou , Zixiang Chen , Quanquan Gu

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

We propose efficient coding schemes for two communication settings: 1. asymmetric channels, and 2. channels with an informed encoder. These settings are important in non-volatile memories, as well as optical and broadcast communication. The…

Information Theory · Computer Science 2015-12-31 Eyal En Gad , Yue Li , Joerg Kliewer , Michael Langberg , Anxiao Jiang , Jehoshua Bruck

Drill string communications are important for drilling efficiency and safety. The design of a low latency drill string communication system with high throughput and reliability remains an open challenge. In this paper a deep learning…

Machine Learning · Computer Science 2024-05-08 Iurii Lezhenin , Aleksandr Sidnev , Vladimir Tsygan , Igor Malyshev

To address the issue of increased bit error rates during the later stages of linear search in denoising diffusion error correction codes, we propose a novel method that optimizes denoising diffusion error correction codes (ECC) using cosine…

Information Theory · Computer Science 2024-05-07 Congyang Ou , Xiaojing Chen , Wan Jiang

The binary asymmetric channel is a model for practical communication systems where the error probabilities for symbol transitions $0\rightarrow 1$ and $1\rightarrow0$ differ substantially. In this paper, we introduce the notion of…

Information Theory · Computer Science 2026-04-10 Shukai Wang , Cuiling Fan , Chunming Tang , Zhengchun Zhou

In this paper, we consider the problem of variable-length coding over the class of memoryless binary asymmetric channels (BACs) with noiseless feedback, including the binary symmetric channel (BSC) as a special case. In 2012, Naghshvar et…

Information Theory · Computer Science 2021-12-01 Hengjie Yang , Minghao Pan , Amaael Antonini , Richard D. Wesel

Researchers have applied deep neural networks to image restoration tasks, in which they proposed various network architectures, loss functions, and training methods. In particular, adversarial training, which is employed in recent studies,…

Neural and Evolutionary Computing · Computer Science 2018-03-02 Masanori Suganuma , Mete Ozay , Takayuki Okatani

According to recent studies, the vulnerability of state-of-the-art Neural Networks to adversarial input samples has increased drastically. A neural network is an intermediate path or technique by which a computer learns to perform tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Anirudh Yadav , Ashutosh Upadhyay , S. Sharanya

Autoencoders are a deep learning model for representation learning. When trained to minimize the distance between the data and its reconstruction, linear autoencoders (LAEs) learn the subspace spanned by the top principal directions but…

Machine Learning · Computer Science 2019-05-15 Daniel Kunin , Jonathan M. Bloom , Aleksandrina Goeva , Cotton Seed

We introduce Perception Encoder (PE), a state-of-the-art vision encoder for image and video understanding trained via simple vision-language learning. Traditionally, vision encoders have relied on a variety of pretraining objectives, each…

Learning binary representation is essential to large-scale computer vision tasks. Most existing algorithms require a separate quantization constraint to learn effective hashing functions. In this work, we present Direct Binary Embedding…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Liu Liu , Alireza Rahimpour , Ali Taalimi , Hairong Qi

An attractive approach for fast search in image databases is binary hashing, where each high-dimensional, real-valued image is mapped onto a low-dimensional, binary vector and the search is done in this binary space. Finding the optimal…

Machine Learning · Computer Science 2015-01-23 Miguel Á. Carreira-Perpiñán , Ramin Raziperchikolaei

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Autoencoders (AE) are generative stochastic networks with these desired properties. We integrate a special type of…

Neural and Evolutionary Computing · Computer Science 2015-09-22 Malte Probst

The coding matrix design plays a fundamental role in the prediction performance of the error correcting output codes (ECOC)-based multi-class task. {In many-class classification problems, e.g., fine-grained categorization, it is difficult…

Machine Learning · Computer Science 2016-03-21 Joey Tianyi Zhou , Ivor W. Tsang , Shen-Shyang Ho , Klaus-Robert Muller