English
Related papers

Related papers: Generation of Innovative and Sparse Encoding Vecto…

200 papers

The design of optimal linear block codes capable of being efficiently decoded is of major concern, especially for short block lengths. As near capacity-approaching codes, Low-Density Parity-Check (LDPC) codes possess several advantages over…

Information Theory · Computer Science 2024-10-11 Yoni Choukroun , Lior Wolf

We consider transmission over a binary-input additive white Gaussian noise channel using low-density parity-check codes. One of the most popular techniques for decoding low-density parity-check codes is the linear programming decoder. In…

Information Theory · Computer Science 2015-03-19 Shrinivas Kudekar , Jason K. Johnson , Misha Chertkov

Sparse coding strategies have been lauded for their parsimonious representations of data that leverage low dimensional structure. However, inference of these codes typically relies on an optimization procedure with poor computational…

Machine Learning · Computer Science 2022-09-02 Kion Fallah , Christopher J. Rozell

Network coding enhances performance in network communications and distributed storage by increasing throughput and robustness while reducing latency. Batched Sparse (BATS) codes are a class of capacity-achieving network codes, but their…

Hardware Architecture · Computer Science 2025-01-10 Jiaxin Qing , Philip H. W. Leong , Kin Hong Lee , Raymond W. Yeung

Convolutional sparse coding (CSC) is an important building block of many computer vision applications ranging from image and video compression to deep learning. We present two contributions to the state of the art in CSC. First, we…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Lama Affara , Bernard Ghanem , Peter Wonka

A recent line of work has shown promise in using sparse autoencoders (SAEs) to uncover interpretable features in neural network representations. However, the simple linear-nonlinear encoding mechanism in SAEs limits their ability to perform…

Machine Learning · Computer Science 2025-01-31 Charles O'Neill , Alim Gumran , David Klindt

Sparse coding refers to the pursuit of the sparsest representation of a signal in a typically overcomplete dictionary. From a Bayesian perspective, sparse coding provides a Maximum a Posteriori (MAP) estimate of the unknown vector under a…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Dror Simon , Jeremias Sulam , Yaniv Romano , Yue M. Lu , Michael Elad

The \emph{index coding} problem has recently attracted a significant attention from the research community due to its theoretical significance and applications in wireless ad-hoc networks. An instance of the index coding problem includes a…

Information Theory · Computer Science 2008-10-02 Salim Y. El Rouayheb , Alex Sprintson , Costas N. Georghiades

Autoencoding has achieved great empirical success as a framework for learning generative models for natural images. Autoencoders often use generic deep networks as the encoder or decoder, which are difficult to interpret, and the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xili Dai , Ke Chen , Shengbang Tong , Jingyuan Zhang , Xingjian Gao , Mingyang Li , Druv Pai , Yuexiang Zhai , XIaojun Yuan , Heung-Yeung Shum , Lionel M. Ni , Yi Ma

This letter considers a network comprising a transmitter, which employs random linear network coding to encode a message, a legitimate receiver, which can recover the message if it gathers a sufficient number of linearly independent coded…

Cryptography and Security · Computer Science 2022-03-08 Amjad Saeed Khan , Andrea Tassi , Ioannis Chatzigeorgiou

We consider the problem of encoding a finite set of vectors into a small number of bits while approximately retaining information on the angular distances between the vectors. By deriving improved variance bounds related to binary Gaussian…

Information Theory · Computer Science 2017-12-27 Sjoerd Dirksen , Alexander Stollenwerk

We present a novel sparse modeling approach to non-rigid shape matching using only the ability to detect repeatable regions. As the input to our algorithm, we are given only two sets of regions in two shapes; no descriptors are provided so…

Graphics · Computer Science 2012-10-01 J. Pokrass , A. M. Bronstein , M. M. Bronstein , P. Sprechmann , G. Sapiro

In Index coding there is a single sender with multiple messages and multiple receivers each wanting a different set of messages and knowing a different set of messages a priori. The Index Coding problem is to identify the minimum number of…

Information Theory · Computer Science 2015-04-21 Kavitha. R , B. Sundar Rajan

Vector perturbation is an encoding method for broadcast channels in which the transmitter solves a shortest vector problem in a lattice to create a perturbation vector, which is then added to the data before transmission. In this work, we…

Information Theory · Computer Science 2016-04-26 David A. Karpuk , Amaro Barreal , Oliver W. Gnilke , Camilla Hollanti

A spread code is a set of vector spaces of a fixed dimension over a finite field Fq with certain properties used for random network coding. It can be constructed in different ways which lead to different decoding algorithms. In this work we…

Information Theory · Computer Science 2014-06-20 Felice Manganiello , Anna-Lena Trautmann

Stochastic encoders for channel coding and lossy source coding are introduced with a rate close to the fundamental limits, where the only restriction is that the channel input alphabet and the reproduction alphabet of the lossy source code…

Information Theory · Computer Science 2016-11-15 Jun Muramatsu

The vast existing wireless infrastructure features a variety of systems and standards. It is of significant practical value to introduce new features and devices without changing the physical layer/hardware infrastructure, but upgrade it…

Information Theory · Computer Science 2012-02-03 Petar Popovski , Zoran Utkovski

We focus on designing error-correcting codes for the symmetric Gaussian broadcast channel with feedback. Feedback not only expands the capacity region of the broadcast channel but also enhances transmission reliability. In this work, we…

Information Theory · Computer Science 2025-03-04 Yingyao Zhou , Natasha Devroye

The problem of low complexity, close to optimal, channel decoding of linear codes with short to moderate block length is considered. It is shown that deep learning methods can be used to improve a standard belief propagation decoder,…

Information Theory · Computer Science 2018-03-14 Eliya Nachmani , Elad Marciano , Loren Lugosch , Warren J. Gross , David Burshtein , Yair Beery

In this paper, we propose \textit{coded compressive sensing} that recovers an $n$-dimensional integer sparse signal vector from a noisy and quantized measurement vector whose dimension $m$ is far-fewer than $n$. The core idea of coded…

Information Theory · Computer Science 2016-01-27 Namyoon Lee , Song-Nam Hong