English
Related papers

Related papers: Variable-length Convolutional Coding for Short Blo…

200 papers

This paper presents a new technique for deterministic length reduction. This technique improves the running time of the algorithm presented in \cite{LR07} for performing fast convolution in sparse data. While the regular fast convolution of…

Data Structures and Algorithms · Computer Science 2008-02-04 Amihood Amir , Klim Efremenko , Oren Kapah , Ely Porat , Amir Rothschild

We prove that the evidence lower bound (ELBO) employed by variational auto-encoders (VAEs) admits non-trivial solutions having constant posterior variances under certain mild conditions, removing the need to learn variances in the encoder.…

Machine Learning · Computer Science 2021-05-27 Graham Fyffe

Training deep neural networks typically relies on backpropagating high dimensional error signals a computationally intensive process with little evidence supporting its implementation in the brain. However, since most tasks involve…

Machine Learning · Computer Science 2026-01-15 Maher Hanut , Jonathan Kadmon

To achieve higher coding efficiency, Versatile Video Coding (VVC) includes several novel components, but at the expense of increasing decoder computational complexity. These technologies at a low bit rate often create contouring and ringing…

Image and Video Processing · Electrical Eng. & Systems 2021-05-27 Shiba Kuanar , Dwarikanath Mahapatra , Vassilis Athitsos , K. R Rao

Traditional video coding (VVC, HEVC) prioritizes human visual perception, transmitting substantial texture redundancy that severely hinders machine decision-making under constrained bandwidths. In dynamic channels, this redundancy causes…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Chenxing Li , Yiping Duan , Han Jiao , Xiaoming Tao , Weiyao Lin , Mingquan Lu

In this work, we propose Cell Variational Information Bottleneck Network (cellVIB), a convolutional neural network using information bottleneck mechanism, which can be combined with the latest feedforward network architecture in an…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zhonghua Zhai , Chen Ju , Jinsong Lan , Shuai Xiao

Low and ultra-low-bitrate neural speech coding achieves unprecedented coding gain by generating speech signals from compact speech features. This paper introduces additional coding efficiency in neural speech coding by reducing the temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-07 Haici Yang , Wootaek Lim , Minje Kim

Efficient channel state information (CSI) compression at the user equipment plays a key role in enabling accurate channel reconstruction and precoder design in massive multiple-input multiple-output systems. A key challenge lies in…

Information Theory · Computer Science 2026-02-04 Xi Chen , Homa Esfahanizadeh , Foad Sohrabi

We consider a variable-length source coding problem subject to local decodability constraints. In particular, we investigate the blocklength scaling behavior attainable by encodings of $r$-sparse binary sequences, under the constraint that…

Information Theory · Computer Science 2015-04-09 Ashwin Pananjady , Thomas A. Courtade

Online blind source separation is essential for both speech communication and human-machine interaction. Among existing approaches, overdetermined independent vector analysis (OverIVA) delivers strong performance by exploiting the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Kang Chen , Xianrui Wang , Yichen Yang , Andreas Brendel , Gongping Huang , Zbyněk Koldovský , Jingdong Chen , Jacob Benesty , Shoji Makino

Modern applications are driving demand for ultra-reliable low-latency communications, rekindling interest in the performance of short, high-rate error correcting codes. To that end, here we introduce a soft-detection variant of Guessing…

Information Theory · Computer Science 2021-06-16 Ken R. Duffy

The performance of a Turbo code with short block length depends critically on the interleaver design. There are two major criteria in the design of an interleaver: the distance spectrum of the code and the correlation between the…

Combinatorics · Mathematics 2007-07-16 H. R. Sadjadpour , N. J. A. Sloane , M. Salehi , G. Nebe

With the phenomenal growth of the Internet of Things (IoT), Ultra Reliable Low Latency Communications (URLLC) has potentially been the enabler to guarantee the stringent requirements on latency and reliability. However, how to achieve low…

Information Theory · Computer Science 2019-03-15 Xiaoyu Zhao , Wei Chen

Blind recognition of polar codes remains challenging in non-cooperative scenarios, particularly for information-set recognition with known code length. Existing methods mainly rely on threshold decisions determined by the generator-matrix…

Information Theory · Computer Science 2026-05-14 Changwei Tu , Yang Liu , Xianzhao Feng , Kai Niu

This paper investigates task-oriented communication for edge inference, where a low-end edge device transmits the extracted feature vector of a local data sample to a powerful edge server for processing. It is critical to encode the data…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Jiawei Shao , Yuyi Mao , Jun Zhang

In this paper, we propose an efficient reliability based segmentation-discarding decoding (SDD) algorithm for short block-length codes. A novel segmentation-discarding technique is proposed along with the stopping rule to significantly…

Information Theory · Computer Science 2019-01-23 Chentao Yue , Mahyar Shirvanimoghaddam , Yonghui Li , Branka Vucetic

Hyperparameter tuning plays a crucial role in optimizing the performance of predictive learners. Cross--validation (CV) is a widely adopted technique for estimating the error of different hyperparameter settings. Repeated cross-validation…

Machine Learning · Computer Science 2023-08-01 Giovanni Maria Merola

Long-tailed classification is challenging due to its heavy imbalance in class probabilities. While existing methods often focus on overall accuracy or accuracy for tail classes, they overlook a critical aspect: certain types of errors can…

Machine Learning · Computer Science 2025-01-27 Bolian Li , Ruqi Zhang

In this paper, we present a framework for generic decoding of convolutional codes, which allows us to do cryptanalysis of code-based systems that use convolutional codes. We then apply this framework to information set decoding, study…

Information Theory · Computer Science 2025-06-03 Niklas Gassner , Julia Lieb , Abhinaba Mazumder , Michael Schaller

Analog/mixed-signal circuit design encounters significant challenges due to performance degradation from process, voltage, and temperature (PVT) variations. To achieve commercial-grade reliability, iterative manual design revisions and…