English
Related papers

Related papers: Efficient Minimum Bayes Risk Decoding using Low-Ra…

200 papers

Parity check matrices (PCMs) are used to define linear error correcting codes and ensure reliable information transmission over noisy channels. The set of codewords of such a code is the null space of this binary matrix. We consider the…

Information Theory · Computer Science 2020-05-12 Luís M. S. Russo , Tobias Dietz , José Rui Figueira , Alexandre P. Francisco , Stefan Ruzika

Reed-Muller (RM) codes are known for their good maximum likelihood (ML) performance in the short block-length regime. Despite being one of the oldest classes of channel codes, finding a low complexity soft-input decoding scheme is still an…

Information Theory · Computer Science 2021-07-28 Marvin Geiselhart , Ahmed Elkelesh , Moustafa Ebada , Sebastian Cammerer , Stephan ten Brink

A complexity-adaptive tree search algorithm is proposed for $\boldsymbol{G}_N$-coset codes that implements maximum-likelihood (ML) decoding by using a successive decoding schedule. The average complexity is close to that of the successive…

Information Theory · Computer Science 2021-09-03 Peihong Yuan , Mustafa Cemil Coşkun

We present a low-complexity and low-latency decoding algorithm for a class of Reed-Muller (RM) subcodes that are defined based on the product of smaller RM codes. More specifically, the input sequence is shaped as a multi-dimensional array,…

Information Theory · Computer Science 2022-02-09 Mohammad Vahid Jamali , Mohammad Fereydounian , Hessam Mahdavifar , Hamed Hassani

This paper revisits the problem of decomposing a positive semidefinite matrix as a sum of a matrix with a given rank plus a sparse matrix. An immediate application can be found in portfolio optimization, when the matrix to be decomposed is…

Optimization and Control · Mathematics 2021-06-16 Michel Baes , Calypso Herrera , Ariel Neufeld , Pierre Ruyssen

The min-sum (MS) algorithm is arguably the second most fundamental algorithm in the realm of message passing due to its optimality (for a tree code) with respect to the {\em block error} probability \cite{Wiberg}. There also seems to be a…

Information Theory · Computer Science 2007-07-13 Kapil Bhattad , Vishwambhar Rathi , Ruediger Urbanke

Weighted low rank approximation is a fundamental problem in numerical linear algebra, and it has many applications in machine learning. Given a matrix $M \in \mathbb{R}^{n \times n}$, a non-negative weight matrix $W \in \mathbb{R}_{\geq…

Machine Learning · Computer Science 2025-02-18 Zhao Song , Mingquan Ye , Junze Yin , Lichen Zhang

Batched sparse (BATS) codes were proposed as a reliable communication solution for networks with packet loss. In the finite-length regime, the error probability of BATS codes under belief propagation (BP) decoding has been studied in the…

Information Theory · Computer Science 2025-02-12 Mingyang Zhu , Shenghao Yang , Ming Jiang , Chunming Zhao

In this paper, we propose two new constructions of exact-repair minimum storage regenerating (exact-MBR) codes. Both constructions obtain the encoded symbols by first treating the message vector over GF(q) as a linearized polynomial and…

Information Theory · Computer Science 2013-01-22 Hongmei Xie , Zhiyuan Yan

The principle of Maximal Coding Rate Reduction (MCR$^2$) has recently been proposed as a training objective for learning discriminative low-dimensional structures intrinsic to high-dimensional data to allow for more robust training than…

Machine Learning · Computer Science 2022-04-04 Christina Baek , Ziyang Wu , Kwan Ho Ryan Chan , Tianjiao Ding , Yi Ma , Benjamin D. Haeffele

Quaternion matrices are employed successfully in many color image processing applications. In particular, a pure quaternion matrix can be used to represent red, green and blue channels of color images. A low-rank approximation for a pure…

Numerical Analysis · Mathematics 2021-01-01 Guangjing Song , Weiyang Ding , Michael K. Ng

We introduce a new method for decoding short and moderate length linear block codes with dense parity-check matrix representations of cyclic form, termed multiple-bases belief-propagation (MBBP). The proposed iterative scheme makes use of…

Information Theory · Computer Science 2016-11-15 Thorsten Hehn , Johannes B. Huber , Olgica Milenkovic , Stefan Laendner

In many autonomous mapping tasks, the maps cannot be accurately constructed due to various reasons such as sparse, noisy, and partial sensor measurements. We propose a novel map prediction method built upon the recent success of Low-Rank…

Robotics · Computer Science 2021-11-02 Zheng Chen , Shi Bai , Lantao Liu

Despite its reduced complexity, lattice reduction-aided decoding exhibits a widening gap to maximum-likelihood (ML) performance as the dimension increases. To improve its performance, this paper presents randomized lattice decoding based on…

Information Theory · Computer Science 2016-11-17 Shuiyin Liu , Cong Ling , Damien Stehlé

Automatic metrics play a crucial role in machine translation. Despite the widespread use of n-gram-based metrics, there has been a recent surge in the development of pre-trained model-based metrics that focus on measuring sentence…

Computation and Language · Computer Science 2023-07-11 Yiming Yan , Tao Wang , Chengqi Zhao , Shujian Huang , Jiajun Chen , Mingxuan Wang

State-of-the-art methods for solving smooth optimization problems are nonlinear conjugate gradient, low memory BFGS, and Majorize-Minimize (MM) subspace algorithms. The MM subspace algorithm which has been introduced more recently has shown…

Optimization and Control · Mathematics 2016-08-24 Emilie Chouzenoux , Jean-Christophe Pesquet

We consider the problem of recovering a lowrank matrix M from a small number of random linear measurements. A popular and useful example of this problem is matrix completion, in which the measurements reveal the values of a subset of the…

Information Theory · Computer Science 2009-10-05 Emmanuel J. Candes , Yaniv Plan

On the heels of compressed sensing, a remarkable new field has very recently emerged. This field addresses a broad range of problems of significant practical interest, namely, the recovery of a data matrix from what appears to be…

Information Theory · Computer Science 2009-03-19 Emmanuel J. Candes , Yaniv Plan

Reed-Muller (RM) codes achieve the capacity of general binary-input memoryless symmetric channels and are conjectured to have a comparable performance to that of random codes in terms of scaling laws. However, such results are established…

Information Theory · Computer Science 2023-08-02 Mohammad Vahid Jamali , Xiyang Liu , Ashok Vardhan Makkuva , Hessam Mahdavifar , Sewoong Oh , Pramod Viswanath

Matrix approximation is a common tool in machine learning for building accurate prediction models for recommendation systems, text mining, and computer vision. A prevalent assumption in constructing matrix approximations is that the…

Machine Learning · Computer Science 2013-01-16 Joonseok Lee , Seungyeon Kim , Guy Lebanon , Yoram Singer