English
Related papers

Related papers: An Algebraic View to Gradient Descent Decoding

200 papers

We examine gradient descent on unregularized logistic regression problems, with homogeneous linear predictors on linearly separable datasets. We show the predictor converges to the direction of the max-margin (hard margin SVM) solution. The…

Machine Learning · Statistics 2024-10-29 Daniel Soudry , Elad Hoffer , Mor Shpigel Nacson , Suriya Gunasekar , Nathan Srebro

The interpolation step of Guruswami and Sudan's list decoding of Reed-Solomon codes poses the problem of finding the minimal polynomial of an ideal with respect to a certain monomial order. An efficient algorithm that solves the problem is…

Commutative Algebra · Mathematics 2007-12-11 Kwankyu Lee , Michael E. O'Sullivan

In this paper, we introduce a deep learning-based decoder designed for concatenated coding schemes over a deletion/substitution channel. Specifically, we focus on serially concatenated codes, where the outer code is either a convolutional…

Information Theory · Computer Science 2024-10-15 E. Uras Kargı , Tolga M. Duman

Decoding of convolutional codes poses a significant challenge for coding theory. Classical methods, based on e.g. Viterbi decoding, suffer from being computationally expensive and are restricted therefore to codes of small complexity. Based…

Information Theory · Computer Science 2009-09-04 Jose Ignacio Iglesias Curto , Uwe Helmke

We consider binary systematic network codes and investigate their capability of decoding a source message either in full or in part. We carry out a probability analysis, derive closed-form expressions for the decoding probability and show…

Information Theory · Computer Science 2016-11-15 Andrew L. Jones , Ioannis Chatzigeorgiou , Andrea Tassi

The sum-product algorithm for decoding of binary codes is analyzed for bipartite graphs in which the check nodes all have degree $2$. The algorithm simplifies dramatically and may be expressed using linear algebra. Exact results about the…

Information Theory · Computer Science 2014-11-11 John O. Brevik , Michael E. O'Sullivan

We introduce the new concept of computation coding. Similar to how rate-distortion theory is concerned with the lossy compression of data, computation coding deals with the lossy computation of functions. Particularizing to linear…

Information Theory · Computer Science 2021-02-02 Ralf Müller , Bernhard Gäde , Ali Bereyhi

In previous work, we demonstrated how decoding of a non-binary linear code could be formulated as a linear-programming problem. In this paper, we study different polytopes for use with linear-programming decoding, and show that for many…

Information Theory · Computer Science 2016-11-18 Vitaly Skachek , Mark F. Flanagan , Eimear Byrne , Marcus Greferath

Practically good error-correcting codes should have good parameters and efficient decoding algorithms. Some algebraically defined good codes such as cyclic codes, Reed-Solomon codes, and Reed-Muller codes have nice decoding algorithms.…

Information Theory · Computer Science 2019-11-19 Lucky Galvez , Jon-Lark Kim

In this paper, we develop a new decomposition technique for solving bi-objective linear programming problems. The proposed methodology combines the bi-objective simplex algorithm with Benders decomposition and can be used to obtain a…

Optimization and Control · Mathematics 2024-09-02 Andrea Raith , Richard Lusby , Ali Akbar Sohrabi Yousefkhan

We consider the problem of determining Gr\"obner bases of binomial ideals associated with linear error correcting codes. Computation of Gr\"obner bases of linear codes have become a topic of interest to many researchers in coding theory…

Information Theory · Computer Science 2017-07-25 Arunkumar R. Patil , Nitin S. Darkunde

In this work we will present algorithms for decoding rank metric codes. First we will look at a new decoding algorithm for Gabidulin codes using the property of Dickson matrices corresponding to linearized polynomials. We will be using a…

Information Theory · Computer Science 2018-02-01 Tovohery Hajatiana Randrianarisoa

An algorithm and associated strategy for solving polynomial systems within the optimization framework is presented. The algorithm and strategy are named, respectively, the penetrating gradient algorithm and the deepest descent strategy. The…

Optimization and Control · Mathematics 2015-01-15 Nikica Hlupic , Ivo Beros

Gradient coding is a technique for straggler mitigation in distributed learning. In this paper we design novel gradient codes using tools from classical coding theory, namely, cyclic MDS codes, which compare favorably with existing…

Information Theory · Computer Science 2019-07-09 Netanel Raviv , Itzhak Tamo , Rashish Tandon , Alexandros G. Dimakis

We consider the disjoint bilinear programming problem in which one of the disjoint subsets has the structure of an acute-angled polytope. An optimality criterion for such a problem is formulated and proved, and based on this, a polynomial…

Optimization and Control · Mathematics 2025-02-13 Dmitrii Lozovanu

We design a polynomial time decoding algorithm for linearized Algebraic Geometry codes with unramified evaluation places, a family of sum-rank metric evaluation codes on division algebras over function fields. By establishing a Serre…

Information Theory · Computer Science 2026-03-13 Elena Berardini , Xavier Caruso , Fabrice Drain

This paper presents the Gradient Flow (GF) decoding for LDPC codes. GF decoding, a continuous-time methodology based on gradient flow, employs a potential energy function associated with bipolar codewords of LDPC codes. The decoding process…

Information Theory · Computer Science 2024-08-02 Tadashi Wadayama , Lantian Wei

We introduce a novel algorithm for decoding binary linear codes by linear programming. We build on the LP decoding algorithm of Feldman et al. and introduce a post-processing step that solves a second linear program that reweights the…

Information Theory · Computer Science 2011-03-16 Amin Khajehnejad , Alexandros G. Dimakis , Babak Hassibi , Benjamin Vigoda , William Bradley

Decoding error-correctiong codes by methods of mathematical optimization, most importantly linear programming, has become an important alternative approach to both algebraic and iterative decoding methods since its introduction by Feldman…

Information Theory · Computer Science 2015-09-04 Michael Helmling

The purpose of this paper is twofold. An immediate practical use of the presented algorithm is its applicability to the parametric solution of underdetermined linear ordinary differential equations (ODEs) with coefficients that are…

Symbolic Computation · Computer Science 2011-08-24 Thomas Wolf