English
Related papers

Related papers: New advances in permutation decoding of first-orde…

200 papers

In this paper we describe a class of codes called {\it permutation codes}. This class of codes is a generalization of cyclic codes and quasi-cyclic codes. We also give some examples of optimal permutation codes over binary, ternary, and…

Information Theory · Computer Science 2019-04-16 Irwansyah , Intan Muchtadi-Alamsyah , Aleams Barra

While large language models (LLMs) demonstrate impressive capabilities across numerous applications, their robustness remains a critical concern. This paper is motivated by a specific vulnerability: the order sensitivity of LLMs. This…

Machine Learning · Computer Science 2025-05-22 Beni Egressy , Jan Stühmer

We present for the first time a general theory of error correction for permutation invariant (PI) codes. Using representation theory of the symmetric group we construct efficient algorithms that can correct any correctible error on any PI…

Quantum Physics · Physics 2026-02-17 Yingkai Ouyang , Gavin K. Brennen

We present a framework for synthesising formulas in first-order logic (FOL) from examples, which unifies and advances state-of-the-art approaches for inference of transition system invariants. To do so, we study and categorise the existing…

Programming Languages · Computer Science 2026-01-08 Ziyi Yang , George Pîrlea , Ilya Sergey

In this work, we present an abstract framework for some algebraic error-correcting codes with the aim of capturing codes that are list-decodable to capacity, along with their decoding algorithm. In the polynomial ideal framework, a code is…

Information Theory · Computer Science 2023-12-21 Siddharth Bhandari , Prahladh Harsha , Mrinal Kumar , Madhu Sudan

Consider a polynomial $F$ in $m$ variables and a finite point ensemble $S=S_1 \times ... \times S_m$. When given the leading monomial of $F$ with respect to a lexicographic ordering we derive improved information on the possible number of…

Information Theory · Computer Science 2011-01-27 Olav Geil , Casper Thomsen

A framework of monomial codes is considered, which includes linear codes generated by the evaluation of certain monomials. Polar and Reed-Muller codes are the two best-known representatives of such codes and can be considered as two extreme…

Information Theory · Computer Science 2021-02-08 Kirill Ivanov , Rüdiger Urbanke

Rank modulation is a way of encoding information to correct errors in flash memory devices as well as impulse noise in transmission lines. Modeling rank modulation involves construction of packings of the space of permutations equipped with…

Information Theory · Computer Science 2011-10-13 Arya Mazumdar , Alexander Barg , Gilles Zémor

The recently introduced polar codes constitute a breakthrough in coding theory due to their capacityachieving property. This goes hand in hand with a quasilinear construction, encoding, and successive cancellation list decoding procedures…

Information Theory · Computer Science 2021-10-19 Kirill Ivanov , Rüdiger Urbanke

The main decoding algorithms for Reed-Solomon codes are based on a bivariate interpolation step, which is expensive in time complexity. Lot of interpolation methods were proposed in order to decrease the complexity of this procedure, but…

Information Theory · Computer Science 2014-07-14 Morgan Barbier

The use of permutation polynomials has appeared, along to their compositional inverses, as a good choice in the implementation of cryptographic systems. Hence, there has been a demand for constructions of these polynomials which…

Number Theory · Mathematics 2020-06-01 Gustavo Terra Bastos

An exact, one-to-one transform is presented that not only allows digital circular convolutions, but is free from multiplications and quantisation errors for transform lengths of arbitrary powers of two. The transform is analogous to the…

Numerical Analysis · Computer Science 2010-05-11 Shekhar S. Chandra

Neural machine translation (NMT) models generally adopt an encoder-decoder architecture for modeling the entire translation process. The encoder summarizes the representation of input sentence from scratch, which is potentially a problem if…

Computation and Language · Computer Science 2018-12-27 Xinwei Geng , Longyue Wang , Xing Wang , Bing Qin , Ting Liu , Zhaopeng Tu

Permutation decoding is a technique which involves finding a subset $S$, called PD-set, of the permutation automorphism group of a code $C$ in order to assist in decoding. An explicit construction of $\left \lfloor{\frac{2^m-m-1}{1+m}}…

Information Theory · Computer Science 2016-05-03 Roland D. Barrolleta , Mercè Villanueva

General error locator polynomials are polynomials able to decode any correctable syndrome for a given linear code. Such polynomials are known to exist for all cyclic codes and for a large class of linear codes. We provide some decoding…

Commutative Algebra · Mathematics 2016-04-01 Chiara Marcolla , Emmanuela Orsini , Massimiliano Sala

Residual networks are an Euler discretization of solutions to Ordinary Differential Equations (ODE). This paper explores a deeper relationship between Transformer and numerical ODE methods. We first show that a residual block of layers in…

Computation and Language · Computer Science 2022-04-13 Bei Li , Quan Du , Tao Zhou , Yi Jing , Shuhan Zhou , Xin Zeng , Tong Xiao , JingBo Zhu , Xuebo Liu , Min Zhang

We consider the problem of discrete-time signal denoising, focusing on a specific family of non-linear convolution-type estimators. Each such estimator is associated with a time-invariant filter which is obtained adaptively, by solving a…

Statistics Theory · Mathematics 2018-06-13 Dmitrii Ostrovskii , Zaid Harchaoui

The problem of storing permutations in a distributed manner arises in several common scenarios, such as efficient updates of a large, encrypted, or compressed data set. This problem may be addressed in either a combinatorial or a coding…

Information Theory · Computer Science 2016-05-05 Netanel Raviv , Eitan Yaakobi , Muriel Medard

In arXiv:2305.03945 [math.NA], a first-order optimization algorithm has been introduced to solve time-implicit schemes of reaction-diffusion equations. In this research, we conduct theoretical studies on this first-order algorithm equipped…

Numerical Analysis · Mathematics 2025-04-01 Shu Liu , Xinzhe Zuo , Stanley Osher , Wuchen Li

Undetected errors are important for linear codes, which are the only type of errors after hard decision and automatic-repeat-request (ARQ), but do not receive much attention on their correction. In concatenated channel coding, suboptimal…

Information Theory · Computer Science 2019-01-09 Jingzhao Wang , Yuan Luo