English
Related papers

Related papers: Correcting Limited-Magnitude Errors in the Rank-Mo…

200 papers

Motivated by distributed storage applications, we investigate the degree to which capacity achieving encodings can be efficiently updated when a single information bit changes, and the degree to which such encodings can be efficiently…

Information Theory · Computer Science 2013-10-08 Arya Mazumdar , Venkat Chandar , Gregory W. Wornell

Low Rank Parity Check (LRPC) codes form a class of rank-metric error-correcting codes that was purposely introduced to design public-key encryption schemes. An LRPC code is defined from a parity check matrix whose entries belong to a…

Information Theory · Computer Science 2023-09-26 Étienne Burle , Ayoub Otmani

Most low-density parity-check (LDPC) code constructions are considered over finite fields. In this work, we focus on regular LDPC codes over integer residue rings and analyze their performance with respect to the Lee metric. Their…

Information Theory · Computer Science 2024-08-01 Jessica Bariffi , Hannes Bartz , Gianluigi Liva , Joachim Rosenthal

We illustrate how computer-aided methods can be used to investigate the fundamental limits of the caching systems, which are significantly different from the conventional analytical approach usually seen in the information theory…

Information Theory · Computer Science 2018-08-28 Chao Tian

We study the problem of list ranking in the parallel external memory (PEM) model. We observe an interesting dual nature for the hardness of the problem due to limited information exchange among the processors about the structure of the…

Data Structures and Algorithms · Computer Science 2014-09-08 Riko Jacob , Tobias Lieber , Nodari Sitchinava

Processing in memory (PiM) represents a promising computing paradigm to enhance performance of numerous data-intensive applications. Variants performing computing directly in emerging nonvolatile memories can deliver very high energy…

The increasing use of Non-Volatile Memory (NVM) in computer architecture has brought about new challenges, one of which is the write endurance problem. Frequent writes to a particular cache cell in NVM can lead to degradation of the memory…

Hardware Architecture · Computer Science 2024-10-22 Keshav Krishna , Ayush Verma

This paper investigates the classification capability of small-scale spiking neural networks based on the Leaky Integrate-and-Fire (LIF) neuron model. We analyze the relationship between classification accuracy and three factors: the number…

Neurons and Cognition · Quantitative Biology 2026-01-22 Zhengdi Zhang , Cong Han , Wenjun Xia

Training with larger mini-batches improves the convergence rate and can yield superior performance. However, training with large mini-batches becomes prohibitive for Large Language Models (LLMs), due to the large GPU memory requirement. To…

Machine Learning · Computer Science 2025-05-29 Dang Nguyen , Wenhan Yang , Rathul Anand , Yu Yang , Baharan Mirzasoleiman

In this paper we show error bounds for randomly subsampled rank-1 lattices. We pay particular attention to the ratio of the size of the subset to the size of the initial lattice, which is decisive for the computational complexity. In the…

Numerical Analysis · Mathematics 2026-02-12 Felix Bartel , Alexander D. Gilbert , Frances Y. Kuo , Ian H. Sloan

Due to the small size of nanoscale devices, they are highly prone to process disturbances which results in manufacturing defects. Some of the defects are randomly distributed throughout the nanodevice layer. Other disturbances tend to be…

Hardware Architecture · Computer Science 2019-07-11 Hossein Pourmeidani , Mehdi Habibi

Answering multi-hop reasoning questions requires retrieving and synthesizing information from diverse sources. Large Language Models (LLMs) struggle to perform such reasoning consistently. Here we propose an approach to pinpoint and rectify…

Computation and Language · Computer Science 2024-03-01 Mansi Sakarvadia , Aswathy Ajith , Arham Khan , Daniel Grzenda , Nathaniel Hudson , André Bauer , Kyle Chard , Ian Foster

Ternary channels can be used to model the behavior of some memory devices, where information is stored in three different levels. In this paper, error correcting coding for a ternary channel where some of the error transitions are not…

Information Theory · Computer Science 2011-05-31 Nicolas Bitouze , Alexandre Graell i Amat , Eirik Rosnes

We study the combination of two recent coding approaches, in the context of DNA based data storage. Composite DNA alphabets leverage properties of the DNA synthesis and sequencing process. A composite symbol does not represent a single…

Information Theory · Computer Science 2026-05-20 Tomer Cohen , Eitan Yaakobi , Zohar Yakhini

Large Language Models (LLMs) have demonstrated exceptional performance across diverse tasks, yet their training remains highly resource-intensive and susceptible to critical challenges such as training instability. A predominant source of…

Machine Learning · Computer Science 2025-03-03 Tianjin Huang , Ziquan Zhu , Gaojie Jin , Lu Liu , Zhangyang Wang , Shiwei Liu

In this paper, we study properties of rank metric codes in general and maximum rank distance (MRD) codes in particular. For codes with the rank metric, we first establish Gilbert and sphere-packing bounds, and then obtain the asymptotic…

Information Theory · Computer Science 2007-07-13 Maximilien Gadouleau , Zhiyuan Yan

In this paper we study properties and invariants of matrix codes endowed with the rank metric, and relate them to the covering radius. We introduce new tools for the analysis of rank-metric codes, such as puncturing and shortening…

Combinatorics · Mathematics 2016-09-01 Eimear Byrne , Alberto Ravagnani

In this paper, we represent Raptor codes as multi-edge type low-density parity-check (MET-LDPC) codes, which gives a general framework to design them for higher-order modulation using MET density evolution. We then propose an efficient…

Information Theory · Computer Science 2017-01-17 Sachini Jayasooriya , Mahyar Shirvanimoghaddam , Lawrence Ong , Sarah J. Johnson

The beta-binomial (BBM) channel model was recently proposed to model the overdispersed statistics of empirically observed bit errors in multi-level cell (MLC) flash memories. In this paper, we study the capacity of the BBM channel model for…

Information Theory · Computer Science 2016-09-02 Veeresh Taranalli , Hironori Uchikawa , Paul H. Siegel

In this work we present error-correcting codes for random network coding based on rank- metric codes, Ferrers diagrams, and puncturing. For most parameters, the constructed codes are larger than all previously known codes.

Information Theory · Computer Science 2008-07-16 Tuvi Etzion , Natalia Silberstein