English
Related papers

Related papers: Endurance-Limited Memories: Capacity and Codes

200 papers

Quantum error correction is widely thought to be the key to fault-tolerant quantum computation. However, determining the most suited encoding for unknown error channels or specific laboratory setups is highly challenging. Here, we present a…

Cortical neurons are complex, multi-timescale processors wired into recurrent circuits, shaped by long evolutionary pressure under stringent biological constraints. Mainstream machine learning, by contrast, predominantly builds models from…

Machine Learning · Computer Science 2026-05-13 Aaron Spieler , Georg Martius , Anna Levina

Efficiency is a fundamental property of any type of program, but it is even more so in the context of the programs executing on the blockchain (known as smart contracts). This is because optimizing smart contracts has direct consequences on…

Programming Languages · Computer Science 2023-01-13 Elvira Albert , Jesús Correas , Pablo Gordillo , Guillermo Román-Díez , Albert Rubio

We present new lower and upper bounds for the compression rate of binary prefix codes optimized over memoryless sources according to two related exponential codeword length objectives. The objectives explored here are exponential-average…

Information Theory · Computer Science 2011-05-03 Michael B. Baer

We propose efficient coding schemes for two communication settings: 1. asymmetric channels, and 2. channels with an informed encoder. These settings are important in non-volatile memories, as well as optical and broadcast communication. The…

Information Theory · Computer Science 2015-12-31 Eyal En Gad , Yue Li , Joerg Kliewer , Michael Langberg , Anxiao Jiang , Jehoshua Bruck

The input-constrained binary erasure channel (BEC) with strictly causal feedback is studied. The channel input sequence must satisfy the $(0,k)$-runlength limited (RLL) constraint, i.e., no more than $k$ consecutive `$0$'s are allowed. The…

Information Theory · Computer Science 2017-12-08 Ori Peled , Oron Sabag , Haim H. Permuter

Large reasoning models (LRMs) excel on complex problems but face a critical barrier to efficiency: reinforcement learning (RL) training requires long rollouts for outcome-based rewards, where autoregressive decoding dominates time and…

Machine Learning · Computer Science 2026-02-20 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Hao Sun , Chenliang Xu , Jianfeng Gao

In a distributed storage environment, where the data is placed in nodes connected through a network, it is likely that one of these nodes fails. It is known that the use of erasure coding improves the fault tolerance and minimizes the…

Information Theory · Computer Science 2013-05-17 Bernat Gastón , Jaume Pujol , Mercè Villanueva

In recent years, the energy consumption of computing systems has increased and a large fraction of this energy is consumed in main memory. Towards this, researchers have proposed use of non-volatile memory, such as phase change memory…

Hardware Architecture · Computer Science 2013-09-17 Sparsh Mittal

High density Solid State Drives, such as QLC drives, offer increased storage capacity, but a magnitude lower Program and Erase (P/E) cycles, limiting their endurance and hence usability. We present the design and implementation of…

Hardware Architecture · Computer Science 2022-08-02 Shehbaz Jaffer , Kaveh Mahdaviani , Bianca Schroeder

In the age of data revolution, a modern storage~or transmission system typically requires different levels of protection. For example, the coding technique used to fortify data in a modern storage system when the device is fresh cannot be…

Information Theory · Computer Science 2025-12-29 Doğukan Özbayrak , Ahmed Hareedy

We study variable-length feedback (VLF) codes under a strict delay constraint to maximize their average transmission rate (ATR) in a discrete memoryless channel (DMC) while considering periodic decoding attempts. We first derive a lower…

Information Theory · Computer Science 2015-02-25 Seong Hwan Kim , Dan Keun Sung , Tho Le-Ngoc

The question whether RM codes are capacity-achieving is a long-standing open problem in coding theory that was recently answered in the affirmative for transmission over erasure channels [1], [2]. Remarkably, the proof does not rely on…

Information Theory · Computer Science 2016-07-12 Shrinivas Kudekar , Santhosh Kumar , Marco Mondelli , Henry D. Pfister , Rüdiger Urbanke

The explosion of the amount of data stored in cloud systems calls for more efficient paradigms for redundancy. While replication is widely used to ensure data availability, erasure correcting codes provide a much better trade-off between…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-16 Steve Jiekak , Anne-Marie Kermarrec , Nicolas Le Scouarnec , Gilles Straub , Alexandre Van Kempen

Fracton codes have been intensively studied as novel topological states of matter, yet their fault-tolerant properties remain largely unexplored. Here, we investigate the optimal thresholds of self-dual fracton codes, in particular the…

Quantum Physics · Physics 2026-04-29 Giovanni Canossa , Lode Pollet , Miguel A. Martin-Delgado , Hao Song , Ke Liu

This paper proposes an enhanced list-aided successive cancellation stack (ELSCS) decoding algorithm with adjustable decoding complexity. In addition, a logarithmic likelihood ratio (LLR)-threshold based path extension scheme is designed to…

Information Theory · Computer Science 2019-12-18 Haotian Zheng , Bin Chen , Luis F. Abanto-Leon , Zizheng Cao , Ton Koonen

In this work, we introduce Erasure of Language Memory (ELM), a principled approach to concept-level unlearning that operates by matching distributions defined by the model's own introspective classification capabilities. Our key insight is…

Computation and Language · Computer Science 2025-07-23 Rohit Gandikota , Sheridan Feucht , Samuel Marks , David Bau

In-memory deep learning computes neural network models where they are stored, thus avoiding long distance communication between memory and computation units, resulting in considerable savings in energy and time. In-memory deep learning has…

Machine Learning · Computer Science 2021-12-02 Zhehui Wang , Tao Luo , Rick Siow Mong Goh , Wei Zhang , Weng-Fai Wong

We consider the use of extreme learning machines (ELM) for computational partial differential equations (PDE). In ELM the hidden-layer coefficients in the neural network are assigned to random values generated on $[-R_m,R_m]$ and fixed,…

Computational Physics · Physics 2022-06-01 Suchuan Dong , Jielin Yang

Rank modulation has been recently proposed as a scheme for storing information in flash memories. While rank modulation has advantages in improving write speed and endurance, the current encoding approach is based on the "push to the top"…

Information Theory · Computer Science 2011-08-16 Eyal En Gad , Anxiao , Jiang , Jehoshua Bruck