English
Related papers

Related papers: LRPC codes with multiple syndromes: near ideal-siz…

200 papers

Compressed prompts aid instruction-tuned language models (LMs) in overcoming context window limitations and reducing computational costs. Existing methods, which primarily based on training embeddings, face various challenges associated…

Computation and Language · Computer Science 2024-06-04 Hoyoun Jung , Kyung-Joong Kim

Fair-density parity-check (FDPC) codes have been recently introduced demonstrating improved performance compared to low-density parity-check (LDPC) codes standardized in 5G systems particularly in high-rate regimes. In this paper, we…

Information Theory · Computer Science 2025-10-02 Niloufar Hosseinzadeh , Mohsen Moradi , Hessam Mahdavifar

Fault-tolerant quantum computing relies on Quantum Error Correction, which encodes logical qubits into data and parity qubits. Error decoding is the process of translating the measured parity bits into types and locations of errors. To…

Quantum Physics · Physics 2024-04-05 Narges Alavisamani , Suhas Vittal , Ramin Ayanzadeh , Poulami Das , Moinuddin Qureshi

In this paper, we report an encoding and decoding method for irregular-quasic-cyclic low-density parity-check (IR-QC-LDPC) codes with multi rates. The algorithm is applicable to parity-check matrices which have dual-diagonal parity…

Information Theory · Computer Science 2019-10-31 Kun Cheng , Qiming Lu , Hongbo Xie , Qi Shen , Shengkai Liao , Chengzhi Peng

The recently introduced Quantum Lego framework provides a powerful method for generating complex quantum error correcting codes (QECCs) out of simple ones. We gamify this process and unlock a new avenue for code design and discovery using…

Quantum Physics · Physics 2025-06-02 Vincent Paul Su , ChunJun Cao , Hong-Ye Hu , Yariv Yanay , Charles Tahan , Brian Swingle

Post-training quantization of Large Language Models (LLMs) is challenging. In this work, we introduce Low-rank Quantization Error Reduction (LQER), which combines quantization and low-rank approximation to recover the model capability. LQER…

Machine Learning · Computer Science 2024-05-31 Cheng Zhang , Jianyi Cheng , George A. Constantinides , Yiren Zhao

The existence of quantum uncertainty relations is the essential reason that some classically impossible cryptographic primitives become possible when quantum communication is allowed. One direct operational manifestation of these…

Quantum Physics · Physics 2013-12-09 Omar Fawzi , Patrick Hayden , Pranab Sen

The emergence of accurate open large language models (LLMs) has led to a race towards performant quantization techniques which can enable their execution on end-user devices. In this paper, we revisit the problem of "extreme" LLM…

Machine Learning · Computer Science 2024-09-12 Vage Egiazarian , Andrei Panferov , Denis Kuznedelev , Elias Frantar , Artem Babenko , Dan Alistarh

Embedding models play a pivot role in modern NLP applications such as IR and RAG. While the context limit of LLMs has been pushed beyond 1 million tokens, embedding models are still confined to a narrow context window not exceeding 8k…

Computation and Language · Computer Science 2024-11-08 Dawei Zhu , Liang Wang , Nan Yang , Yifan Song , Wenhao Wu , Furu Wei , Sujian Li

Moderate Density Parity Check (MDPC) codes are defined here as codes which have a parity-check matrix whose row weight is $O(\sqrt{n})$ where $n$ is the length $n$ of the code. They can be decoded like LDPC codes but they decode much less…

Information Theory · Computer Science 2018-01-16 Jean-Pierre Tillich

Coding in the projective space has received recently a lot of attention due to its application in network coding. Reduced row echelon form of the linear subspaces and Ferrers diagram can play a key role for solving coding problems in the…

Information Theory · Computer Science 2009-03-14 Tuvi Etzion , Natalia Silberstein

Random Fourier features provide a way to tackle large-scale machine learning problems with kernel methods. Their slow Monte Carlo convergence rate has motivated the research of deterministic Fourier features whose approximation error can…

Machine Learning · Computer Science 2021-10-20 Frederiek Wesel , Kim Batselier

Long-context memory systems often fail under fixed budgets, but end-to-end evaluation does not reveal whether evidence was discarded during compression or preserved but never retrieved. We introduce a four-condition diagnostic protocol that…

Computation and Language · Computer Science 2026-05-26 Jiangnan Yu , Kisson Songqi Lin , Jilong Wu

Background: Leaking sensitive information - such as API keys, tokens, and credentials - in source code remains a persistent security threat. Traditional regex and entropy-based tools often generate high false positives due to limited…

Software Engineering · Computer Science 2025-07-29 Md Nafiu Rahman , Sadif Ahmed , Zahin Wahab , S M Sohan , Rifat Shahriyar

Since Large Language Models or LLMs have demonstrated high-quality performance on many complex language tasks, there is a great interest in bringing these LLMs to mobile devices for faster responses and better privacy protection. However,…

The security of code-based cryptography usually relies on the hardness of the syndrome decoding (SD) problem for the Hamming weight. The best generic algorithms are all improvements of an old algorithm by Prange, and they are known under…

Cryptography and Security · Computer Science 2021-09-16 André Chailloux , Thomas Debris-Alazard , Simona Etinski

Rank-metric codes are subspaces of matrices over finite fields endowed with the rank metric and admit a natural tensorial representation. The tensor rank provides a measure of the minimal size of a decomposition of a code into rank-one…

Information Theory · Computer Science 2026-05-22 Matteo Bonini , Eimear Byrne , Giuseppe Cotardo

This paper considers the performance of $(j,k)$-regular low-density parity-check (LDPC) codes with message-passing (MP) decoding algorithms in the high-rate regime. In particular, we derive the high-rate scaling law for MP decoding of LDPC…

Information Theory · Computer Science 2012-02-01 Fan Zhang , Henry D. Pfister

Security code review is a time-consuming and labor-intensive process typically requiring integration with automated security defect detection tools. However, existing security analysis tools struggle with poor generalization, high false…

Software Engineering · Computer Science 2026-05-12 Jiaxin Yu , Peng Liang , Yujia Fu , Amjed Tahir , Mojtaba Shahin , Chong Wang , Yangxiao Cai

PCM is a popular backing memory for DRAM main memory in tiered memory systems. PCM has asymmetric access energy; writes dominate reads. MLC asymmetry can vary by an order of magnitude. Many schemes have been developed to take advantage of…

Hardware Architecture · Computer Science 2021-12-06 Stephen Longofono , Seyed Mohammad Seyedzadeh , Alex K. Jones