English
Related papers

Related papers: Smoothing Linear Codes by R\'enyi Divergence and A…

200 papers

The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and…

Information Theory · Computer Science 2019-01-30 Jonathan Scarlett , Volkan Cevher

Despite the effectiveness of recurrent neural network language models, their maximum likelihood estimation suffers from two limitations. It treats all sentences that do not match the ground truth as equally poor, ignoring the structure of…

Computation and Language · Computer Science 2018-05-15 Maha Elbayad , Laurent Besacier , Jakob Verbeek

This paper establishes error bounds for the convergence of a piecewise linear approximation of the constrained optimal smoothing problem posed in a reproducing kernel Hilbert space (RKHS). This problem can be reformulated as a Bayesian…

Statistics Theory · Mathematics 2025-06-24 Laurence Grammont , François Bachoc , Andrés F. López-Lopera

In this letter, the SNR value at which the error performance curve of a soft decision maximum likelihood decoder reaches the slope corresponding to the code minimum distance is determined for a random code. Based on this value, referred to…

Information Theory · Computer Science 2016-11-18 Marc Fossorier

We present an adaptive regularization algorithm that can be effectively applied to the optimization problem in deep learning framework. Our regularization algorithm aims to take into account the fitness of data to the current state of model…

Machine Learning · Computer Science 2019-09-02 Junghee Cho , Junseok Kwon , Byung-Woo Hong

In the torn paper channel, a transmitted codeword is broken at random locations into fragments that arrive at the decoder in an unordered manner. A central theoretical challenge within this model is global alignment -- the task of…

Information Theory · Computer Science 2026-05-25 Junsheng Liu , Netanel Raviv

A recent line of research has shown that gradient-based algorithms with random initialization can converge to the global minima of the training loss for over-parameterized (i.e., sufficiently wide) deep neural networks. However, the…

Machine Learning · Computer Science 2019-06-12 Difan Zou , Quanquan Gu

Sparse coding algorithms are about finding a linear basis in which signals can be represented by a small number of active (non-zero) coefficients. Such coding has many applications in science and engineering and is believed to play an…

Neural and Evolutionary Computing · Computer Science 2016-08-14 András Lőrincz , Zsolt Palotai , Gábor Szirtes

As quantum machine learning continues to develop at a rapid pace, the importance of ensuring the robustness and efficiency of quantum algorithms cannot be overstated. Our research presents an analysis of quantum randomized smoothing, how…

Quantum Physics · Physics 2024-07-26 Nicola Franco , Marie Kempkes , Jakob Spiegelberg , Jeanette Miriam Lorenz

Error correction codes are a crucial part of the physical communication layer, ensuring the reliable transfer of data over noisy channels. The design of optimal linear block codes capable of being efficiently decoded is of major concern,…

Information Theory · Computer Science 2024-05-08 Yoni Choukroun , Lior Wolf

The performance of algebraic soft-decision decoding of Reed-Solomon codes using bit-level soft information is investigated. Optimal multiplicity assignment strategies of algebraic soft-decision decoding with infinite cost are first studied…

Information Theory · Computer Science 2008-08-05 Jing Jiang , Krishna R. Narayanan

A variety of past research on superconducting qubits shows that these devices exhibit considerable variation and thus cannot be accurately depicted by a uniform noise model. To combat this often unrealistic picture of homogeneous noise in…

Quantum Physics · Physics 2026-03-04 Jacob S. Palmer , Kaitlin N. Smith

In this work, we propose a novel information theoretic framework for dictionary learning (DL) and sparse coding (SC) on a statistical manifold (the manifold of probability distributions). Unlike the traditional DL and SC framework, our new…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Rudrasis Chakraborty , Monami Banerjee , Victoria Crawford , Baba C. Vemuri

Starting from a practical use of Reed-Solomon codes in a cryptographic scheme published in Indocrypt'09, this paper deals with the threshold of linear $q$-ary error-correcting codes. The security of this scheme is based on the…

Information Theory · Computer Science 2010-01-15 Bruno Kindarji , Gérard Cohen , Hervé Chabanne

Linear regression is a fundamental and primitive problem in supervised machine learning, with applications ranging from epidemiology to finance. In this work, we propose methods for speeding up distributed linear regression. We do so by…

Information Theory · Computer Science 2024-04-02 Neophytos Charalambides , Hessam Mahdavifar , Mert Pilanci , Alfred O. Hero

A present challenge in wireless communications is the assurance of ultra-reliable and low-latency communication (URLLC). While the reliability aspect is well known to be improved by channel coding with long codewords, this usually implies…

Information Theory · Computer Science 2023-03-15 Sahar Allahkaram , Francisco A. Monteiro , Ioannis Chatzigeorgiou

We introduce and analyze a discrete soft-decision channel called the linear reliability channel (LRC) in which the soft information is the rank ordering of the received symbol reliabilities. We prove that the LRC is an appropriate…

Information Theory · Computer Science 2025-09-11 Alexander Mariona , Ken R. Duffy , Muriel Médard

Quantum error correction is essential for reliable quantum computation, where surface codes demonstrate high fault-tolerant thresholds and hardware efficiency. However, noise in single-shot measurements limits logical readout fidelity,…

Quantum Physics · Physics 2025-05-13 Xiao-Yue Xu , Chen Ding , Wan-Su Bao

Topological quantum error-correcting codes are a promising candidate for building fault-tolerant quantum computers. Decoding topological codes optimally, however, is known to be a computationally hard problem. Various decoders have been…

Quantum Physics · Physics 2020-04-01 Milap Sheth , Sara Zafar Jafarzadeh , Vlad Gheorghiu

Surface codes are among the best candidates to ensure the fault-tolerance of a quantum computer. In order to avoid the accumulation of errors during a computation, it is crucial to have at our disposal a fast decoding algorithm to quickly…

Quantum Physics · Physics 2020-07-15 Nicolas Delfosse , Gilles Zémor
‹ Prev 1 8 9 10 Next ›