English
Related papers

Related papers: High-performance low-complexity error pattern gene…

200 papers

We consider communication over a noisy network under randomized linear network coding. Possible error mechanism include node- or link- failures, Byzantine behavior of nodes, or an over-estimate of the network min-cut. Building on the work…

Information Theory · Computer Science 2007-11-27 Andrea Montanari , Ruediger Urbanke

We study the problem of minimizing an ordered norm of a load vector (indexed by a set of $d$ resources), where a finite number $n$ of customers $c$ contribute to the load of each resource by choosing a solution $x_c$ in a convex set $X_c…

Data Structures and Algorithms · Computer Science 2026-05-12 Daniel Blankenburg , Antonia Ellerbrock , Thomas Kesselheim , Jens Vygen

Gradient regularization (GR) has been shown to improve the generalizability of trained models. While Natural Gradient Descent has been shown to accelerate optimization in the initial phase of training, little attention has been paid to how…

Machine Learning · Computer Science 2026-03-27 Satya Prakash Dash , Hossein Abdi , Wei Pan , Samuel Kaski , Mingfei Sun

Generative adversarial networks (GANs) with clustered latent spaces can perform conditional generation in a completely unsupervised manner. In the real world, the salient attributes of unlabeled data can be imbalanced. However, most of…

Machine Learning · Computer Science 2022-03-16 Uiwon Hwang , Heeseung Kim , Dahuin Jung , Hyemi Jang , Hyungyu Lee , Sungroh Yoon

This paper proposes a novel approach to improve the training efficiency and the generalization performance of Feed Forward Neural Networks (FFNNs) resorting to an optimal rescaling of input features (OFR) carried out by a Genetic Algorithm…

Machine Learning · Computer Science 2024-02-21 Federico Maria Vitrò , Marco Leonesio , Lorenzo Fagiano

This paper proposes a framework for improving the operational efficiency of automated storage systems under uncertainty. It considers a 2D grid-based storage for uniform-sized loads (e.g., containers, pallets, or totes), which are moved by…

Robotics · Computer Science 2026-01-28 Tzvika Geft , William Zhang , Jingjin Yu , Kostas Bekris

Graph generation is a fundamental problem in various domains, including chemistry and social networks. Recent work has shown that molecular graph generation using recurrent neural networks (RNNs) is advantageous compared to traditional…

Social and Information Networks · Computer Science 2024-02-07 Edo Cohen-Karlik , Eyal Rozenberg , Daniel Freedman

In this paper, we propose an efficient ordered-statistics decoding (OSD) algorithm with an adaptive Gaussian elimination (GE) reduction technique. The proposed decoder utilizes two decoding conditions to adaptively remove GE in OSD. The…

Information Theory · Computer Science 2022-12-26 Chentao Yue , Mahyar Shirvanimoghaddam , Branka Vucetic , Yonghui Li

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

Despite recent advances, standard sequence labeling systems often fail when processing noisy user-generated text or consuming the output of an Optical Character Recognition (OCR) process. In this paper, we improve the noise-aware training…

Computation and Language · Computer Science 2021-05-26 Marcin Namysl , Sven Behnke , Joachim Köhler

We consider transmission over a binary-input additive white Gaussian noise channel using low-density parity-check codes. One of the most popular techniques for decoding low-density parity-check codes is the linear programming decoder. In…

Information Theory · Computer Science 2015-03-19 Shrinivas Kudekar , Jason K. Johnson , Misha Chertkov

We describe an efficient and fault-tolerant algorithm for distributed cyclic garbage collection. The algorithm imposes few requirements on the local machines and allows for flexibility in the choice of local collector and distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 N. Allen , T. Terriberry

CA-Polar codes have been selected for all control channel communications in 5G NR, but accurate, computationally feasible decoders are still subject to development. Here we report the performance of a recently proposed class of optimally…

Information Theory · Computer Science 2021-02-22 Ken Duffy , Amit Solomon , Kishori M. Konwar , Muriel Medard

Shuffling strategies for stochastic gradient descent (SGD), including incremental gradient, shuffle-once, and random reshuffling, are supported by rigorous convergence analyses for arbitrary within-epoch permutations. In particular, random…

Machine Learning · Computer Science 2026-04-02 Lam M. Nguyen , Dzung T. Phan , Jayant Kalagnanam

In this paper, we propose a systematic low density generator matrix (LDGM) code ensemble, which is defined by the Bernoulli process. We prove that, under maximum likelihood (ML) decoding, the proposed ensemble can achieve the capacity of…

Information Theory · Computer Science 2020-01-10 Suihua Cai , Wenchao Lin , Xinyuanmeng Yao , Baodian Wei , Xiao Ma

Clustering is a pivotal challenge in unsupervised machine learning and is often investigated through the lens of mixture models. The optimal error rate for recovering cluster labels in Gaussian and sub-Gaussian mixture models involves ad…

Statistics Theory · Mathematics 2024-07-18 Maximilien Dreveton , Alperen Gözeten , Matthias Grossglauser , Patrick Thiran

A graph generative model defines a distribution over graphs. One type of generative model is constructed by autoregressive neural networks, which sequentially add nodes and edges to generate a graph. However, the likelihood of a graph under…

Machine Learning · Statistics 2021-06-15 Xiaohui Chen , Xu Han , Jiajing Hu , Francisco J. R. Ruiz , Liping Liu

Out-of-distribution (OOD) inputs can compromise the performance and safety of real world machine learning systems. While many methods exist for OOD detection and work well on small scale datasets with lower resolution and few classes, few…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Hong Yang , William Gebhardt , Alexander G. Ororbia , Travis Desell

We establish that it is possible to extract accurate blockwise and bitwise soft output from Guessing Codeword Decoding with minimal additional computational complexity by considering it as a variant of Guessing Random Additive Noise…

Information Theory · Computer Science 2025-12-18 Ken R. Duffy , Peihong Yuan , Joseph Griffin , Muriel Medard

We study universal decoding over unknown discrete additive channels determined by a finite-state (unifilar) random process. Aiming at low-complexity decoders, we study variants of noise-guessing decoders that use estimators for the…

Information Theory · Computer Science 2025-07-24 Henrique K. Miyamoto , Sheng Yang