English
Related papers

Related papers: Fine-tuning ORBGRAND with Very Few Channel Soft Va…

200 papers

Ordinal regression is a classification task where classes have an order and prediction error increases the further the predicted class is from the true class. The standard approach for modeling ordinal data involves fitting parallel…

Machine Learning · Computer Science 2022-02-16 Fred Lu , Francis Ferraro , Edward Raff

Belief Propagation (BP) followed by Ordered Statistics Decoding (OSD) has emerged as the gold standard for decoding quantum low-density parity-check (QLDPC) codes. Recent advancements in this field have proposed new methods and algorithms…

Information Theory · Computer Science 2026-05-26 Michele Banfi , Marco Ferrari , Antonino Favano , Alberto Tarable , Luca Barletta

Labeled data is a fundamental component in training supervised deep learning models for computer vision tasks. However, the labeling process, especially for ordinal image classification where class boundaries are often ambiguous, is prone…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Alireza Sedighi Moghaddam , Mohammad Reza Mohammadi

We introduce RandRAND, a new class of randomized preconditioning methods for large-scale linear systems. RandRAND deflates the spectrum via efficient orthogonal projections onto random subspaces, without computing eigenpairs or low-rank…

Numerical Analysis · Mathematics 2025-09-25 Oleg Balabanov , Caleb Ju , Kaiwen He , Aryaman Jeendgar , Michael W. Mahoney

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

Random jammers that overpower transmitted signals are a practical concern for many wireless communication protocols. As such, wireless receivers must be able to cope with standard channel noise and jamming (intentional or unintentional). To…

Information Theory · Computer Science 2023-01-25 Furkan Ercan , Kevin Galligan , David Starobinski , Muriel Medard , Ken R. Duffy , Rabia Tugce Yazicigil

We introduce Noise Recycling, a method that substantially enhances decoding performance of orthogonal channels subject to correlated noise without the need for joint encoding or decoding. The method can be used with any combination of…

Information Theory · Computer Science 2020-06-11 Alejandro Cohen , Amit Solomon , Ken R. Duffy , Muriel Médard

We introduce an ordinate method for noisy data analysis, based solely on rank information and thus insensitive to outliers. The method is nonparametric, objective, and the required data processing is parsimonious. Main ingredients are a…

Data Analysis, Statistics and Probability · Physics 2019-09-11 Glenn Ierley , Alex Kostinski

In the classic wiretap model, Alice wishes to reliably communicate to Bob without being overheard by Eve who is eavesdropping over a degraded channel. Systems for achieving that physical layer security often rely on an error correction code…

Information Theory · Computer Science 2023-04-18 Muriel Médard , Ken R. Duffy

To facilitate applications in IoT, 5G, and beyond, there is an engineering need to enable high-rate, low-latency communications. Errors in physical channels typically arrive in clumps, but most decoders are designed assuming that channels…

Information Theory · Computer Science 2023-04-18 Wei An , Muriel Médard , Ken R. Duffy

We study $\perp$Grad, a geometry-aware modification to gradient-based optimization that constrains descent directions to address overconfidence, a key limitation of standard optimizers in uncertainty-critical applications. By enforcing…

Machine Learning · Computer Science 2025-09-29 C. Evans Hedges

The efficient estimation of an approximate model order is very important for real applications with multi-dimensional data if the observed low-rank data is corrupted by additive noise. In this paper, we present a novel robust method for…

Methodology · Statistics 2022-12-21 Alexey A. Korobkov , Marina K. Diugurova , Jens Haueisen , Martin Haardt

When evaluating the performance of a pre-trained model transferred to a downstream task, it is imperative to assess not only the in-distribution (ID) accuracy of the downstream model but also its capacity to generalize and identify…

Machine Learning · Computer Science 2024-04-02 Andrew Geng , Pin-Yu Chen

Effectively adapting powerful pretrained foundation models to diverse tasks remains a key challenge in AI deployment. Current approaches primarily follow two paradigms:discrete optimization of text prompts through prompt engineering, or…

Computation and Language · Computer Science 2025-08-06 Xiaoming Hou , Jiquan Zhang , Zibin Lin , DaCheng Tao , Shengli Zhang

Objective: Accurate probability estimates are essential for the safe deployment of medical image segmentation models in clinical decision-making. However, modern deep segmentation networks are often poorly calibrated, a problem exacerbated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Meritxell Riera-Marín , Javier García López , Júlia Rodríguez-Comas , Miguel A. González Ballester , Adrian Galdran

The order statistics based list decoding techniques for linear binary block codes of small to medium block length are investigated. The construction of the list of the test error patterns is considered. The original order statistics…

Information Theory · Computer Science 2011-01-27 Saif E. A. Alnawayseh , Pavel Loskot

Recent studies have shown that deep neural networks are not well-calibrated and often produce over-confident predictions. The miscalibration issue primarily stems from using cross-entropy in classifications, which aims to align predicted…

Machine Learning · Computer Science 2025-02-05 Daehwan Kim , Haejun Chung , Ikbeom Jang

This paper considers the problem of code design for a channel where communications and radar systems coexist, modeled as having both Additive White Gaussian Noise (AWGN) and Additive Radar Interference (ARI). The issue of how to adapt or…

Information Theory · Computer Science 2019-04-12 Federico Brunero , Daniela Tuninetti , Natasha Devroye

The problem of learning a channel decoder is considered for two channel models. The first model is an additive noise channel whose noise distribution is unknown and nonparametric. The learner is provided with a fixed codebook and a dataset…

Information Theory · Computer Science 2023-02-17 Amit Tsvieli , Nir Weinberger

This paper investigates guesswork over ordered statistics and formulates the achievable guesswork complexity of ordered statistics decoding (OSD) in binary additive white Gaussian noise (AWGN) channels. The achievable guesswork complexity…

Information Theory · Computer Science 2024-12-18 Chentao Yue , Changyang She , Branka Vucetic , Yonghui Li