English
Related papers

Related papers: Don't Fear the Bit Flips: Optimized Coding Strateg…

200 papers

We study the theoretical performance of a combined approach to demodulation and decoding of binary continuous-phase modulated signals under repetition-like codes. This technique is motivated by a need to transmit packetized or framed data…

Information Theory · Computer Science 2014-04-28 Gaurav Thakur

Noisy PN learning is the problem of binary classification when training examples may be mislabeled (flipped) uniformly with noise rate rho1 for positive examples and rho0 for negative examples. We propose Rank Pruning (RP) to solve noisy PN…

Machine Learning · Statistics 2017-08-11 Curtis G. Northcutt , Tailin Wu , Isaac L. Chuang

Departing from traditional communication theory where decoding algorithms are assumed to perform without error, a system where noise perturbs both computational devices and communication channels is considered here. This paper studies…

Information Theory · Computer Science 2010-05-31 Lav R. Varshney

We present a principled framework to address resource allocation for realizing boosting algorithms on substrates with communication or computation noise. Boosting classifiers (e.g., AdaBoost) make a final decision via a weighted vote from…

Machine Learning · Computer Science 2020-10-28 Yongjune Kim , Yuval Cassuto , Lav R. Varshney

Advancements in quantum computing have spurred significant interest in harnessing its potential for speedups over classical systems. However, noise remains a major obstacle to achieving reliable quantum algorithms. In this work, we present…

Quantum Physics · Physics 2025-05-29 Lucas Tecot , Di Luo , Cho-Jui Hsieh

This paper introduces techniques to construct binary polar source/channel codes based on the bit error probability of successive-cancellation decoding. The polarization lemma is reconstructed based on the bit error probability and then…

Information Theory · Computer Science 2022-05-16 Jun Muramatsu

Binary neural networks leverage $\mathrm{Sign}$ function to binarize weights and activations, which require gradient estimators to overcome its non-differentiability and will inevitably bring gradient errors during backpropagation. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Yefei He , Luoming Zhang , Weijia Wu , Hong Zhou

The widespread adoption of deep-learning models in data-driven applications has drawn attention to the potential risks associated with biased datasets and models. Neglected or hidden biases within datasets and models can lead to unexpected…

Machine Learning · Computer Science 2026-01-27 Md Sahidullah , Hye-jin Shim , Rosa Gonzalez Hautamäki , Tomi H. Kinnunen

In successive cancellation (SC) polar decoding, an incorrect estimate of any prior unfrozen bit may bring about severe error propagation in the following decoding, thus it is desirable to find out and correct an error as early as possible.…

Information Theory · Computer Science 2017-12-12 Zhaoyang Zhang , Kangjian Qin , Liang Zhang , Huazi Zhang , Guo Tai Chen

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

In supervised machine learning, models are typically trained using data with hard labels, i.e., definite assignments of class membership. This traditional approach, however, does not take the inherent uncertainty in these labels into…

Machine Learning · Computer Science 2024-09-25 Sjoerd de Vries , Dirk Thierens

We investigate machine learning based on clustering techniques that are suitable for the detection of encoded strings of q-ary symbols transmitted over a noisy channel with partially unknown characteristics. We consider the detection of the…

Signal Processing · Electrical Eng. & Systems 2018-12-24 Kees A. Schouhamer Immink , Kui Cai

Function-level binary code similarity detection is a crucial aspect of cybersecurity. It enables the detection of bugs and patent infringements in released software and plays a pivotal role in preventing supply chain attacks. A practical…

Cryptography and Security · Computer Science 2023-12-27 Sun RuiJin , Guo Shize , Guo Jinhong , Li Wei , Zhan Dazhi , Sun Meng , Pan Zhisong

In this work, we propose a frequency bin-wise method to estimate the single-channel speech presence probability (SPP) with multiple deep neural networks (DNNs) in the short-time Fourier transform domain. Since all frequency bins are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-24 Shuai Tao , Himavanth Reddy , Jesper Rindom Jensen , Mads Græsbøll Christensen

Image classification systems recently made a giant leap with the advancement of deep neural networks. However, these systems require an excessive amount of labeled data to be adequately trained. Gathering a correctly annotated dataset is…

Machine Learning · Computer Science 2021-01-19 Görkem Algan , Ilkay Ulusoy

Modern deep learning systems are data-hungry. Learning with web data is one of the feasible solutions, but will introduce label noise inevitably, which can hinder the performance of deep neural networks. Sample selection is an effective way…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Chao Liang , Linchao Zhu , Humphrey Shi , Yi Yang

The optimization of Binary Neural Networks (BNNs) relies on approximating the real-valued weights with their binarized representations. Current techniques for weight-updating use the same approaches as traditional Neural Networks (NNs) with…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Cuauhtemoc Daniel Suarez-Ramirez , Miguel Gonzalez-Mendoza , Leonardo Chang-Fernandez , Gilberto Ochoa-Ruiz , Mario Alberto Duran-Vega

Learning with Noisy labels (LNL) poses a significant challenge for the Machine Learning community. Some of the most widely used approaches that select as clean samples for which the model itself (the in-training model) has high confidence,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Chen Feng , Georgios Tzimiropoulos , Ioannis Patras

This paper presents a new approach to identifying and eliminating mislabeled training instances for supervised learning. The goal of this approach is to improve classification accuracies produced by learning algorithms by improving the…

Artificial Intelligence · Computer Science 2011-06-02 C. E. Brodley , M. A. Friedl

Despite extensive testing and correctness certification of their functional semantics, a number of compiler optimizations have been shown to violate security guarantees implemented in source code. While prior work has shed light on how such…

Cryptography and Security · Computer Science 2021-09-30 Michael D. Brown , Matthew Pruett , Robert Bigelow , Girish Mururu , Santosh Pande