English
Related papers

Related papers: Decoding noisy messages: a method that just should…

200 papers

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

We consider the problem of estimating a low-rank matrix from a noisy observed matrix. Previous work has shown that the optimal method depends crucially on the choice of loss function. In this paper, we use a family of weighted loss…

Statistics Theory · Mathematics 2021-04-08 William Leeb

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani

State-of-the-art abstractive summarization systems frequently hallucinate content that is not supported by the source document, mainly due to noise in the training dataset. Existing methods opt to drop the noisy samples or tokens from the…

Computation and Language · Computer Science 2023-02-20 Meng Cao , Yue Dong , Jingyi He , Jackie Chi Kit Cheung

Machine language acquisition is often presented as a problem of imitation learning: there exists a community of language users from which a learner observes speech acts and attempts to decode the mappings between utterances and situations.…

Machine Learning · Computer Science 2025-08-20 Dylan Cope , Peter McBurney

Instead of treating the noise as a detrimental effect, can we use it as an information carrier? In this letter, we provide the conceptual and mathematical foundations of wireless communication utilizing noise and random signals in general.…

Information Theory · Computer Science 2023-12-22 Ertugrul Basar

A short survey is provided about our recent explorations of the young topic of noise-based logic. After outlining the motivation behind noise-based computation schemes, we present a short summary of our ongoing efforts in the introduction,…

Data Analysis, Statistics and Probability · Physics 2012-03-15 Laszlo B. Kish , Sunil P. Khatri , Sergey M. Bezrukov , Ferdinand Peper , Zoltan Gingl , Tamas Horvath

A string is sent over a noisy channel that erases some of its characters. Knowing the statistical properties of the string's source and which characters were erased, a listener that is equipped with an ability to test the veracity of a…

Information Theory · Computer Science 2013-11-27 Mark M. Christiansen , Ken R. Duffy , Flavio du Pin Calmon , Muriel Medard

An improved inference method for densely connected systems is presented. The approach is based on passing condensed messages between variables, representing macroscopic averages of microscopic messages. We extend previous work that showed…

Information Theory · Computer Science 2009-11-11 Juan P. Neirotti , David Saad

This paper investigates coordination problems over packet-based communication channels. We consider the scenario in which the communication between network nodes is corrupted by unknown-but-bounded noise. We introduce a novel coordination…

Systems and Control · Computer Science 2018-08-14 Mingming Shi , Pietro Tesi , Claudio De Persis

Quantum error correction protocols have been developed to offset the high sensitivity to noise inherent in quantum systems. However, much is still unknown about the behaviour of a quantum error-correcting code under general noise, including…

Quantum Physics · Physics 2021-06-09 Stefanie J. Beale , Joel J. Wallman

Many satellite communication systems operating today employ low cost upconverters or downconverters which create phase noise. This noise can severely limit the information rate of the system and pose a serious challenge for the detection…

Information Theory · Computer Science 2012-10-19 Shachar Shayovitz , Dan Raphaeli

Despite considerable advancements with deep neural language models, the enigma of neural text degeneration persists when these models are tested as text generators. The counter-intuitive empirical observation is that even though the use of…

Computation and Language · Computer Science 2020-02-18 Ari Holtzman , Jan Buys , Li Du , Maxwell Forbes , Yejin Choi

A real-time communication system with two encoders communicating with a single receiver over separate noisy channels is considered. The two encoders make distinct partial observations of a Markov source. Each encoder must encode its…

Information Theory · Computer Science 2009-10-27 Ashutosh Nayyar , Demosthenis Teneketzis

We use an artificial neural network to analyze asymmetric noisy random telegraph signals (RTSs), and extract underlying transition rates. We demonstrate that a long short-term memory neural network can vastly outperform conventional…

Mesoscale and Nanoscale Physics · Physics 2020-07-23 N. J. Lambert , A. A. Esmail , M. Edwards , A. J. Ferguson , H. G. L. Schwefel

To model printing noise a binary noisy channel and a set of controlled gates are introduced. The channel input is an image created by a halftoning algorithm and its output is the printed picture. Using this channel robustness to noise…

Other Computer Science · Computer Science 2015-03-19 V. N. Gorbachev , E. S. Yakovleva

The problem of error-control in random linear network coding is considered. A ``noncoherent'' or ``channel oblivious'' model is assumed where neither transmitter nor receiver is assumed to have knowledge of the channel transfer…

Information Theory · Computer Science 2008-03-25 Ralf Koetter , Frank Kschischang

Channel charting has emerged as a powerful tool for user equipment localization and wireless environment sensing. Its efficacy lies in mapping high-dimensional channel data into low-dimensional features that preserve the relative…

Signal Processing · Electrical Eng. & Systems 2025-09-17 Ge Chen , Panqi Chen , Lei Cheng

We consider signal transaction in a simple neuronal model featuring intrinsic noise. The presence of noise limits the precision of neural responses and impacts the quality of neural signal transduction. We assess the signal transduction…

Biological Physics · Physics 2015-03-17 Michael J. Barber , Manfred L. Ristig

Additive asynchronous and cyclostationary impulsive noise limits communication performance in OFDM powerline communication (PLC) systems. Conventional OFDM receivers assume additive white Gaussian noise and hence experience degradation in…

Machine Learning · Statistics 2016-11-18 Jing Lin , Marcel Nassar , Brian L. Evans