English
Related papers

Related papers: Denoising Diffusion Error Correction Codes

200 papers

One of the main drawback of diffusion models is the slow inference time for image generation. Among the most successful approaches to addressing this problem are distillation methods. However, these methods require considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Senmao Li , Taihang Hu , Joost van de Weijer , Fahad Shahbaz Khan , Tao Liu , Linxuan Li , Shiqi Yang , Yaxing Wang , Ming-Ming Cheng , Jian Yang

Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah

Diffusion models (DM) can gradually learn to remove noise, which have been widely used in artificial intelligence generated content (AIGC) in recent years. The property of DM for eliminating noise leads us to wonder whether DM can be…

Information Theory · Computer Science 2023-09-19 Tong Wu , Zhiyong Chen , Dazhi He , Liang Qian , Yin Xu , Meixia Tao , Wenjun Zhang

Diffusion models excel in solving imaging inverse problems due to their ability to model complex image priors. However, their reliance on large, clean datasets for training limits their practical use where clean data is scarce. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Weimin Bai , Yifei Wang , Wenzheng Chen , He Sun

Error exponents characterize the exponential decay, when increasing message length, of the probability of error of many error-correcting codes. To tackle the long standing problem of computing them exactly, we introduce a general,…

Disordered Systems and Neural Networks · Physics 2007-07-16 Thierry Mora , Olivier Rivoire

Error correction codes (ECC) are crucial for ensuring reliable information transmission in communication systems. Choukroun & Wolf (2022b) recently introduced the Error Correction Code Transformer (ECCT), which has demonstrated promising…

Machine Learning · Computer Science 2024-10-10 Matan Levy , Yoni Choukroun , Lior Wolf

In this paper, faulty successive cancellation decoding of polar codes for the binary erasure channel is studied. To this end, a simple erasure-based fault model is introduced to represent errors in the decoder and it is shown that, under…

Information Theory · Computer Science 2017-11-13 Alexios Balatsoukas-Stimming , Andreas Burg

Diffusion models (DM) can gradually learn to remove noise, which have been widely used in artificial intelligence generated content (AIGC) in recent years. The property of DM for removing noise leads us to wonder whether DM can be applied…

Information Theory · Computer Science 2023-05-17 Tong Wu , Zhiyong Chen , Dazhi He , Liang Qian , Yin Xu , Meixia Tao , Wenjun Zhang

Mitigating errors in computing and communication systems has seen a great deal of research since the beginning of the widespread use of these technologies. However, as we develop new methods to do computation or communication, we also need…

Quantum Physics · Physics 2025-05-20 Oliver Weissl , Evgenii Egorov

Realizing the full potential of quantum computation requires quantum error correction (QEC), with most recent breakthrough demonstrations of QEC using the surface code. QEC codes use multiple noisy physical qubits to encode information in…

When digital data are transmitted over a noisy channel, it is important to have a mechanism allowing recovery against a limited number of errors. Normally, a user string of 0's and 1's, called bits, is encoded by adding a number of…

Information Theory · Computer Science 2019-08-28 Mario Blaum

Error Correcting Output Codes (ECOC) is a successful technique in multi-class classification, which is a core problem in Pattern Recognition and Machine Learning. A major advantage of ECOC over other methods is that the multi- class problem…

Computer Vision and Pattern Recognition · Computer Science 2016-02-22 Miguel Angel Bautista , Oriol Pujol , Fernando de la Torre , Sergio Escalera

We propose an ECG denoising method based on a feed forward neural network with three hidden layers. Particulary useful for very noisy signals, this approach uses the available ECG channels to reconstruct a noisy channel. We tested the…

Computational Engineering, Finance, and Science · Computer Science 2012-12-21 Rui Rodrigues , Paula Couto

The presence of noise is common in signal processing regardless the signal type. Deep neural networks have shown good performance in noise removal, especially on the image domain. In this work, we consider deep neural networks as a…

Machine Learning · Computer Science 2020-07-07 Leslie Casas , Attila Klimmek , Nassir Navab , Vasileios Belagiannis

Pretrained language models have significantly advanced performance across various natural language processing tasks. However, adversarial attacks continue to pose a critical challenge to systems built using these models, as they can be…

Computation and Language · Computer Science 2025-05-20 Zhenhao Li , Huichi Zhou , Marek Rei , Lucia Specia

Distributed computation is a framework used to break down a complex computational task into smaller tasks and distributing them among computational nodes. Erasure correction codes have recently been introduced and have become a popular…

Information Theory · Computer Science 2021-08-17 Royee Yosibash , Ram Zamir

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani

Looped transformers scale computational depth without increasing parameter count by repeatedly applying a shared transformer block and can be used for iterative refinement, where each loop rewrites a full fixed-size prediction in parallel.…

Machine Learning · Computer Science 2026-04-22 Chris Cameron , Wangzheng Wang , Nikita Ivanov , Ashmita Bhattacharyya , Didier Chételat , Yingxue Zhang

With the great success of diffusion models in image generation, diffusion-based image compression is attracting increasing interests. However, due to the random noise introduced in the diffusion learning, they usually produce…

Image and Video Processing · Electrical Eng. & Systems 2026-04-09 Zhenyu Du , Yanbo Gao , Shuai Li , Yiyang Li , Hui Yuan , Mao Ye

In this paper, we study sliding window decoding of braided convolutional codes (BCCs) in the context of a streaming application, where decoder error propagation can be a serious problem. A window extension algorithm and a resynchronization…

Information Theory · Computer Science 2018-01-11 Min Zhu , David G. M. Mitchell , Michael Lentmaier , Daniel J. Costello, , Baoming Bai