English
Related papers

Related papers: Syndrome-Enabled Unsupervised Learning for Neural …

200 papers

Real noisy-clean pairs on a large scale are costly and difficult to obtain. Meanwhile, supervised denoisers trained on synthetic data perform poorly in practice. Self-supervised denoisers, which learn only from single noisy images, solve…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Zejin Wang , Jiazheng Liu , Guoqing Li , Hua Han

Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In this context, methods developed for the non-blind case cannot be adapted in a straightforward…

Machine Learning · Computer Science 2026-04-21 Nathan Buskulic , Luca Calatroni , Lorenzo Rosasco , Silvia Villa

Autoencoders are unsupervised deep learning models used for learning representations. In literature, autoencoders have shown to perform well on a variety of tasks spread across multiple domains, thereby establishing widespread…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Maneet Singh , Shruti Nagpal , Mayank Vatsa , Richa Singh , Afzel Noore

In this paper, we consider a recently-proposed model of teaching and learning under uncertainty, in which a teacher receives independent observations of a single bit corrupted by binary symmetric noise, and sequentially transmits to a…

Information Theory · Computer Science 2022-12-09 Yan Hao Ling , Jonathan Scarlett

In this paper, we consider the problem of variable-length coding over the class of memoryless binary asymmetric channels (BACs) with noiseless feedback, including the binary symmetric channel (BSC) as a special case. In 2012, Naghshvar et…

Information Theory · Computer Science 2021-12-01 Hengjie Yang , Minghao Pan , Amaael Antonini , Richard D. Wesel

Deep learning based speech denoising still suffers from the challenge of improving perceptual quality of enhanced signals. We introduce a generalized framework called Perceptual Ensemble Regularization Loss (PERL) built on the idea of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Saurabh Kataria , Jesús Villalba , Najim Dehak

Supervised learning models have been used in various domains such as lending, college admission, face recognition, natural language processing, etc. However, they may inherit pre-existing biases from training data and exhibit discrimination…

Machine Learning · Computer Science 2023-11-08 Mohammad Mahdi Khalili , Xueru Zhang , Mahed Abroshan

This paper proposes crack segmentation augmented by super resolution (SR) with deep neural networks. In the proposed method, a SR network is jointly trained with a binary segmentation network in an end-to-end manner. This joint learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Yuki Kondo , Norimichi Ukita

Being extremely dependent on iterative estimation of the degradation prior or optimization of the model from scratch, the existing blind super-resolution (SR) methods are generally time-consuming and less effective, as the estimation of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Yuanfei Huang , Jie Li , Yanting Hu , Xinbo Gao , Hua Huang

We present a method for supervised learning of sparsity-promoting regularizers for image denoising. Sparsity-promoting regularization is a key ingredient in solving modern image reconstruction problems; however, the operators underlying…

Image and Video Processing · Electrical Eng. & Systems 2020-06-11 Michael T. McCann , Saiprasad Ravishankar

In this paper, we present a sparse neural network decoder (SNND) of polar codes based on belief propagation (BP) and deep learning. At first, the conventional factor graph of polar BP decoding is converted to the bipartite Tanner graph…

Signal Processing · Electrical Eng. & Systems 2018-11-27 Weihong Xu , Xiaohu You , Chuan Zhang , Yair Be'ery

A new polar coding scheme for higher order modulation is presented. The proposed scheme is based on multi-level coding (MLC) with natural labeling, where the bit-level corresponding to the sign-bit is generated in dependence on the previous…

Information Theory · Computer Science 2019-10-30 Onurcan İşcan , Ronald Böhnke , Wen Xu

Error-correcting codes enable reliable communication, yet practical soft decoding remains challenging across code families and block lengths. We propose SB-ECC, a score-based decoder that casts decoding as continuous-time denoising. A…

Machine Learning · Computer Science 2026-05-28 Alon Helvits , Eliya Nachmani

A two-part successive syndrome-check decoding of polar codes is proposed with the first part successively refining the received codeword and the second part checking its syndrome. A new formulation of the successive-cancellation (SC)…

Information Theory · Computer Science 2021-12-02 Seyyed Ali Hashemi , Marco Mondelli , John Cioffi , Andrea Goldsmith

From CNNs to attention mechanisms, encoding inductive biases into neural networks has been a fruitful source of improvement in machine learning. Adding auxiliary losses to the main objective function is a general way of encoding biases that…

Machine Learning · Computer Science 2021-09-07 Ferran Alet , Maria Bauza , Kenji Kawaguchi , Nurullah Giray Kuru , Tomas Lozano-Perez , Leslie Pack Kaelbling

Polar codes are a class of capacity-achieving codes for the binary-input discrete memoryless channels (B-DMCs). However, when applied in channels with intersymbol interference (ISI), the codes may perform poorly with BCJR equalization and…

Information Theory · Computer Science 2014-04-14 Runxin Wang , Rongke Liu , Yi Hou

Neuroprosthetic brain-computer interfaces function via an algorithm which decodes neural activity of the user into movements of an end effector, such as a cursor or robotic arm. In practice, the decoder is often learned by updating its…

Machine Learning · Statistics 2016-09-28 Josh Merel , David Carlson , Liam Paninski , John P. Cunningham

Polar codes have gained significant attention in channel coding for their ability to approach the capacity of binary input discrete memoryless channels (B-DMCs), thanks to their reliability and efficiency in transmission. However, existing…

Information Theory · Computer Science 2025-01-30 Jiaxing Li , Shuwen Zhang , Zhisong Bie

We consider practical hardware implementation of Polar decoders. To reduce latency due to the serial nature of successive cancellation (SC), existing optimizations improve parallelism with two approaches, i.e., multi-bit decision or reduced…

Information Theory · Computer Science 2018-08-07 Huazi Zhang , Jiajie Tong , Rong Li , Pengcheng Qiu , Yourui Huangfu , Chen Xu , Xianbin Wang , Jun Wang

Minimizing cross-entropy over the softmax scores of a linear map composed with a high-capacity encoder is arguably the most popular choice for training neural networks on supervised learning tasks. However, recent works show that one can…

Machine Learning · Statistics 2023-03-03 Florian Graf , Christoph D. Hofer , Marc Niethammer , Roland Kwitt