English
Related papers

Related papers: Online Label Recovery for Deep Learning-based Comm…

200 papers

Precisely-labeled data sets with sufficient amount of samples are very important for training deep convolutional neural networks (CNNs). However, many of the available real-world data sets contain erroneously labeled samples and those…

Computer Vision and Pattern Recognition · Computer Science 2016-03-03 Samaneh Azadi , Jiashi Feng , Stefanie Jegelka , Trevor Darrell

This paper studies semi-supervised learning of semantic segmentation, which assumes that only a small portion of training images are labeled and the others remain unlabeled. The unlabeled images are usually assigned pseudo labels to be used…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Donghyeon Kwon , Suha Kwak

The performance of a model trained with noisy labels is often improved by simply \textit{retraining} the model with its \textit{own predicted hard labels} (i.e., 1/0 labels). Yet, a detailed theoretical characterization of this phenomenon…

Recent deep networks are capable of memorizing the entire data even when the labels are completely random. To overcome the overfitting on corrupted labels, we propose a novel technique of learning another neural network, called MentorNet,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Lu Jiang , Zhengyuan Zhou , Thomas Leung , Li-Jia Li , Li Fei-Fei

Many modern machine learning applications come with complex and nuanced design goals such as minimizing the worst-case error, satisfying a given precision or recall target, or enforcing group-fairness constraints. Popular techniques for…

Machine Learning · Computer Science 2021-07-13 Harikrishna Narasimhan , Aditya Krishna Menon

We propose a novel adaptive and causal random linear network coding (AC-RLNC) algorithm with forward error correction (FEC) for a point-to-point communication channel with delayed feedback. AC-RLNC is adaptive to the channel condition, that…

Information Theory · Computer Science 2019-09-30 Alejandro Cohen , Derya Malak , Vered Bar Bracha , Muriel Medard

Reliable broadcasting data to multiple receivers over lossy wireless channels is challenging due to the heterogeneity of the wireless link conditions. Automatic Repeat-reQuest (ARQ) based retransmission schemes are bandwidth inefficient due…

Networking and Internet Architecture · Computer Science 2016-12-30 Dong Nguyen , Canh Nguyen , Thuan Duong-Ba , Hung Nguyen , Anh Nguyen , Tuan Tran

Network embedding is a highly effective method to learn low-dimensional node vector representations with original network structures being well preserved. However, existing network embedding algorithms are mostly developed for a single…

Social and Information Networks · Computer Science 2021-05-06 Xiao Shen , Quanyu Dai , Sitong Mao , Fu-lai Chung , Kup-Sze Choi

Large language models (LLMs) have enhanced our ability to rapidly analyze and classify unstructured natural language data. However, concerns regarding cost, network limitations, and security constraints have posed challenges for their…

Machine Learning · Computer Science 2024-11-05 David Farr , Nico Manzonelli , Iain Cruickshank , Jevin West

Error-correcting codes (ECC) are used to reduce multiclass classification tasks to multiple binary classification subproblems. In ECC, classes are represented by the rows of a binary matrix, corresponding to codewords in a codebook.…

Machine Learning · Computer Science 2023-02-13 Itay Evron , Ophir Onn , Tamar Weiss Orzech , Hai Azeroual , Daniel Soudry

Sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing. Large-scale pre-trained language models…

Computation and Language · Computer Science 2020-12-14 Yaqing Wang , Subhabrata Mukherjee , Haoda Chu , Yuancheng Tu , Ming Wu , Jing Gao , Ahmed Hassan Awadallah

In this work, we for the first time present a method for detecting label errors in image datasets with semantic segmentation, i.e., pixel-wise class labels. Annotation acquisition for semantic segmentation datasets is time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Matthias Rottmann , Marco Reese

We propose a self-supervised deep learning-based decoding scheme that enables one-shot decoding of polar codes. In the proposed scheme, rather than using the information bit vectors as labels for training the neural network (NN) through…

Information Theory · Computer Science 2023-08-01 Huiying Song , Yihao Luo , Yuma Fukuzawa

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

Marker code is an effective coding scheme to protect data from insertions and deletions. It has potential applications in future storage systems, such as DNA storage and racetrack memory. When decoding marker codes, perfect channel state…

Information Theory · Computer Science 2025-02-11 Guochen Ma , Xiaopeng Jiao , Jianjun Mu , Hui Han , Yaming Yang

We show that compact fully connected (FC) deep learning networks trained to classify wireless protocols using a hierarchy of multiple denoising autoencoders (AEs) outperform reference FC networks trained in a typical way, i.e., with a…

Networking and Internet Architecture · Computer Science 2019-04-29 Silvija Kokalj-Filipovic , Rob Miller , Joshua Morman

We present a semi-supervised way of training a character-based encoder-decoder recurrent neural network for morphological reinflection, the task of generating one inflected word form from another. This is achieved by using unlabeled tokens…

Computation and Language · Computer Science 2017-07-24 Katharina Kann , Hinrich Schütze

Recently, over-parameterized deep networks, with increasingly more network parameters than training samples, have dominated the performances of modern machine learning. However, when the training data is corrupted, it has been well-known…

Machine Learning · Computer Science 2022-08-04 Sheng Liu , Zhihui Zhu , Qing Qu , Chong You

Using noisy crowdsourced labels from multiple annotators, a deep learning-based end-to-end (E2E) system aims to learn the label correction mechanism and the neural classifier simultaneously. To this end, many E2E systems concatenate the…

Machine Learning · Computer Science 2023-06-07 Shahana Ibrahim , Tri Nguyen , Xiao Fu

Class imbalance is an intrinsic characteristic of multi-label data. Most of the labels in multi-label data sets are associated with a small number of training examples, much smaller compared to the size of the data set. Class imbalance…

Machine Learning · Computer Science 2018-11-07 Bin Liu , Grigorios Tsoumakas