English
Related papers

Related papers: Network Recovery from Unlabeled Noisy Samples

200 papers

Recent studies on the memorization effects of deep neural networks on noisy labels show that the networks first fit the correctly-labeled training samples before memorizing the mislabeled samples. Motivated by this early-learning…

Machine Learning · Computer Science 2021-09-07 Yangdi Lu , Yang Bo , Wenbo He

Models of growing networks are a central topic in network science. In these models, vertices are usually labeled by their arrival time, distinguishing even those node pairs whose structural roles are identical. In contrast, unlabeled…

Physics and Society · Physics 2025-09-23 Harrison Hartle , Brennan Klein , Dmitri Krioukov , P. L. Krapivsky

Training deep neural network (DNN) with noisy labels is practically challenging since inaccurate labels severely degrade the generalization ability of DNN. Previous efforts tend to handle part or full data in a unified denoising flow via…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Boshen Zhang , Yuxi Li , Yuanpeng Tu , Jinlong Peng , Yabiao Wang , Cunlin Wu , Yang Xiao , Cairong Zhao

In the field of medical image analysis, deep learning models have demonstrated remarkable success in enhancing diagnostic accuracy and efficiency. However, the reliability of these models is heavily dependent on the quality of training…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Maolin Li , Giacomo Tarroni

In Gaussian graphical model selection, noise-corrupted samples present significant challenges. It is known that even minimal amounts of noise can obscure the underlying structure, leading to fundamental identifiability issues. A recent line…

Machine Learning · Statistics 2024-05-09 Abrar Zahin , Rajasekhar Anguluri , Lalitha Sankar , Oliver Kosut , Gautam Dasarathy

In "Unlabeled Sensing", one observes a set of linear measurements of an underlying signal with incomplete or missing information about their ordering, which can be modeled in terms of an unknown permutation. Previous work on the case of a…

Information Theory · Computer Science 2020-07-14 Hang Zhang , Martin Slawski , Ping Li

This paper considers a noisy data structure recovery problem. The goal is to investigate the following question: Given a noisy observation of a permuted data set, according to which permutation was the original data sorted? The focus is on…

Information Theory · Computer Science 2020-11-24 Minoh Jeong , Alex Dytso , Martina Cardone , H. Vincent Poor

Regression methods assume that accurate labels are available for training. However, in certain scenarios, obtaining accurate labels may not be feasible, and relying on multiple specialists with differing opinions becomes necessary. Existing…

Machine Learning · Statistics 2023-05-15 Milene Regina dos Santos , Rafael Izbicki

Graph Neural Networks (GNNs) have achieved promising results for semi-supervised learning tasks on graphs such as node classification. Despite the great success of GNNs, many real-world graphs are often sparsely and noisily labeled, which…

Machine Learning · Computer Science 2021-06-10 Enyan Dai , Charu Aggarwal , Suhang Wang

We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to…

Machine Learning · Computer Science 2019-06-04 Duc Tam Nguyen , Thi-Phuong-Nhung Ngo , Zhongyu Lou , Michael Klar , Laura Beggel , Thomas Brox

In this paper, we consider the graph alignment problem, which is the problem of recovering, given two graphs, a one-to-one mapping between nodes that maximizes edge overlap. This problem can be viewed as a noisy version of the well-known…

Machine Learning · Statistics 2022-01-14 Georgina Hall , Laurent Massoulié

The structure of a network is an unlabeled graph, yet graphs in most models of complex networks are labeled by meaningless random integers. Is the associated labeling noise always negligible, or can it overpower the network-structural…

Physics and Society · Physics 2022-11-21 Jeremy Paton , Harrison Hartle , Huck Stepanyants , Pim van der Hoorn , Dmitri Krioukov

We prove the first guarantees of sparse recovery for ReLU neural networks, where the sparse network weights constitute the signal to be recovered. Specifically, we study structural properties of the sparse network weights for two-layer,…

Machine Learning · Computer Science 2026-03-03 Sara Fridovich-Keil , Mert Pilanci

Over-parameterized deep neural networks trained by simple first-order methods are known to be able to fit any labeling of data. Such over-fitting ability hinders generalization when mislabeled training examples are present. On the other…

Machine Learning · Computer Science 2020-10-06 Wei Hu , Zhiyuan Li , Dingli Yu

Classical multidimensional scaling is an important dimension reduction technique. Yet few theoretical results characterizing its statistical performance exist. This paper provides a theoretical framework for analyzing the quality of…

Statistics Theory · Mathematics 2020-07-09 Anna Little , Yuying Xie , Qiang Sun

Noisy labels are common in large-scale medical imaging datasets due to inter-observer variability and ambiguous cases. We propose a statistically grounded and task-agnostic framework, Standardized Loss Aggregation (SLA), for detecting noisy…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Inhyuk Park , Doohyun Park

In federated learning, federated unlearning is a technique that provides clients with a rollback mechanism that allows them to withdraw their data contribution without training from scratch. However, existing research has not considered…

Machine Learning · Computer Science 2024-12-23 Xinrui Yu , Wenbin Pei , Bing Xue , Qiang Zhang

Consider the following fundamental learning problem: given input examples $x \in \mathbb{R}^d$ and their vector-valued labels, as defined by an underlying generative neural network, recover the weight matrices of this network. We consider…

Data Structures and Algorithms · Computer Science 2018-11-06 Ainesh Bakshi , Rajesh Jayaram , David P. Woodruff

Given data with noisy labels, over-parameterized deep networks suffer overfitting mislabeled data, resulting in poor generalization. The memorization effect of deep networks shows that although the networks have the ability to memorize all…

Machine Learning · Computer Science 2024-04-30 Jingyi Wang , Xiaobo Xia , Long Lan , Xinghao Wu , Jun Yu , Wenjing Yang , Bo Han , Tongliang Liu

Networks are widely used in many fields for their powerful ability to provide vivid representations of relationships between variables. However, many of them may be corrupted by experimental noise or inappropriate network inference methods…

Molecular Networks · Quantitative Biology 2021-09-21 Jiating Yu , Jiacheng Leng , Ling-Yun Wu