English
Related papers

Related papers: Bridging Weakly-Supervised Learning and VLM Distil…

200 papers

Volumetric magnetic resonance (MR) image segmentation plays an important role in many clinical applications. Deep learning (DL) has recently achieved state-of-the-art or even human-level performance on various image segmentation tasks.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yousuf Babiker M. Osman , Cheng Li , Weijian Huang , Nazik Elsayed , Zhenzhen Xue , Hairong Zheng , Shanshan Wang

Pre-trained Vision Language Models (VLMs) have demonstrated notable progress in various zero-shot tasks, such as classification and retrieval. Despite their performance, because improving performance on new tasks requires task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jihwan Bang , Sumyeong Ahn , Jae-Gil Lee

Since convolutional neural networks (CNNs) can easily overfit noisy labels, which are ubiquitous in visual classification tasks, it has been a great challenge to train CNNs against them robustly. Various methods have been proposed for this…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yongqi Zhang , Hui Zhang , Quanming Yao , Jun Wan

ConvNets achieve good results when training from clean data, but learning from noisy labels significantly degrades performances and remains challenging. Unlike previous works constrained by many conditions, making them infeasible to real…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Jiangfan Han , Ping Luo , Xiaogang Wang

Deep learning faces a formidable challenge when handling noisy labels, as models tend to overfit samples affected by label noise. This challenge is further compounded by the presence of instance-dependent noise (IDN), a realistic form of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Arpit Garg , Cuong Nguyen , Rafael Felix , Thanh-Toan Do , Gustavo Carneiro

Pre-training on large-scale datasets and then fine-tuning on downstream tasks have become a standard practice in deep learning. However, pre-training data often contain label noise that may adversely affect the generalization of the model.…

Machine Learning · Computer Science 2024-03-12 Hao Chen , Jindong Wang , Ankit Shah , Ran Tao , Hongxin Wei , Xing Xie , Masashi Sugiyama , Bhiksha Raj

Scientific Natural Language Inference (NLI) is the task of predicting the semantic relation between a pair of sentences extracted from research articles. The automatic annotation method based on distant supervision for the training set of…

Computation and Language · Computer Science 2024-06-24 Mobashir Sadat , Cornelia Caragea

Manual annotation of soiling on surround view cameras is a very challenging and expensive task. The unclear boundary for various soiling categories like water drops or mud particles usually results in a large variance in the annotation…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Michal Uricar , Ganesh Sistu , Lucie Yahiaoui , Senthil Yogamani

Supervised learning depends on annotated examples, which are taken to be the \emph{ground truth}. But these labels often come from noisy crowdsourcing platforms, like Amazon Mechanical Turk. Practitioners typically collect multiple labels…

Machine Learning · Computer Science 2018-05-22 Ashish Khetan , Zachary C. Lipton , Anima Anandkumar

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

Machine Learning · Computer Science 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

Large-scale audio tagging datasets inevitably contain imperfect labels, such as clip-wise annotated (temporally weak) tags with no exact on- and offsets, due to a high manual labeling cost. This work proposes pseudo strong labels (PSL), a…

Sound · Computer Science 2022-04-29 Heinrich Dinkel , Zhiyong Yan , Yongqing Wang , Junbo Zhang , Yujun Wang

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as…

Machine Learning · Statistics 2016-12-07 Tan Nguyen , Wanjia Liu , Ethan Perez , Richard G. Baraniuk , Ankit B. Patel

Speaker representation learning is crucial for voice recognition systems, with recent advances in self-supervised approaches reducing dependency on labeled data. Current two-stage iterative frameworks, while effective, suffer from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Danwei Cai , Zexin Cai , Ze Li , Ming Li

Label noise has been broadly observed in real-world datasets. To mitigate the negative impact of overfitting to label noise for deep models, effective strategies (\textit{e.g.}, re-weighting, or loss rectification) have been broadly applied…

Machine Learning · Computer Science 2026-03-19 Haoliang Sun , Qi Wei , Lei Feng , Yupeng Hu , Fan Liu , Hehe Fan , Yilong Yin

Knowledge distillation with unlabeled examples is a powerful training paradigm for generating compact and lightweight student models in applications where the amount of labeled data is limited but one has access to a large pool of unlabeled…

Machine Learning · Computer Science 2023-06-12 Vasilis Kontonis , Fotis Iliopoulos , Khoa Trinh , Cenk Baykal , Gaurav Menghani , Erik Vee

Learning with noisy labels (LNL) aims to ensure model generalization given a label-corrupted training set. In this work, we investigate a rarely studied scenario of LNL on fine-grained datasets (LNL-FG), which is more practical and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Qi Wei , Lei Feng , Haoliang Sun , Ren Wang , Chenhui Guo , Yilong Yin

Pseudo-Labeling has emerged as a simple yet effective technique for semi-supervised object detection (SSOD). However, the inevitable noise problem in pseudo-labels significantly degrades the performance of SSOD methods. Recent advances…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yulin He , Wei Chen , Ke Liang , Yusong Tan , Zhengfa Liang , Yulan Guo

Recent advances in deep learning algorithms have led to significant benefits for solving many medical image analysis problems. Training deep learning models commonly requires large datasets with expert-labeled annotations. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , Stephanie Wichuk , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

Fully-supervised salient object detection (SOD) methods have made great progress, but such methods often rely on a large number of pixel-level annotations, which are time-consuming and labour-intensive. In this paper, we focus on a new…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Runmin Cong , Qi Qin , Chen Zhang , Qiuping Jiang , Shiqi Wang , Yao Zhao , Sam Kwong

Weakly supervised semantic segmentation (WSSS) trains dense pixel-level segmentation models from partial or coarse annotations such as bounding boxes, scribbles, or image-level tags. While recent work leverages foundation models such as the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Stefano Colamonaco , Andrei-Bogdan Florea , Jaron Maene