English
Related papers

Related papers: Bi-directional Weakly Supervised Knowledge Distill…

200 papers

Knowledge Distillation (KD) utilizes training data as a transfer set to transfer knowledge from a complex network (Teacher) to a smaller network (Student). Several works have recently identified many scenarios where the training data may…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Gaurav Kumar Nayak , Monish Keswani , Sharan Seshadri , Anirban Chakraborty

Fully-supervised salient object detection (SOD) methods have made great progress, but such methods often rely on a large number of pixel-level annotations, which are time-consuming and labour-intensive. In this paper, we focus on a new…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Runmin Cong , Qi Qin , Chen Zhang , Qiuping Jiang , Shiqi Wang , Yao Zhao , Sam Kwong

Knowledge distillation has shown great success in classification, however, it is still challenging for detection. In a typical image for detection, representations from different locations may have different contributions to detection…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Zijian Kang , Peizhen Zhang , Xiangyu Zhang , Jian Sun , Nanning Zheng

Multiple Instance Learning (MIL) is widely used in analyzing histopathological Whole Slide Images (WSIs). However, existing MIL methods do not explicitly model the data distribution, and instead they only learn a bag-level or instance-level…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Linhao Qu , Xiaoyuan Luo , Shaolei Liu , Manning Wang , Zhijian Song

Knowledge distillation extracts general knowledge from a pre-trained teacher network and provides guidance to a target student network. Most studies manually tie intermediate features of the teacher and student, and transfer knowledge…

Machine Learning · Computer Science 2021-02-08 Mingi Ji , Byeongho Heo , Sungrae Park

Deep Learning has emerged as a promising approach for skin lesion analysis. However, existing methods mostly rely on fully supervised learning, requiring extensive labeled data, which is challenging and costly to obtain. To alleviate this…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Siyamalan Manivannan

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

Machine Learning · Computer Science 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout

Label smoothing is widely used in deep neural networks for multi-class classification. While it enhances model generalization and reduces overconfidence by aiming to lower the probability for the predicted class, it distorts the predicted…

Machine Learning · Computer Science 2021-10-12 Mohamed Maher , Meelis Kull

We investigate omni-supervised learning, a special regime of semi-supervised learning in which the learner exploits all available labeled data plus internet-scale sources of unlabeled data. Omni-supervised learning is lower-bounded by…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Ilija Radosavovic , Piotr Dollár , Ross Girshick , Georgia Gkioxari , Kaiming He

Weak supervision learning on classification labels has demonstrated high performance in various tasks, while a few pixel-level fine annotations are also affordable. Naturally a question comes to us that whether the combination of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Jiahui Li , Wen Chen , Xiaodi Huang , Zhiqiang Hu , Qi Duan , Hongsheng Li , Dimitris N. Metaxas , Shaoting Zhang

The segmentation and automatic identification of histological regions of diagnostic interest offer a valuable aid to pathologists. However, segmentation methods are hampered by the difficulty of obtaining pixel-level annotations, which are…

Image and Video Processing · Electrical Eng. & Systems 2023-02-02 Pushpak Pati , Guillaume Jaume , Zeineb Ayadi , Kevin Thandiackal , Behzad Bozorgtabar , Maria Gabrani , Orcun Goksel

Asthma is a chronic inflammatory disorder of the lower respiratory tract and naturally occurs in humans and animals including horses. The annotation of an asthma microscopy whole slide image (WSI) is an extremely labour-intensive task due…

Image and Video Processing · Electrical Eng. & Systems 2021-01-14 Christian Marzahl , Christof A. Bertram , Frauke Wilm , Jörn Voigt , Ann K. Barton , Robert Klopfleisch , Katharina Breininger , Andreas Maier , Marc Aubreville

Computational methods on analyzing Whole Slide Images (WSIs) enable early diagnosis and treatments by supporting pathologists in detection and classification of tumors. However, the extremely high resolution of WSIs makes end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Umar Marikkar , Muhammad Awais , Sara Atito

Fine-grained classification of whole slide images (WSIs) is essential in precision oncology, enabling precise cancer diagnosis and personalized treatment strategies. The core of this task involves distinguishing subtle morphological…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Cheng Jin , Luyang Luo , Huangjing Lin , Jun Hou , Hao Chen

In practical machine learning applications, it is often challenging to assign accurate labels to data, and increasing the number of labeled instances is often limited. In such cases, Weakly Supervised Learning (WSL), which enables training…

Machine Learning · Computer Science 2026-03-24 Tomoya Tate , Kosuke Sugiyama , Masato Uchida

Distillation-based learning boosts the performance of the miniaturized neural network based on the hypothesis that the representation of a teacher model can be used as structured and relatively weak supervision, and thus would be easily…

Machine Learning · Computer Science 2019-04-22 Xiao Jin , Baoyun Peng , Yichao Wu , Yu Liu , Jiaheng Liu , Ding Liang , Junjie Yan , Xiaolin Hu

Semantic segmentation is a core computer vision problem, but the high costs of data annotation have hindered its wide application. Weakly-Supervised Semantic Segmentation (WSSS) offers a cost-efficient workaround to extensive labeling in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Elham Ravanbakhsh , Cheng Niu , Yongqing Liang , J. Ramanujam , Xin Li

This paper introduces a novel approach to leverage features learned from both supervised and self-supervised paradigms, to improve image classification tasks, specifically for vehicle classification. Two state-of-the-art self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Shihan Ma , Jidong J. Yang

Humans have a strong class-agnostic object segmentation ability and can outline boundaries of unknown objects precisely, which motivates us to propose a box-supervised class-agnostic object segmentation (BoxCaseg) based solution for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Xinggang Wang , Jiapei Feng , Bin Hu , Qi Ding , Longjin Ran , Xiaoxin Chen , Wenyu Liu

Pathology computing has dramatically improved pathologists' workflow and diagnostic decision-making processes. Although computer-aided diagnostic systems have shown considerable value in whole slide image (WSI) analysis, the problem of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yonghuang Wu , Xuan Xie , Xinyuan Niu , Chengqian Zhao , Jinhua Yu