English
Related papers

Related papers: Distill-to-Label: Weakly Supervised Instance Label…

200 papers

In the context of label-efficient learning on video data, the distillation method and the structural design of the teacher-student architecture have a significant impact on knowledge distillation. However, the relationship between these…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Chao Wang , Zheng Tang

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

Weakly supervised object detection (WSOD) is a challenging task that requires simultaneously learn object classifiers and estimate object locations under the supervision of image category labels. A major line of WSOD methods roots in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Shiwei Zhang , Wei Ke , Lin Yang

Weakly-supervised temporal action localization aims to localize and recognize actions in untrimmed videos with only video-level category labels during training. Without instance-level annotations, most existing methods follow the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Huan Ren , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

State-of-the-art CNN based recognition models are often computationally prohibitive to deploy on low-end devices. A promising high level approach tackling this limitation is knowledge distillation, which let small student model mimic…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Tao Wang , Li Yuan , Xiaopeng Zhang , Jiashi Feng

Classification of gigapixel Whole Slide Images (WSIs) is an important prediction task in the emerging area of computational pathology. There has been a surge of research in deep learning models for WSI classification with clinical…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Sajid Javed , Arif Mahmood , Talha Qaiser , Naoufel Werghi , Nasir Rajpoot

Deep Learning has emerged as a promising approach for skin lesion analysis. However, existing methods mostly rely on fully supervised learning, requiring extensive labeled data, which is challenging and costly to obtain. To alleviate this…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Siyamalan Manivannan

Deep learning models have revolutionized the field of medical image analysis, due to their outstanding performances. However, they are sensitive to spurious correlations, often taking advantage of dataset bias to improve results for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Diogo J. Araújo , M. Rita Verdelho , Alceu Bissoto , Jacinto C. Nascimento , Carlos Santiago , Catarina Barata

Analysis of histopathology slides is a critical step for many diagnoses, and in particular in oncology where it defines the gold standard. In the case of digital histopathological analysis, highly trained pathologists must review vast…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Pierre Courtiol , Eric W. Tramel , Marc Sanselme , Gilles Wainrib

A growing number of machine learning scenarios rely on knowledge distillation where one uses the output of a surrogate model as labels to supervise the training of a target model. In this work, we provide a sharp characterization of this…

Machine Learning · Statistics 2025-02-28 M. Emrullah Ildiz , Halil Alperen Gozeten , Ege Onur Taga , Marco Mondelli , Samet Oymak

Deep learning has achieved remarkable progress for visual recognition on large-scale balanced datasets but still performs poorly on real-world long-tailed data. Previous methods often adopt class re-balanced training strategies to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Tianhao Li , Limin Wang , Gangshan Wu

Multiple instance learning (MIL) is a powerful tool to solve the weakly supervised classification in whole slide image (WSI) based pathology diagnosis. However, the current MIL methods are usually based on independent and identical…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zhuchen Shao , Hao Bian , Yang Chen , Yifeng Wang , Jian Zhang , Xiangyang Ji , Yongbing Zhang

Although existing semantic segmentation approaches achieve impressive results, they still struggle to update their models incrementally as new categories are uncovered. Furthermore, pixel-by-pixel annotations are expensive and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Fabio Cermelli , Dario Fontanel , Antonio Tavera , Marco Ciccone , Barbara Caputo

Histopathology image analysis can be considered as a Multiple instance learning (MIL) problem, where the whole slide histopathology image (WSI) is regarded as a bag of instances (i.e, patches) and the task is to predict a single class label…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Meng Li , Lin Wu , Arnold Wiliem , Kun Zhao , Teng Zhang , Brian C. Lovell

We propose a new formulation of Multiple-Instance Learning (MIL). In typical MIL settings, a unit of data is given as a set of instances called a bag and the goal is to find a good classifier of bags based on similarity from a single or…

Machine Learning · Computer Science 2018-12-11 Daiki Suehiro , Kohei Hatano , Eiji Takimoto , Shuji Yamamoto , Kenichi Bannai , Akiko Takeda

Breast cancer prediction models for mammography assume that annotations are available for individual images or regions of interest (ROIs), and that there is a fixed number of images per patient. These assumptions do not hold in real…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Shreyasi Pathak , Jörg Schlötterer , Jeroen Geerdink , Jeroen Veltman , Maurice van Keulen , Nicola Strisciuglio , Christin Seifert

Multiple Instance Learning (MIL) has become the predominant approach for classification tasks on gigapixel histopathology whole slide images (WSIs). Within the MIL framework, single WSIs (bags) are decomposed into patches (instances), with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Daniel Sens , Ario Sadafi , Francesco Paolo Casale , Nassir Navab , Carsten Marr

Skin cancer is a major concern to public health, accounting for one-third of the reported cancers. If not detected early, the cancer has the potential for severe consequences. Recognizing the critical need for effective skin cancer…

Image and Video Processing · Electrical Eng. & Systems 2024-07-01 Niful Islam , Khan Md Hasib , Fahmida Akter Joti , Asif Karim , Sami Azam

The existing solutions for object detection distillation rely on the availability of both a teacher model and ground-truth labels. We propose a new perspective to relax this constraint. In our framework, a student is first trained with…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Amin Banitalebi-Dehkordi

We apply deep learning (DL) on Magnetic resonance spectroscopy (MRS) data for the task of brain tumor detection. Medical applications often suffer from data scarcity and corruption by noise. Both of these problems are prominent in our data…

Machine Learning · Computer Science 2021-12-17 Diyuan Lu , Gerhard Kurz , Nenad Polomac , Iskra Gacheva , Elke Hattingen , Jochen Triesch