English
Related papers

Related papers: Guided Distillation for Semi-Supervised Instance S…

200 papers

Segmenting tumors in histological images is vital for cancer diagnosis. While fully supervised models excel with pixel-level annotations, creating such annotations is labor-intensive and costly. Accurate histopathology image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yinsheng He , Xingyu Li , Roger J. Zemp

Despite the significant progress that depth-based 3D hand pose estimation methods have made in recent years, they still require a large amount of labeled training data to achieve high accuracy. However, collecting such data is both costly…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Mohammad Rezaei , Farnaz Farahanipad , Alex Dillhoff , Vassilis Athitsos

In semantic segmentation, the creation of pixel-level labels for training data incurs significant costs. To address this problem, semi-supervised learning, which utilizes a small number of labeled images alongside unlabeled images to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Takahiro Mano , Reiji Saito , Kazuhiro Hotta

Food instance segmentation is essential to estimate the serving size of dishes in a food image. The recent cutting-edge techniques for instance segmentation are deep learning networks with impressive segmentation quality and fast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Huu-Thanh Nguyen , Yu Cao , Chong-Wah Ngo , Wing-Kwong Chan

The success of existing salient object detection models relies on a large pixel-wise labeled training dataset, which is time-consuming and expensive to obtain. We study semi-supervised salient object detection, with access to a small number…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Jiawei Liu , Jing Zhang , Nick Barnes

Instance segmentation demands costly per-pixel annotations and computationally expensive models. We introduce CAST, a semi-supervised knowledge distillation (SSKD) framework that compresses pre-trained vision foundation models (VFM) into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Pardis Taghavi , Tian Liu , Renjie Li , Reza Langari , Zhengzhong Tu

Recent advancements in camera-based 3D object detection have introduced cross-modal knowledge distillation to bridge the performance gap with LiDAR 3D detectors, leveraging the precise geometric information in LiDAR point clouds. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sanmin Kim , Youngseok Kim , Sihwan Hwang , Hyeonjun Jeong , Dongsuk Kum

Algorithmic efficiency techniques such as distillation (\cite{hinton2015distillation}) are useful in improving model quality without increasing serving costs, provided a larger teacher model is available for a smaller student model to learn…

Machine Learning · Computer Science 2025-10-09 Khoa Trinh , Gaurav Menghani , Erik Vee

Semi-supervised learning, i.e., training networks with both labeled and unlabeled data, has made significant progress recently. However, existing works have primarily focused on image classification tasks and neglected object detection…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Yen-Cheng Liu , Chih-Yao Ma , Zijian He , Chia-Wen Kuo , Kan Chen , Peizhao Zhang , Bichen Wu , Zsolt Kira , Peter Vajda

Recent work on distilling Whisper's knowledge into small models using pseudo-labels shows promising performance while reducing the size by up to 50%. This results in small, efficient, and dedicated models. However, a critical step of…

Computation and Language · Computer Science 2025-05-16 Abdul Waheed , Karima Kadaoui , Bhiksha Raj , Muhammad Abdul-Mageed

Active learning generally involves querying the most representative samples for human labeling, which has been widely studied in many fields such as image classification and object detection. However, its potential has not been explored in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jun Wang , Shaoguo Wen , Kaixing Chen , Jianghua Yu , Xin Zhou , Peng Gao , Changsheng Li , Guotong Xie

We present a semi-supervised method for panoptic segmentation based on ConsInstancy regularisation, a novel strategy for semi-supervised learning. It leverages completely unlabelled data by enforcing consistency between predicted instance…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Max Coenen , Tobias Schack , Dries Beyer , Christian Heipke , Michael Haist

Current instance segmentation methods rely heavily on pixel-level annotated images. The huge cost to obtain such fully-annotated images restricts the dataset scale and limits the performance. In this paper, we formally address…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Zhenyu Wang , Yali Li , Shengjin Wang

Improving a semi-supervised image segmentation task has the option of adding more unlabelled images, labelling the unlabelled images or combining both, as neither image acquisition nor expert labelling can be considered trivial in most…

Image and Video Processing · Electrical Eng. & Systems 2019-08-23 Yunguan Fu , Maria R. Robu , Bongjin Koo , Crispin Schneider , Stijn van Laarhoven , Danail Stoyanov , Brian Davidson , Matthew J. Clarkson , Yipeng Hu

Instance-level image classification tasks have traditionally relied on single-instance labels to train models, e.g., few-shot learning and transfer learning. However, set-level coarse-grained labels that capture relationships among…

Machine Learning · Computer Science 2023-11-21 Renyu Zhang , Aly A. Khan , Yuxin Chen , Robert L. Grossman

Multi-label classification is crucial for comprehensive image understanding, yet acquiring accurate annotations is challenging and costly. To address this, a recent study suggests exploiting unsupervised multi-label classification…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Dongseob Kim , Hyunjung Shim

Purpose: In curriculum learning, the idea is to train on easier samples first and gradually increase the difficulty, while in self-paced learning, a pacing function defines the speed to adapt the training progress. While both methods…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Mobarakol Islam , Lalithkumar Seenivasan , S. P. Sharan , V. K. Viekash , Bhavesh Gupta , Ben Glocker , Hongliang Ren

Recent Semi-Supervised Object Detection (SS-OD) methods are mainly based on self-training, i.e., generating hard pseudo-labels by a teacher model on unlabeled data as supervisory signals. Although they achieved certain success, the limited…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Qiushan Guo , Yao Mu , Jianyu Chen , Tianqi Wang , Yizhou Yu , Ping Luo

Weakly supervised instance labeling using only image-level labels, in lieu of expensive fine-grained pixel annotations, is crucial in several applications including medical image analysis. In contrast to conventional instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Jayaraman J. Thiagarajan , Satyananda Kashyap , Alexandros Karagyris

The advancement of knowledge distillation has played a crucial role in enabling the transfer of knowledge from larger teacher models to smaller and more efficient student models, and is particularly beneficial for online and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Wanli Ma , Oktay Karakus , Paul L. Rosin