English
Related papers

Related papers: Label Semantic Knowledge Distillation for Unbiased…

200 papers

Semantic segmentation requires a holistic understanding of the physical world, as it assigns semantic labels to spatially continuous and structurally coherent objects rather than to isolated pixels. However, existing data-free knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongxuan Sun , Tao Wu

Zero-shot detection (ZSD) is a challenging task where we aim to recognize and localize objects simultaneously, even when our model has not been trained with visual samples of a few target ("unseen") classes. Recently, methods employing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Sandipan Sarma , Sushil Kumar , Arijit Sur

Knowledge Distillation (KD) aims at improving the performance of a low-capacity student model by inheriting knowledge from a high-capacity teacher model. Previous KD methods typically train a student by minimizing a task-related loss and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Mengya Gao , Yujun Shen , Quanquan Li , Junjie Yan , Liang Wan , Dahua Lin , Chen Change Loy , Xiaoou Tang

In this paper, we tackle the problem of Generalized Category Discovery (GCD). Given a dataset containing both labelled and unlabelled images, the objective is to categorize all images in the unlabelled subset, irrespective of whether they…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yuanpei Liu , Kai Han

Scene graph generation is a sophisticated task because there is no specific recognition pattern (e.g., "looking at" and "near" have no conspicuous difference concerning vision, whereas "near" could occur between entities with different…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Xiaoguang Chang , Teng Wang , Changyin Sun , Wenzhe Cai

Single Domain Generalization (SDG) tackles the problem of training a model on a single source domain so that it generalizes to any unseen target domain. While this has been well studied for image classification, the literature on SDG object…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Vidit Vidit , Martin Engilberge , Mathieu Salzmann

Large amounts of labeled data are typically required to train deep learning models. For many real-world problems, however, acquiring additional data can be expensive or even impossible. We present semi-supervised deep kernel learning…

Machine Learning · Computer Science 2019-03-05 Neal Jean , Sang Michael Xie , Stefano Ermon

Knowledge distillation (KD), a technique widely employed in computer vision, has emerged as a de facto standard for improving the performance of small neural networks. However, prevailing KD-based approaches in video tasks primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Guiqin Wang , Peng Zhao , Yanjiang Shi , Cong Zhao , Shusen Yang

The performance of current Scene Graph Generation models is severely hampered by some hard-to-distinguish predicates, e.g., "woman-on/standing on/walking on-beach" or "woman-near/looking at/in front of-child". While general SGG models are…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Xinyu Lyu , Lianli Gao , Yuyu Guo , Zhou Zhao , Hao Huang , Heng Tao Shen , Jingkuan Song

Graph Neural Networks (GNNs) have received increasing attention in many fields. However, due to the lack of prior graphs, their use for semantic labeling has been limited. Here, we propose a novel architecture called the Self-Constructing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Qinghui Liu , Michael Kampffmeyer , Robert Jenssen , Arnt-Børre Salberg

Multi-label image classification is a critical task in machine learning that aims to accurately assign multiple labels to a single image. While existing methods often utilize attention mechanisms or graph convolutional networks to model…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ren-Dong Xie , Zhi-Fen He , Bo Li , Bin Liu , Jin-Yan Hu

Knowledge distillation (KD) has been actively studied for image classification tasks in deep learning, aiming to improve the performance of a student based on the knowledge from a teacher. However, applying KD in image regression with a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Xin Ding , Yongwei Wang , Zuheng Xu , Z. Jane Wang , William J. Welch

Scene Graph Generation is a critical enabler of environmental comprehension for autonomous robotic systems. Most of existing methods, however, are often thwarted by the intricate dynamics of background complexity, which limits their ability…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Xukun Zhou , Zhenbo Song , Jun He , Hongyan Liu , Zhaoxin Fan

Advances in self-distillation have shown that when knowledge is distilled from a teacher to a student using the same deep learning (DL) architecture, the student performance can surpass the teacher particularly when the network is…

Machine Learning · Computer Science 2025-06-25 Muhammad Haseeb Aslam , Clara Martinez , Marco Pedersoli , Alessandro Koerich , Ali Etemad , Eric Granger

Video Scene Graph Generation (VidSGG) aims to capture dynamic relationships among entities by sequentially analyzing video frames and integrating visual and semantic information. However, VidSGG is challenged by significant biases that skew…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yanjun Li , Zhaoyang Li , Honghui Chen , Lizhi Xu

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

Machine Learning · Statistics 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong

Multi-label Recognition (MLR) involves assigning multiple labels to each data instance in an image, offering advantages over single-label classification in complex scenarios. However, it faces the challenge of annotating all relevant…

Machine Learning · Computer Science 2025-06-03 Ruhui Zhang , Hezhe Qiao , Pengcheng Xu , Mingsheng Shang , Lin Chen

Scene Graph Generation (SGG) offers a structured representation critical in many computer vision applications. Traditional SGG approaches, however, are limited by a closed-set assumption, restricting their ability to recognize only…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zuyao Chen , Jinlin Wu , Zhen Lei , Zhaoxiang Zhang , Changwen Chen

Panoptic Scene Graph Generation (PSG) involves the detection of objects and the prediction of their corresponding relationships (predicates). However, the presence of biased predicate annotations poses a significant challenge for PSG…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Li Li , You Qin , Wei Ji , Yuxiao Zhou , Roger Zimmermann

Cross-modal Knowledge Distillation has demonstrated promising performance on paired modalities with strong semantic connections, referred to as Symmetric Cross-modal Knowledge Distillation (SCKD). However, implementing SCKD becomes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Riling Wei , Kelu Yao , Chuanguang Yang , Jin Wang , Zhuoyan Gao , Chao Li