English
Related papers

Related papers: Robust and Accurate Object Detection via Self-Know…

200 papers

Knowledge Distillation (KD) has made remarkable progress in the last few years and become a popular paradigm for model compression and knowledge transfer. However, almost all existing KD algorithms are data-driven, i.e., relying on a large…

Machine Learning · Computer Science 2020-03-03 Gongfan Fang , Jie Song , Chengchao Shen , Xinchao Wang , Da Chen , Mingli Song

Despite that current reading comprehension systems have achieved significant advancements, their promising performances are often obtained at the cost of making an ensemble of numerous models. Besides, existing approaches are also…

Computation and Language · Computer Science 2018-09-18 Minghao Hu , Yuxing Peng , Furu Wei , Zhen Huang , Dongsheng Li , Nan Yang , Ming Zhou

Universal Domain Adaptation (UniDA) targets knowledge transfer in the presence of both covariate and label shifts. Recently, Source-free Universal Domain Adaptation (SF-UniDA) has emerged to achieve UniDA without access to source data,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Sanqing Qu , Tianpei Zou , Lianghua He , Florian Röhrbein , Alois Knoll , Guang Chen , Changjun Jiang

Recent works have shown that optical flow can be learned by deep networks from unlabelled image pairs based on brightness constancy assumption and smoothness prior. Current approaches additionally impose an augmentation regularization term…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jie Yang

Unsupervised domain adaptation (UDA) plays a crucial role in object detection when adapting a source-trained detector to a target domain without annotated data. In this paper, we propose a novel and effective four-step UDA approach that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Mohamed L. Mekhalfi , Davide Boscaini , Fabio Poiesi

Cross domain object detection is a realistic and challenging task in the wild. It suffers from performance degradation due to large shift of data distributions and lack of instance-level annotations in the target domain. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Mengzhe He , Yali Wang , Jiaxi Wu , Yiru Wang , Hanqing Li , Bo Li , Weihao Gan , Wei Wu , Yu Qiao

Object detectors often perform poorly on data that differs from their training set. Domain adaptive object detection (DAOD) methods have recently demonstrated strong results on addressing this challenge. Unfortunately, we identify systemic…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Justin Kay , Timm Haucke , Suzanne Stathatos , Siqi Deng , Erik Young , Pietro Perona , Sara Beery , Grant Van Horn

Rigid point cloud registration is a fundamental problem and highly relevant in robotics and autonomous driving. Nowadays deep learning methods can be trained to match a pair of point clouds, given the transformation between them. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Christian Löwens , Thorben Funke , André Wagner , Alexandru Paul Condurache

Open World Object Detection (OWOD) is a novel and challenging computer vision task that enables object detection with the ability to detect unknown objects. Existing methods typically estimate the object likelihood with an additional…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yulin He , Wei Chen , Yusong Tan , Siqi Wang

Discrete diffusion models excel at visual synthesis but rely on slow, iterative decoding. Existing single-step distillation methods attempt to bypass this bottleneck, either by training auxiliary score networks that effectively double…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Chaoyang Wang , Yunhai Tong

For a very long time, unsupervised learning for anomaly detection has been at the heart of image processing research and a stepping stone for high performance industrial automation process. With the emergence of CNN, several methods have…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Simon Thomine , Hichem Snoussi , Mahmoud Soua

Anomaly detection is a critical task in computer vision with profound implications for medical imaging, where identifying pathologies early can directly impact patient outcomes. While recent unsupervised anomaly detection approaches show…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Le Dong , Qinzhong Tan , Chunlei Li , Jingliang Hu , Yilei Shi , Weisheng Dong , Xiao Xiang Zhu , Lichao Mou

Knowledge distillation (KD) has been proven to be useful for training compact object detection models. However, we observe that KD is often effective when the teacher model and student counterpart share similar proposal information. This…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Sheng Xu , Yanjing Li , Bohan Zeng , Teli ma , Baochang Zhang , Xianbin Cao , Peng Gao , Jinhu Lv

Recent Semi-Supervised Object Detection (SS-OD) methods are mainly based on self-training, i.e., generating hard pseudo-labels by a teacher model on unlabeled data as supervisory signals. Although they achieved certain success, the limited…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Qiushan Guo , Yao Mu , Jianyu Chen , Tianqi Wang , Yizhou Yu , Ping Luo

Apples growing in natural environments often face severe visual obstructions from leaves and branches. This significantly increases the risk of false detections in object detection tasks, thereby escalating the challenge. Addressing this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Liang Geng

Data heterogeneity among Federated Learning (FL) users poses a significant challenge, resulting in reduced global model performance. The community has designed various techniques to tackle this issue, among which Knowledge Distillation…

Machine Learning · Computer Science 2024-10-08 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Knowledge distillation (KD) is a widely used technique to transfer knowledge from a large teacher network to a smaller student model. Traditional KD uses a fixed balancing factor alpha as a hyperparameter to combine the hard-label…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zhengda Li

Recent advances in collaborative knowledge distillation have demonstrated cutting-edge performance for resource-constrained distributed multimedia learning scenarios. However, achieving such competitiveness requires addressing a fundamental…

Machine Learning · Computer Science 2026-03-24 Jing Liu , Zhenchao Ma , Han Yu , Bobo Ju , Wenliang Yang , Chengfang Li , Bo Hu , Liang Song

Recent advances in automotive four-dimensional (4D) Radar have enabled access to raw 4D Radar Tensor (4DRT), offering richer spatial and Doppler information than conventional point clouds. While most existing methods rely on heavily…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Seung-Hyun Song , Dong-Hee Paek , Minh-Quan Dao , Ezio Malis , Seung-Hyun Kong

Deep learning models are vulnerable to adversarial examples, posing critical security challenges in real-world applications. While Adversarial Training (AT ) is a widely adopted defense mechanism to enhance robustness, it often incurs a…

Machine Learning · Computer Science 2025-09-16 Jing Zou , Shungeng Zhang , Meikang Qiu , Chong Li