English
Related papers

Related papers: Dynamic Knowledge Distillation With Noise Eliminat…

200 papers

The representation gap between teacher and student is an emerging topic in knowledge distillation (KD). To reduce the gap and improve the performance, current methods often resort to complicated training schemes, loss functions, and feature…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Tao Huang , Yuan Zhang , Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Chang Xu

By integrating complementary information from RGB image and depth map, the ability of salient object detection (SOD) for complex and challenging scenes can be improved. In recent years, the important role of Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Runmin Cong , Hongyu Liu , Chen Zhang , Wei Zhang , Feng Zheng , Ran Song , Sam Kwong

Existing RGB-thermal salient object detection (RGB-T SOD) methods aim to identify visually significant objects by leveraging both RGB and thermal modalities to enable robust performance in complex scenarios, but they often suffer from…

Multimedia · Computer Science 2025-04-09 Xingyuan Li , Ruichao Hou , Tongwei Ren , Gangshan Wu

Knowledge Distillation (KD) has been used in image classification for model compression. However, rare studies apply this technology on single-stage object detectors. Focal loss shows that the accumulated errors of easily-classified samples…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Shitao Tang , Litong Feng , Wenqi Shao , Zhanghui Kuang , Wei Zhang , Yimin Chen

Typically, a salient object detection (SOD) model faces opposite requirements in processing object interiors and boundaries. The features of interiors should be invariant to strong appearance change so as to pop-out the salient object as a…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Jinming Su , Jia Li , Yu Zhang , Changqun Xia , Yonghong Tian

Object detection in documents is a key step to automate the structural elements identification process in a digital or scanned document through understanding the hierarchical structure and relationships between different elements. Large and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Ayan Banerjee , Sanket Biswas , Josep Lladós , Umapada Pal

How to effectively fuse cross-modal information is the key problem for RGB-D salient object detection. Early fusion and the result fusion schemes fuse RGB and depth information at the input and output stages, respectively, hence incur the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Nian Liu , Ni Zhang , Ling Shao , Junwei Han

Recognizing novel sub-categories with scarce samples is an essential and challenging research topic in computer vision. Existing literature addresses this challenge by employing local-based representation approaches, which may not…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Haiqi Liu , C. L. Philip Chen , Xinrong Gong , Tong Zhang

Fully convolutional neural networks (FCNs) have shown outstanding performance in many computer vision tasks including salient object detection. However, there still remains two issues needed to be addressed in deep learning based saliency…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Chunbiao Zhu , Xing Cai , Kan Huang , Thomas H Li , Ge Li

Score Distillation Sampling (SDS) is a recent but already widely popular method that relies on an image diffusion model to control optimization problems using text prompts. In this paper, we conduct an in-depth analysis of the SDS loss…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Thiemo Alldieck , Nikos Kolotouros , Cristian Sminchisescu

The real human attention is an interactive activity between our visual system and our brain, using both low-level visual stimulus and high-level semantic information. Previous image salient object detection (SOD) works conduct their…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Zhenyu Wu , Shuai Li , Chenglizhao Chen , Aimin Hao , Hong Qin

Focusing on the issue of how to effectively capture and utilize cross-modality information in RGB-D salient object detection (SOD) task, we present a convolutional neural network (CNN) model, named CIR-Net, based on the novel cross-modality…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Runmin Cong , Qinwei Lin , Chen Zhang , Chongyi Li , Xiaochun Cao , Qingming Huang , Yao Zhao

Knowledge distillation (KD) represents a vital mechanism to transfer expertise from complex teacher networks to efficient student models. However, in decentralized or secure AI ecosystems, privacy regulations and proprietary interests often…

Machine Learning · Computer Science 2026-04-29 Tri-Nhan Vo , Dang Nguyen , Trung Le , Kien Do , Sunil Gupta

3D object detection often involves complicated training and testing pipelines, which require substantial domain knowledge about individual datasets. Inspired by recent non-maximum suppression-free 2D object detection models, we propose a 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Yue Wang , Justin Solomon

The inherent noisy and sparse characteristics of radar data pose challenges in finding effective representations for 3D object detection. In this paper, we propose RadarDistill, a novel knowledge distillation (KD) method, which can improve…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Geonho Bang , Kwangjin Choi , Jisong Kim , Dongsuk Kum , Jun Won Choi

Convolutional neural networks have a significant improvement in the accuracy of Object detection. As convolutional neural networks become deeper, the accuracy of detection is also obviously improved, and more floating-point calculations are…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Wei Hong , Jin ke Yu Fan Zong

Light field data exhibit favorable characteristics conducive to saliency detection. The success of learning-based light field saliency detection is heavily dependent on how a comprehensive dataset can be constructed for higher…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yongri Piao , Zhengkun Rong , Shuang Xu , Miao Zhang , Huchuan Lu

Although deep salient object detection (SOD) has achieved remarkable progress, deep SOD models are extremely data-hungry, requiring large-scale pixel-wise annotations to deliver such promising results. In this paper, we propose a novel yet…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Zhenyu Wu , Lin Wang , Wei Wang , Tengfei Shi , Chenglizhao Chen , Aimin Hao , Shuo Li

Efficient models for remote sensing object counting are urgently required for applications in scenarios with limited computing resources, such as drones or embedded systems. A straightforward yet powerful technique to achieve this is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shengqin Jiang , Yuan Gao , Bowen Li , Fengna Cheng , Renlong Hang , Qingshan Liu

Training deep neural networks has become increasingly demanding, requiring large datasets and significant computational resources, especially as model complexity advances. Data distillation methods, which aim to improve data efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Sunwoo Cho , Yejin Jung , Nam Ik Cho , Jae Woong Soh