English
Related papers

Related papers: Dynamic Knowledge Distillation With Noise Eliminat…

200 papers

Recent RGBD-based models for saliency detection have attracted research attention. The depth clues such as boundary clues, surface normal, shape attribute, etc., contribute to the identification of salient objects with complicated…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zongwei Wu , Guillaume Allibert , Christophe Stolz , Chao Ma , Cédric Demonceaux

Knowledge Distillation (KD) is a well-known training paradigm in deep neural networks where knowledge acquired by a large teacher model is transferred to a small student. KD has proven to be an effective technique to significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Philip de Rijk , Lukas Schneider , Marius Cordts , Dariu M. Gavrila

Previous Knowledge Distillation based efficient image retrieval methods employs a lightweight network as the student model for fast inference. However, the lightweight student model lacks adequate representation capacity for effective…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Yi Xie , Huaidong Zhang , Xuemiao Xu , Jianqing Zhu , Shengfeng He

Temperature plays a pivotal role in moderating label softness in the realm of knowledge distillation (KD). Traditional approaches often employ a static temperature throughout the KD process, which fails to address the nuanced complexities…

Machine Learning · Computer Science 2024-04-22 Yukang Wei , Yu Bai

Salient object detection (SOD) in complex environments remains a challenging research topic. Most existing methods perform well in natural scenes with negligible noise, and tend to leverage multi-modal information (e.g., depth and infrared)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Quan Chen , Xiong Yang , Bolun Zheng , Rongfeng Lu , Xiaokai Yang , Qianyu Zhang , Yu Liu , Xiaofei Zhou

Knowledge distillation has become widely recognized for its ability to transfer knowledge from a large teacher network to a compact and more streamlined student network. Traditional knowledge distillation methods primarily follow a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Chaomin Shen , Yaomin Huang , Haokun Zhu , Jinsong Fan , Guixu Zhang

Small object detection (SOD) in optical images and videos is a challenging problem that even state-of-the-art generic object detection methods fail to accurately localize and identify such objects. Typically, small objects appear in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Aref Miri Rekavandi , Lian Xu , Farid Boussaid , Abd-Krim Seghouane , Stephen Hoefs , Mohammed Bennamoun

Defocus Blur Detection(DBD) aims to separate in-focus and out-of-focus regions from a single image pixel-wisely. This task has been paid much attention since bokeh effects are widely used in digital cameras and smartphone photography.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Xiaodong Cun , Chi-Man Pun

The objective of hyperspectral remote sensing image salient object detection (HRSI-SOD) is to identify objects or regions that exhibit distinct spectrum contrasts with the background. This area holds significant promise for practical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Peifu Liu , Huiyan Bai , Tingfa Xu , Jihui Wang , Huan Chen , Jianan Li

Real-world scenarios pose several challenges to deep learning based computer vision techniques despite their tremendous success in research. Deeper models provide better performance, but are challenging to deploy and knowledge distillation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Ayush Bhardwaj , Sakshee Pimpale , Saurabh Kumar , Biplab Banerjee

Heterogeneous data modalities can provide complementary cues for several tasks, usually leading to more robust algorithms and better performance. However, while training data can be accurately collected to include a variety of sensory…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Nuno C. Garcia , Pietro Morerio , Vittorio Murino

Recent research on deep convolutional neural networks (CNNs) has provided a significant performance boost on efficient super-resolution (SR) tasks by trading off the performance and applicability. However, most existing methods focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-12-25 Yan Wang , Tongtong Su , Yusen Li , Jiuwen Cao , Gang Wang , Xiaoguang Liu

Knowledge Distillation (KD) for object detection aims to train a compact detector by transferring knowledge from a teacher model. Since the teacher model perceives data in a way different from humans, existing KD methods only distill…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jiawei Liang , Siyuan Liang , Aishan Liu , Ke Ma , Jingzhi Li , Xiaochun Cao

Radar-camera fusion methods have emerged as a cost-effective approach for 3D object detection but still lag behind LiDAR-based methods in performance. Recent works have focused on employing temporal fusion and Knowledge Distillation (KD)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Geonho Bang , Minjae Seong , Jisong Kim , Geunju Baek , Daye Oh , Junhyung Kim , Junho Koh , Jun Won Choi

The performance of video saliency estimation techniques has achieved significant advances along with the rapid development of Convolutional Neural Networks (CNNs). However, devices like cameras and drones may have limited computational…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Jia Li , Kui Fu , Shengwei Zhao , Shiming Ge

Diffusion models for super-resolution (SR) produce high-quality visual results but require expensive computational costs. Despite the development of several methods to accelerate diffusion-based SR models, some (e.g., SinSR) fail to produce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Daniil Selikhanovych , David Li , Aleksei Leonov , Nikita Gushchin , Sergei Kushneriuk , Alexander Filippov , Evgeny Burnaev , Iaroslav Koshelev , Alexander Korotin

Existing Knowledge Distillation (KD) methods often align feature information between teacher and student by exploring meaningful feature processing and loss functions. However, due to the difference in feature distributions between the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yu Wang , Chuanguang Yang , Zhulin An , Weilun Feng , Jiarui Zhao , Chengqing Yu , Libo Huang , Boyu Diao , Yongjun Xu

Co-saliency detection (Co-SOD) aims to segment the common salient foreground in a group of relevant images. In this paper, inspired by human behavior, we propose a gradient-induced co-saliency detection (GICD) method. We first abstract a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Zhao Zhang , Wenda Jin , Jun Xu , Ming-Ming Cheng

Regarding intelligent transportation systems, low-bitrate transmission via lossy point cloud compression is vital for facilitating real-time collaborative perception among connected agents, such as vehicles and infrastructures, under…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Hao Jing , Anhong Wang , Yifan Zhang , Donghan Bu , Junhui Hou

Depth information has been proved beneficial in RGB-D salient object detection (SOD). However, depth maps obtained often suffer from low quality and inaccuracy. Most existing RGB-D SOD models have no cross-modal interactions or only have…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Wenbo Zhang , Yao Jiang , Keren Fu , Qijun Zhao