中文
相关论文

相关论文: Breaking Modality Gap in RGBT Tracking: Coupled Kn…

200 篇论文

Knowledge distillation (KD) is an effective technique to transfer knowledge from one neural network (teacher) to another (student), thus improving the performance of the student. To make the student better mimic the behavior of the teacher,…

机器学习 · 计算机科学 2020-10-20 Xiang Deng , Zhongfei , Zhang

Knowledge Distillation (KD) transfers knowledge from a large pre-trained teacher network to a compact and efficient student network, making it suitable for deployment on resource-limited media terminals. However, traditional KD methods…

计算机视觉与模式识别 · 计算机科学 2024-09-23 Xinlei Huang , Jialiang Tang , Xubin Zheng , Jinjia Zhou , Wenxin Yu , Ning Jiang

Knowledge Distillation (KD) aims at improving the performance of a low-capacity student model by inheriting knowledge from a high-capacity teacher model. Previous KD methods typically train a student by minimizing a task-related loss and…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Mengya Gao , Yujun Shen , Quanquan Li , Junjie Yan , Liang Wan , Dahua Lin , Chen Change Loy , Xiaoou Tang

The improvement in the performance of efficient and lightweight models (i.e., the student model) is achieved through knowledge distillation (KD), which involves transferring knowledge from more complex models (i.e., the teacher model).…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Seonghak Kim , Gyeongdo Ham , Yucheol Cho , Daeshik Kim

Knowledge Distillation (KD) is a widely-used technology to inherit information from cumbersome teacher models to compact student models, consequently realizing model compression and acceleration. Compared with image classification, object…

计算机视觉与模式识别 · 计算机科学 2021-12-10 Gang Li , Xiang Li , Yujie Wang , Shanshan Zhang , Yichao Wu , Ding Liang

Knowledge distillation (KD) is a widely adopted technique for compressing large models into smaller, more efficient student models that can be deployed on devices with limited computational resources. Among various KD methods, Relational…

量子物理 · 物理学 2025-08-19 Chen-Yu Liu , Kuan-Cheng Chen , Keisuke Murota , Samuel Yen-Chi Chen , Enrico Rinaldi

The goal of this work is to present a systematic solution for RGB-D salient object detection, which addresses the following three aspects with a unified framework: modal-specific representation learning, complementary cue selection and…

计算机视觉与模式识别 · 计算机科学 2019-09-23 Hao Chen , Youfu Li

RGB-T tracking involves the use of images from both visible and thermal modalities. The primary objective is to adaptively leverage the relatively dominant modality in varying conditions to achieve more robust tracking compared to…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Yang Luo , Xiqing Guo , Mingtao Dong , Jin Yu

Video surveillance systems are crucial components for ensuring public safety and management in smart city. As a fundamental task in video surveillance, text-to-image person retrieval aims to retrieve the target person from an image gallery…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Bingjun Luo , Jinpeng Wang , Wang Zewen , Junjie Zhu , Xibin Zhao

Knowledge distillation (KD) is a new method for transferring knowledge of a structure under training to another one. The typical application of KD is in the form of learning a small model (named as a student) by soft labels produced by a…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Sajjad Abbasi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

Knowledge Distillation (KD) is a powerful technique for transferring knowledge between neural network models, where a pre-trained teacher model is used to facilitate the training of the target student model. However, the availability of a…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Xucong Wang , Pengchao Han , Lei Guo

Knowledge distillation as an efficient knowledge transfer technique, has achieved remarkable success in unimodal scenarios. However, in cross-modal settings, conventional distillation methods encounter significant challenges due to data and…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Hui Li , Pengfei Yang , Juanyang Chen , Le Dong , Yanxin Chen , Quan Wang

Knowledge Distillation (KD) compresses neural networks by learning a small network (student) via transferring knowledge from a pre-trained large network (teacher). Many endeavours have been devoted to the image domain, while few works focus…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Ping Li , Chenhao Ping , Wenxiao Wang , Mingli Song

RGB-Thermal (RGBT) tracking aims to achieve robust object localization across diverse environmental conditions by fusing visible and thermal infrared modalities. However, existing RGBT trackers rely solely on initial-frame visual…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Hao Li , Yuhao Wang , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu

Crossmodal knowledge distillation (KD) aims to enhance a unimodal student using a multimodal teacher model. In particular, when the teacher's modalities include the student's, additional complementary information can be exploited to improve…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Chenqi Guo , Mengshuo Rong , Qianli Feng , Rongfan Feng , Yinglong Ma

Online high-definition (HD) map construction is an important and challenging task in autonomous driving. Recently, there has been a growing interest in cost-effective multi-view camera-based methods without relying on other sensors like…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Xiaoshuai Hao , Ruikai Li , Hui Zhang , Dingzhe Li , Rong Yin , Sangil Jung , Seung-In Park , ByungIn Yoo , Haimei Zhao , Jing Zhang

Knowledge distillation is an effective and stable method for model compression via knowledge transfer. Conventional knowledge distillation (KD) is to transfer knowledge from a large and well pre-trained teacher network to a small student…

计算机视觉与模式识别 · 计算机科学 2021-11-24 Zhiqiang Liu , Yanxia Liu , Chengkai Huang

Multi-modality medical imaging is crucial in clinical treatment as it can provide complementary information for medical image segmentation. However, collecting multi-modal data in clinical is difficult due to the limitation of the scan time…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Shuai Wang , Zipei Yan , Daoan Zhang , Haining Wei , Zhongsen Li , Rui Li

Beam training and prediction in real-world millimeter-wave (mmWave) communications systems are challenging due to rapidly time-varying channels and strong interference from surrounding objects. In this context, widely available sensors,…

信号处理 · 电气工程与系统科学 2026-04-21 Mengyuan Ma , Isuri Welgamage , Ahmed Alkhateeb , A. Lee Swindlehurst , Markku Juntti , Nhan Thanh Nguyen

Existing RGB-D saliency detection models do not explicitly encourage RGB and depth to achieve effective multi-modal learning. In this paper, we introduce a novel multi-stage cascaded learning framework via mutual information minimization to…

计算机视觉与模式识别 · 计算机科学 2022-01-07 Jing Zhang , Deng-Ping Fan , Yuchao Dai , Xin Yu , Yiran Zhong , Nick Barnes , Ling Shao