English
Related papers

Related papers: Knowledge Distillation for Multi-Target Domain Ada…

200 papers

In person re-identification (ReID) task, because of its shortage of trainable dataset, it is common to utilize fine-tuning method using a classification network pre-trained on a large dataset. However, it is relatively difficult to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Youngmin Ro , Jongwon Choi , Dae Ung Jo , Byeongho Heo , Jongin Lim , Jin Young Choi

With the rapid development of deep learning (DL) in recent years, automatic modulation recognition (AMR) with DL has achieved high accuracy. However, insufficient training signal data in complicated channel environments and large-scale DL…

Machine Learning · Computer Science 2024-01-01 Dongbin Hou , Lixin Li , Wensheng Lin , Junli Liang , Zhu Han

In this paper, we consider the intersection of two problems in machine learning: Multi-Source Domain Adaptation (MSDA) and Dataset Distillation (DD). On the one hand, the first considers adapting multiple heterogeneous labeled source…

Machine Learning · Computer Science 2023-09-15 Eduardo Fernandes Montesuma , Fred Ngolè Mboula , Antoine Souloumiac

Lack of specialized data makes building a multi-domain neural machine translation tool challenging. Although emerging literature dealing with low resource languages starts to show promising results, most state-of-the-art models used…

Computation and Language · Computer Science 2020-04-17 Idriss Mghabbar , Pirashanth Ratnamogan

Person re-identification (re-ID) has gained more and more attention due to its widespread applications in intelligent video surveillance. Unfortunately, the mainstream deep learning methods still need a large quantity of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Qi Wang , Sikai Bai , Junyu Gao , Yuan Yuan , Xuelong Li

Knowledge distillation (KD) is a new method for transferring knowledge of a structure under training to another one. The typical application of KD is in the form of learning a small model (named as a student) by soft labels produced by a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Sajjad Abbasi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

Person re-identification (ReID) plays a critical role in intelligent surveillance systems by linking identities across multiple cameras in complex environments. However, ReID faces significant challenges such as appearance variations,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Dang H. Pham , Tu N. Nguyen , Hoa N. Nguyen

Unsupervised Domain Adaptive (UDA) person re-identification (ReID) aims at adapting the model trained on a labeled source-domain dataset to a target-domain dataset without any further annotations. Most successful UDA-ReID approaches combine…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Kecheng Zheng , Wu Liu , Lingxiao He , Tao Mei , Jiebo Luo , Zheng-Jun Zha

In recent years, a variety of proposed methods based on deep convolutional neural networks (CNNs) have improved the state of the art for large-scale person re-identification (ReID). While a large number of optimizations and network…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Paul Marchwica , Michael Jamieson , Parthipan Siva

Person re-identification (Re-ID) aims at recognizing the same person from images taken across different cameras. To address this task, one typically requires a large amount labeled data for training an effective Re-ID model, which might not…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Yu-Jhe Li , Fu-En Yang , Yen-Cheng Liu , Yu-Ying Yeh , Xiaofei Du , Yu-Chiang Frank Wang

In this technical report, we present our submission to the VisDA Challenge in ECCV 2020 and we achieved one of the top-performing results on the leaderboard. Our solution is based on Structured Domain Adaptation (SDA) and Mutual…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Yixiao Ge , Shijie Yu , Dapeng Chen

Knowledge distillation (KD) is a technique for transferring knowledge from complex teacher models to simpler student models, significantly enhancing model efficiency and accuracy. It has demonstrated substantial advancements in various…

Computation and Language · Computer Science 2025-04-21 Junjie Yang , Junhao Song , Xudong Han , Ziqian Bi , Tianyang Wang , Chia Xin Liang , Xinyuan Song , Yichao Zhang , Qian Niu , Benji Peng , Keyu Chen , Ming Liu

Recent years have witnessed a substantial increase in the deep learning (DL)architectures proposed for visual recognition tasks like person re-identification,where individuals must be recognized over multiple distributed cameras.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Hugo Masson , Amran Bhuiyan , Le Thanh Nguyen-Meidine , Mehrsan Javan , Parthipan Siva , Ismail Ben Ayed , Eric Granger

Knowledge distillation (KD) enhances the performance of a student network by allowing it to learn the knowledge transferred from a teacher network incrementally. Existing methods dynamically adjust the temperature to enable the student…

Machine Learning · Computer Science 2026-02-03 Zhengbo Zhang , Yuxi Zhou , Jia Gong , Jun Liu , Zhigang Tu

Knowledge distillation (KD) has emerged as a promising technique in deep learning, typically employed to enhance a compact student network through learning from their high-performance but more complex teacher variant. When applied in the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Yuxuan Jiang , Chen Feng , Fan Zhang , David Bull

In this work we address multi-target domain adaptation (MTDA) in semantic segmentation, which consists in adapting a single model from an annotated source dataset to multiple unannotated target datasets that differ in their underlying data…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yangsong Zhang , Subhankar Roy , Hongtao Lu , Elisa Ricci , Stéphane Lathuilière

To ease the burden of labeling, unsupervised domain adaptation (UDA) aims to transfer knowledge in previous and related labeled datasets (sources) to a new unlabeled dataset (target). Despite impressive progress, prior methods always need…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jian Liang , Dapeng Hu , Jiashi Feng , Ran He

LiDAR-based 3D object detectors have been largely utilized in various applications, including autonomous vehicles or mobile robots. However, LiDAR-based detectors often fail to adapt well to target domains with different sensor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Jiyun Jang , Mincheol Chang , Jongwon Park , Jinkyu Kim

In many practical applications, it is often difficult and expensive to obtain large-scale labeled data to train state-of-the-art deep neural networks. Therefore, transferring the learned knowledge from a separate, labeled source domain to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Sicheng Zhao , Hui Chen , Hu Huang , Pengfei Xu , Guiguang Ding

The generalization capability of deep neural networks has been substantially improved by applying a wide spectrum of regularization methods, e.g., restricting function space, injecting randomness during training, augmenting data, etc. In…

Machine Learning · Computer Science 2021-10-08 Kyungyul Kim , ByeongMoon Ji , Doyoung Yoon , Sangheum Hwang