English
Related papers

Related papers: Multi-Dataset Cross-Domain Knowledge Distillation …

200 papers

The significance of mental health classification is paramount in contemporary society, where digital platforms serve as crucial sources for monitoring individuals' well-being. However, existing social media mental health datasets primarily…

Computation and Language · Computer Science 2024-11-08 Rina Carines Cabral , Siwen Luo , Josiah Poon , Soyeon Caren Han

Current methods for developing foundation models in medical image segmentation rely on two primary assumptions: a fixed set of classes and the immediate availability of a substantial and diverse training dataset. However, this can be…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaoyang Chen , Hao Zheng , Yifang Xie , Yuncong Ma , Tengfei Li

In the surveillance and defense domain, multi-target detection and classification (MTD) is considered essential yet challenging due to heterogeneous inputs from diverse data sources and the computational complexity of algorithms designed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ngoc Tuyen Do , Tri Nhu Do

A major focus of clinical imaging workflow is disease diagnosis and management, leading to medical imaging datasets strongly tied to specific clinical objectives. This scenario has led to the prevailing practice of developing task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yunhe Gao , Zhuowei Li , Di Liu , Mu Zhou , Shaoting Zhang , Dimitris N. Metaxas

In clinical practice, medical segmentation datasets are often limited and heterogeneous, with variations in modalities, protocols, and anatomical targets across institutions. Existing deep learning models struggle to jointly learn from such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Weiwei Ma , Xiaobing Yu , Peijie Qiu , Jin Yang , Pan Xiao , Xiaoqi Zhao , Xiaofeng Liu , Tomo Miyazaki , Shinichiro Omachi , Yongsong Huang

Generalising deep models to new data from new centres (termed here domains) remains a challenge. This is largely attributed to shifts in data statistics (domain shifts) between source and unseen domains. Recently, gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xiao Liu , Spyridon Thermos , Alison O'Neil , Sotirios A. Tsaftaris

With the rapid increase of multimedia data, a large body of literature has emerged to work on multimodal summarization, the majority of which target at refining salient information from textual and visual modalities to output a pictorial…

Computation and Language · Computer Science 2022-02-16 Zhengkun Zhang , Xiaojun Meng , Yasheng Wang , Xin Jiang , Qun Liu , Zhenglu Yang

Knowledge distillation constitutes a simple yet effective way to improve the performance of a compact student network by exploiting the knowledge of a more powerful teacher. Nevertheless, the knowledge distillation literature remains…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Shuxuan Guo , Jose M. Alvarez , Mathieu Salzmann

Conventional transfer learning leverages weights of pre-trained networks, but mandates the need for similar neural architectures. Alternatively, knowledge distillation can transfer knowledge between heterogeneous networks but often requires…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Shuhang Wang , Vivek Kumar Singh , Alex Benjamin , Mercy Asiedu , Elham Yousef Kalafi , Eugene Cheah , Viksit Kumar , Anthony Samir

Many medical image segmentation methods have achieved impressive results. Yet, most existing methods do not take into account the shape-intensity prior information. This may lead to implausible segmentation results, in particular for images…

Image and Video Processing · Electrical Eng. & Systems 2024-09-27 Wenhui Dong , Bo Du , Yongchao Xu

Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shenghao Zhu , Yifei Chen , Weihong Chen , Yuanhan Wang , Chang Liu , Shuo Jiang , Feiwei Qin , Changmiao Wang

The lack of well-annotated datasets in computational pathology (CPath) obstructs the application of deep learning techniques for classifying medical images. %Since pathologist time is expensive, dataset curation is intrinsically difficult.…

Image and Video Processing · Electrical Eng. & Systems 2022-01-28 Ryan Zhang , Jiadai Zhu , Stephen Yang , Mahdi S. Hosseini , Angelo Genovese , Lina Chen , Corwyn Rowsell , Savvas Damaskinos , Sonal Varma , Konstantinos N. Plataniotis

Current state-of-the-art object detectors are at the expense of high computational costs and are hard to deploy to low-end devices. Knowledge distillation, which aims at training a smaller student network by transferring knowledge from a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ruoyu Sun , Fuhui Tang , Xiaopeng Zhang , Hongkai Xiong , Qi Tian

An increasing number of datasets sharing similar domains for semantic segmentation have been published over the past few years. But despite the growing amount of overall data, it is still difficult to train bigger and better models due to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Anton Backhaus , Thorsten Luettel , Mirko Maehlisch

Cross-domain object detection is challenging, because object detection model is often vulnerable to data variance, especially to the considerable domain shift between two distinctive domains. In this paper, we propose a new Unbiased Mean…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Jinhong Deng , Wen Li , Yuhua Chen , Lixin Duan

We propose a novel teacher-student framework to distill knowledge from multiple teachers trained on distinct datasets. Each teacher is first trained from scratch on its own dataset. Then, the teachers are combined into a joint architecture,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Adrian Iordache , Bogdan Alexe , Radu Tudor Ionescu

Collecting annotated data for semantic segmentation is time-consuming and hard to scale up. In this paper, we for the first time propose a unified framework, termed as Multi-Dataset Pretraining, to take full advantage of the fragmented…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Bowen Shi , Xiaopeng Zhang , Haohang Xu , Wenrui Dai , Junni Zou , Hongkai Xiong , Qi Tian

Deep learning achieved great progress recently, however, it is not easy or efficient to further improve its performance by increasing the size of the model. Multi-modal learning can mitigate this challenge by introducing richer and more…

Artificial Intelligence · Computer Science 2025-10-07 Cairong Zhao , Yufeng Jin , Zifan Song , Haonan Chen , Duoqian Miao , Guosheng Hu

Annotating multiple organs in 3D medical images is time-consuming and costly. Meanwhile, there exist many single-organ datasets with one specific organ annotated. This paper investigates how to learn a multi-organ segmentation model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Shixiang Feng , Yuhang Zhou , Xiaoman Zhang , Ya Zhang , Yanfeng Wang

Learning based on multimodal data has attracted increasing interest recently. While a variety of sensory modalities can be collected for training, not all of them are always available in development scenarios, which raises the challenge to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shicai Wei , Yang Luo , Chunbo Luo