English
Related papers

Related papers: Multi-Level Heterogeneous Knowledge Transfer Netwo…

200 papers

Generalized zero-shot learning (GZSL) tackles the problem of learning to classify instances involving both seen classes and unseen ones. The key issue is how to effectively transfer the model learned from seen classes to unseen classes.…

Machine Learning · Computer Science 2019-11-21 Junjie Wang , Xiangfeng Wang , Bo Jin , Junchi Yan , Wenjie Zhang , Hongyuan Zha

Few-shot class-incremental learning (FSCIL) aims to continually learn new classes using a few samples while not forgetting the old classes. The key of this task is effective knowledge transfer from the base session to the incremental…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ye Wang , Yaxiong Wang , Guoshuai Zhao , Xueming Qian

In task-oriented semantic communications, the transmitters are designed to deliver task-related semantic information rather than every signal bit to receivers, which alleviates the spectrum pressure by reducing network traffic loads.…

Signal Processing · Electrical Eng. & Systems 2025-01-06 Hong Chen , Fang Fang , Xianbin Wang

While transfer learning is an effective strategy, it often overlooks the opportunity to leverage knowledge from numerous available models online. Addressing this multi-source transfer learning problem is a promising path to boost…

Machine Learning · Computer Science 2026-04-24 Marcin Osial , Bartosz Wójcik , Bartosz Zieliński , Sebastian Cygert

Very high-resolution (VHR) remote sensing (RS) image classification is the fundamental task for RS image analysis and understanding. Recently, transformer-based models demonstrated outstanding potential for learning high-order contextual…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Yan Zhang , Xiyuan Gao , Qingyan Duan , Jiaxu Leng , Xiao Pu , Xinbo Gao

The ability of a human being to extrapolate previously gained knowledge to other domains inspired a new family of methods in machine learning called transfer learning. Transfer learning is often based on the assumption that objects in both…

Machine Learning · Statistics 2016-10-21 Ievgen Redko , Younès Bennani

Multi-channel inputs offer several advantages over single-channel, to improve the robustness of on-device speech recognition systems. Recent work on multi-channel transformer, has proposed a way to incorporate such inputs into end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-31 Feng-Ju Chang , Martin Radfar , Athanasios Mouchtaris , Maurizio Omologo

While neural networks have been successfully applied to the full-spectrum k-distribution (FSCK) method at a large range of thermodynamics with k-values predicted by a trained multilayer perceptron (MLP) model, the required a-values still…

Machine Learning · Computer Science 2024-03-21 Xin Wang , Yucheng Kuang , Chaojun Wang , Hongyuan Di , Boshu He

Few-Shot Learning (FSL) algorithms have made substantial progress in learning novel concepts with just a handful of labelled data. To classify query instances from novel classes encountered at test-time, they only require a support set…

Machine Learning · Computer Science 2021-08-06 Etienne Bennequin , Victor Bouvier , Myriam Tami , Antoine Toubhans , Céline Hudelot

Accurate classification of laryngeal vascular as benign or malignant is crucial for early detection of laryngeal cancer. However, organizations with limited access to laryngeal vascular images face challenges due to the lack of large and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xinyi Fang , Xu Yang , Chak Fong Chong , Kei Long Wong , Yapeng Wang , Tiankui Zhang , Sio-Kei Im

Knowledge Transfer (KT) techniques tackle the problem of transferring the knowledge from a large and complex neural network into a smaller and faster one. However, existing KT methods are tailored towards classification tasks and they…

Machine Learning · Computer Science 2019-03-21 Nikolaos Passalis , Anastasios Tefas

Expanding existing learning systems to provide high-quality customized models for more domains, such as new users, is challenged by the limited labeled data and the data and device heterogeneities. While knowledge distillation methods could…

Artificial Intelligence · Computer Science 2025-02-10 Gaole Dai , Huatao Xu , Yifan Yang , Rui Tan , Mo Li

Federated learning enables multiple distributed devices to collaboratively learn a shared prediction model without centralizing their on-device data. Most of the current algorithms require comparable individual efforts for local training…

Machine Learning · Computer Science 2022-04-07 Lan Zhang , Dapeng Wu , Xiaoyong Yuan

Currently, under supervised learning, a model pretrained by a large-scale nature scene dataset and then fine-tuned on a few specific task labeling data is the paradigm that has dominated the knowledge transfer learning. It has reached the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Tong Zhang , Peng Gao , Hao Dong , Yin Zhuang , Guanqun Wang , Wei Zhang , He Chen

The generation of Synthetic Computed Tomography (sCT) images has become a pivotal methodology in modern clinical practice, particularly in the context of Radiotherapy (RT) treatment planning. The use of sCT enables the calculation of doses,…

With the rapid development of smart manufacturing, data-driven machinery health management has been of growing attention. In situations where some classes are more difficult to be distinguished compared to others and where classes might be…

Transfer learning has been developed to improve the performances of different but related tasks in machine learning. However, such processes become less efficient with the increase of the size of training data and the number of tasks.…

Machine Learning · Computer Science 2018-03-28 Rui Zhang , Quanyan Zhu

The Knowledge Tracing (KT) task focuses on predicting a learner's future performance based on the historical interactions. The knowledge state plays a key role in learning process. However, considering that the knowledge state is influenced…

Artificial Intelligence · Computer Science 2024-12-30 Shanshan Wang , Xueying Zhang , Keyang Wang , Xun Yang , Xingyi Zhang

With the wide applications of colored point cloud in many fields, point cloud perceptual quality assessment plays a vital role in the visual communication systems owing to the existence of quality degradations introduced in various stages.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Qi Liu , Yiyun Liu , Honglei Su , Hui Yuan , Raouf Hamzaoui

Cross-domain Few-shot Segmentation (CD-FSS) aims to segment novel classes from target domains that are not involved in training and have significantly different data distributions from the source domain, using only a few annotated samples,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Sujun Sun , Haowen Gu , Cheng Xie , Yanxu Ren , Mingwu Ren , Haofeng Zhang