English
Related papers

Related papers: Generalized Adaptive Transfer Network: Enhancing T…

200 papers

In this paper, we propose a Generative Translation Classification Network (GTCN) for improving visual classification accuracy in settings where classes are visually similar and data is scarce. For this purpose, we propose joint learning…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 ByungIn Yoo , Tristan Sylvain , Yoshua Bengio , Junmo Kim

Current generative-based dialogue systems are data-hungry and fail to adapt to new unseen domains when only a small amount of target data is available. Additionally, in real-world applications, most domains are underrepresented, so there is…

Computation and Language · Computer Science 2021-02-23 Rui Ribeiro , Alberto Abad , José Lopes

Being expensive and time-consuming to collect massive COVID-19 image samples to train deep classification models, transfer learning is a promising approach by transferring knowledge from the abundant typical pneumonia datasets for COVID-19…

Image and Video Processing · Electrical Eng. & Systems 2021-03-10 Jindong Wang , Wenjie Feng , Chang Liu , Chaohui Yu , Mingxuan Du , Renjun Xu , Tao Qin , Tie-Yan Liu

Optimising deep neural networks is a challenging task due to complex training dynamics, high computational requirements, and long training times. To address this difficulty, we propose the framework of Generalisable Agents for Neural…

Deep learning based generative adversarial networks (GAN) can effectively perform image reconstruction with under-sampled MR data. In general, a large number of training samples are required to improve the reconstruction performance of a…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Jun Lv , Guangyuan Li , Xiangrong Tong , Weibo Chen , Jiahao Huang , Chengyan Wang , Guang Yang

Transfer learning (TL) is widely used in conventional hybrid automatic speech recognition (ASR) system, to transfer the knowledge from source to target language. TL can be applied to end-to-end (E2E) ASR system such as recurrent neural…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Vikas Joshi , Rui Zhao , Rupesh R. Mehta , Kshitiz Kumar , Jinyu Li

Many algorithms for control of multi-robot teams operate under the assumption that low-latency, global state information necessary to coordinate agent actions can readily be disseminated among the team. However, in harsh environments with…

Robotics · Computer Science 2021-08-02 Ekaterina Tolstaya , Landon Butler , Daniel Mox , James Paulos , Vijay Kumar , Alejandro Ribeiro

The main challenge in domain generalization (DG) is to handle the distribution shift problem that lies between the training and test data. Recent studies suggest that test-time training (TTT), which adapts the learned model with test data,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Liang Chen , Yong Zhang , Yibing Song , Ying Shan , Lingqiao Liu

Training Deep Neural Networks (DNNs) is still highly time-consuming and compute-intensive. It has been shown that adapting a pretrained model may significantly accelerate this process. With a focus on classification, we show that current…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Farshid Varno , Lucas May Petry , Lisa Di Jorio , Stan Matwin

In activity recognition, it is often expensive and time-consuming to acquire sufficient activity labels. To solve this problem, transfer learning leverages the labeled samples from the source domain to annotate the target domain which has…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Jindong Wang , Yiqiang Chen , Lisha Hu , Xiaohui Peng , Philip S. Yu

Transfer Learning is concerned with the application of knowledge gained from solving a problem to a different but related problem domain. In this paper, we propose a method and efficient algorithm for ranking and selecting representations…

Machine Learning · Computer Science 2014-05-29 Son N. Tran , Artur d'Avila Garcez

Team adaptation to new cooperative tasks is a hallmark of human intelligence, which has yet to be fully realized in learning agents. Previous work on multi-agent transfer learning accommodate teams of different sizes, heavily relying on the…

Artificial Intelligence · Computer Science 2022-03-10 Rongjun Qin , Feng Chen , Tonghan Wang , Lei Yuan , Xiaoran Wu , Zongzhang Zhang , Chongjie Zhang , Yang Yu

Deep networks are vulnerable to adversarial examples. Adversarial Training (AT) has been a standard foundation of modern adversarial defense approaches due to its remarkable effectiveness. However, AT is extremely time-consuming, refraining…

Machine Learning · Computer Science 2024-05-28 Shao-Yuan Lo , Vishal M. Patel

Reinforcement learning (RL) has seen great advancements in the past few years. Nevertheless, the consensus among the RL community is that currently used methods, despite all their benefits, suffer from extreme data inefficiency, especially…

Machine Learning · Computer Science 2020-04-01 Kacper Kielak

We evaluate the use of original game curricula supported by the Atari 2600 console as a heterogeneous transfer benchmark for deep reinforcement learning agents. Game designers created curricula using combinations of several discrete…

Machine Learning · Computer Science 2022-10-25 Andrei A. Rusu , Sebastian Flennerhag , Dushyant Rao , Razvan Pascanu , Raia Hadsell

This paper introduces a novel transfer learning framework for deep multi-agent reinforcement learning. The approach automatically combines goal-conditioned policies with temporal contrastive learning to discover meaningful sub-goals. The…

Artificial Intelligence · Computer Science 2024-06-04 Weihao Zeng , Joseph Campbell , Simon Stepputtis , Katia Sycara

Transfer learning, in which a network is trained on one task and re-purposed on another, is often used to produce neural network classifiers when data is scarce or full-scale training is too costly. When the goal is to produce a model that…

Machine Learning · Computer Science 2020-02-24 Ali Shafahi , Parsa Saadatpanah , Chen Zhu , Amin Ghiasi , Christoph Studer , David Jacobs , Tom Goldstein

To reduce the large computation and storage cost of a deep convolutional neural network, the knowledge distillation based methods have pioneered to transfer the generalization ability of a large (teacher) deep network to a light-weight…

Machine Learning · Computer Science 2018-10-19 Peiye Liu , Wu Liu , Huadong Ma , Tao Mei , Mingoo Seok

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

Machine Learning · Computer Science 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

Meta reinforcement learning aims to develop policies that generalize to unseen tasks sampled from a task distribution. While context-based meta-RL methods improve task representation using task latents, they often struggle with…

Machine Learning · Computer Science 2026-05-21 Jeongmo Kim , Yisak Park , Minung Kim , Seungyul Han