English
Related papers

Related papers: Instance-based Inductive Deep Transfer Learning by…

200 papers

Many statistical learning models hold an assumption that the training data and the future unlabeled data are drawn from the same distribution. However, this assumption is difficult to fulfill in real-world scenarios and creates barriers in…

Human-Computer Interaction · Computer Science 2020-09-16 Yuxin Ma , Arlen Fan , Jingrui He , Arun Reddy Nelakurthi , Ross Maciejewski

In activity recognition, it is often expensive and time-consuming to acquire sufficient activity labels. To solve this problem, transfer learning leverages the labeled samples from the source domain to annotate the target domain which has…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Jindong Wang , Yiqiang Chen , Lisha Hu , Xiaohui Peng , Philip S. Yu

Deep transfer learning techniques try to tackle the limitations of deep learning, the dependency on extensive training data and the training costs, by reusing obtained knowledge. However, the current DTL techniques suffer from either…

Machine Learning · Computer Science 2023-05-12 Mohammadreza Iman , John A. Miller , Khaled Rasheed , Robert M. Branch , Hamid R. Arabnia

We present a new approach for transferring knowledge from groups to individuals that comprise them. We evaluate our method in text, by inferring the ratings of individual sentences using full-review ratings. This approach, which combines…

Machine Learning · Computer Science 2014-12-11 Dimitrios Kotzias , Misha Denil , Phil Blunsom , Nando de Freitas

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

Machine Learning · Computer Science 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Deep learning, in general, focuses on training a neural network from large labeled datasets. Yet, in many cases there is value in training a network just from the input at hand. This is particularly relevant in many signal and image…

Machine Learning · Computer Science 2024-04-09 Tom Tirer , Raja Giryes , Se Young Chun , Yonina C. Eldar

Hyperspectral image (HSI) classification is one of the most active research topics and has achieved promising results boosted by the recent development of deep learning. However, most state-of-the-art approaches tend to perform poorly when…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Ying Qu , Razieh Kaviani Baghbaderani , Wei Li , Lianru Gao , Hairong Qi

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

We propose a transfer learning-based solution for the problem of multiple class novelty detection. In particular, we propose an end-to-end deep-learning based approach in which we investigate how the knowledge contained in an external,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Pramuditha Perera , Vishal M. Patel

Inductive transfer learning aims to learn from a small amount of training data for the target task by utilizing a pre-trained model from the source task. Most strategies that involve large-scale deep learning models adopt initialization…

Machine Learning · Computer Science 2022-06-22 Sanghoon Myung , In Huh , Wonik Jang , Jae Myung Choe , Jisu Ryu , Dae Sin Kim , Kee-Eung Kim , Changwook Jeong

Deep convolutional neural network (DCNN) based supervised learning is a widely practiced approach for large-scale image classification. However, retraining these large networks to accommodate new, previously unseen data demands high…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Syed Shakib Sarwar , Aayush Ankit , Kaushik Roy

We propose novel model transfer-learning methods that refine a decision forest model M learned within a "source" domain using a training set sampled from a "target" domain, assumed to be a variation of the source. We present two random…

Machine Learning · Computer Science 2018-05-01 Noam Segev , Maayan Harel , Shie Mannor , Koby Crammer , Ran El-Yaniv

We propose continual instance learning - a method that applies the concept of continual learning to the task of distinguishing instances of the same object category. We specifically focus on the car object, and incrementally learn to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Kishan Parshotam , Mert Kilickaya

Exploring deep convolutional neural networks of high efficiency and low memory usage is very essential for a wide variety of machine learning tasks. Most of existing approaches used to accelerate deep models by manipulating parameters or…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Chuanjian Liu , Yunhe Wang , Kai Han , Chunjing Xu , Chang Xu

In recent years, neural networks have proven to be effective in Chinese word segmentation. However, this promising performance relies on large-scale training data. Neural networks with conventional architectures cannot achieve the desired…

Computation and Language · Computer Science 2017-11-07 Jingjing Xu , Xu Sun , Sujian Li , Xiaoyan Cai , Bingzhen Wei

Transfer learning is widely used to adapt large pretrained models to new tasks with only a small amount of new data. However, a challenge persists -- the features from the original task often do not fully cover what is needed for unseen…

Machine Learning · Computer Science 2026-02-10 Xingyu Alice Yang , Jianyu Zhang , Léon Bottou

Performing data augmentation for learning deep neural networks is known to be important for training visual recognition systems. By artificially increasing the number of training examples, it helps reducing overfitting and improves…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Nikita Dvornik , Julien Mairal , Cordelia Schmid

Food instance segmentation is essential to estimate the serving size of dishes in a food image. The recent cutting-edge techniques for instance segmentation are deep learning networks with impressive segmentation quality and fast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Huu-Thanh Nguyen , Yu Cao , Chong-Wah Ngo , Wing-Kwong Chan

We consider the transfer of experience samples (i.e., tuples < s, a, s', r >) in reinforcement learning (RL), collected from a set of source tasks to improve the learning process in a given target task. Most of the related approaches focus…

Machine Learning · Computer Science 2018-05-29 Andrea Tirinzoni , Andrea Sessa , Matteo Pirotta , Marcello Restelli

Point Transformers are near state-of-the-art models for classification, segmentation, and detection tasks on Point Cloud data. They utilize a self attention based mechanism to model large range spatial dependencies between multiple point…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Kartik Gupta , Rahul Vippala , Sahima Srivastava