English
Related papers

Related papers: Attentive Feature Reuse for Multi Task Meta learni…

200 papers

Meta-learning stands for 'learning to learn' such that generalization to new tasks is achieved. Among these methods, Gradient-based meta-learning algorithms are a specific sub-class that excel at quick adaptation to new tasks with limited…

Machine Learning · Computer Science 2020-10-20 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

We present an attention-based model for recognizing multiple objects in images. The proposed model is a deep recurrent neural network trained with reinforcement learning to attend to the most relevant regions of the input image. We show…

Machine Learning · Computer Science 2015-04-24 Jimmy Ba , Volodymyr Mnih , Koray Kavukcuoglu

Multi-task learning (MTL) is a powerful approach in deep learning that leverages the information from multiple tasks during training to improve model performance. In medical imaging, MTL has shown great potential to solve various tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Sangwook Kim , Thomas G. Purdie , Chris McIntosh

Attention-based graph neural networks have made great progress in feature matching learning. However, insight of how attention mechanism works for feature matching is lacked in the literature. In this paper, we rethink cross- and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yuxin Deng , Jiayi Ma

Adapting pre-trained models with broad capabilities has become standard practice for learning a wide range of downstream tasks. The typical approach of fine-tuning different models for each task is performant, but incurs a substantial…

When faced with learning a set of inter-related tasks from a limited amount of usable data, learning each task independently may lead to poor generalization performance. Multi-Task Learning (MTL) exploits the latent relations between tasks…

Machine Learning · Computer Science 2015-08-14 Niloofar Yousefi , Michael Georgiopoulos , Georgios C. Anagnostopoulos

We introduce a tensor-based model of shared representation for meta-learning from a diverse set of tasks. Prior works on learning linear representations for meta-learning assume that there is a common shared representation across different…

Machine Learning · Computer Science 2022-01-20 Samuel Deng , Yilin Guo , Daniel Hsu , Debmalya Mandal

Attribute recognition, particularly facial, extracts many labels for each image. While some multi-task vision problems can be decomposed into separate tasks and stages, e.g., training independent models for each task, for a growing set of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Ethan Rudd , Manuel Günther , Terrance Boult

Fine-grained image recognition is central to many multimedia tasks such as search, retrieval and captioning. Unfortunately, these tasks are still challenging since the appearance of samples of the same class can be more different than those…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Pau Rodríguez López , Diego Velazquez Dorta , Guillem Cucurull Preixens , Josep M. Gonfaus , F. Xavier Roca Marva , Jordi Gonzàlez Sabaté

In this paper, we build upon the weakly-supervised generation mechanism of intermediate attention maps in any convolutional neural networks and disclose the effectiveness of attention modules more straightforwardly to fully exploit their…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Duo Li , Qifeng Chen

In recent years, the parameters of backbones of Video Understanding tasks continue to increase and even reach billion-level. Whether fine-tuning a specific task on the Video Foundation Model or pre-training the model designed for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zeyi Bo , Wuxi Sun , Ye Jin

Finetuning a pretrained model has become a standard approach for training neural networks on novel tasks, resulting in fast convergence and improved performance. In this work, we study an alternative finetuning method, where instead of…

Machine Learning · Computer Science 2023-07-04 Gal Kaplun , Andrey Gurevich , Tal Swisa , Mazor David , Shai Shalev-Shwartz , Eran Malach

The automatic characterization of pedestrians in surveillance footage is a tough challenge, particularly when the data is extremely diverse with cluttered backgrounds, and subjects are captured from varying distances, under multiple poses,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Ehsan Yaghoubi , Diana Borza , João Neves , Aruna Kumar , Hugo Proença

In this paper, we propose a novel semi-supervised feature selection framework by mining correlations among multiple tasks and apply it to different multimedia applications. Instead of independently computing the importance of features for…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Yi Yang

Spatio-temporal machine learning is critically needed for a variety of societal applications, such as agricultural monitoring, hydrological forecast, and traffic management. These applications greatly rely on regional features that…

Machine Learning · Computer Science 2023-03-09 Zhexiong Liu , Licheng Liu , Yiqun Xie , Zhenong Jin , Xiaowei Jia

In this work we employ multitask learning to capitalize on the structure that exists in related supervised tasks to train complex neural networks. It allows training a network for multiple objectives in parallel, in order to improve…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Georgios Kapidis , Ronald Poppe , Elsbeth van Dam , Lucas Noldus , Remco Veltkamp

In-context learning with attention enables large neural networks to make context-specific predictions by selectively focusing on relevant examples. Here, we adapt this idea to supervised learning procedures such as lasso regression and…

Machine Learning · Statistics 2025-12-11 Erin Craig , Robert Tibshirani

Deep-learning-based local feature extraction algorithms that combine detection and description have made significant progress in visible image matching. However, the end-to-end training of such frameworks is notoriously unstable due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yuxin Deng , Jiayi Ma

Model-Agnostic Meta-Learning (MAML), a popular gradient-based meta-learning framework, assumes that the contribution of each task or instance to the meta-learner is equal. Hence, it fails to address the domain shift between base and novel…

Machine Learning · Computer Science 2021-12-02 Krishnateja Killamsetty , Changbin Li , Chen Zhao , Rishabh Iyer , Feng Chen

As the range of tasks performed by a general vision system expands, executing multiple tasks accurately and efficiently in a single network has become an important and still open problem. Recent computer vision approaches address this…

Machine Learning · Computer Science 2020-11-02 Hila Levi , Shimon Ullman