English
Related papers

Related papers: Multitask Hopfield Networks

200 papers

The human ability to synchronize the feedback from all their senses inspired recent works in multi-task and multi-modal learning. While these works rely on expensive supervision, our multi-task graph requires only pseudo-labels from expert…

Machine Learning · Computer Science 2021-11-05 Emanuela Haller , Elena Burceanu , Marius Leordeanu

This paper explores learned-context neural networks. It is a multi-task learning architecture based on a fully shared neural network and an augmented input vector containing trainable task parameters. The architecture is interesting due to…

Machine Learning · Computer Science 2025-08-07 Anders T. Sandnes , Bjarne Grimstad , Odd Kolbjørnsen

Graph self-supervised learning has gained increasing attention due to its capacity to learn expressive node representations. Many pretext tasks, or loss functions have been designed from distinct perspectives. However, we observe that…

Machine Learning · Computer Science 2022-03-23 Wei Jin , Xiaorui Liu , Xiangyu Zhao , Yao Ma , Neil Shah , Jiliang Tang

We learn multiple hypotheses for related tasks under a latent hierarchical relationship between tasks. We exploit the intuition that for domain adaptation, we wish to share classifier structure, but for multitask learning, we wish to share…

Machine Learning · Computer Science 2014-08-12 Hal Daume

We learn multiple hypotheses for related tasks under a latent hierarchical relationship between tasks. We exploit the intuition that for domain adaptation, we wish to share classifier structure, but for multitask learning, we wish to share…

Machine Learning · Computer Science 2009-07-07 Hal Daumé

In recent years, simultaneous learning of multiple dense prediction tasks with partially annotated label data has emerged as an important research area. Previous works primarily focus on leveraging cross-task relations or conducting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Jingdong Zhang , Hanrong Ye , Xin Li , Wenping Wang , Dan Xu

In this work we address task interference in universal networks by considering that a network is trained on multiple tasks, but performs one task at a time, an approach we refer to as "single-tasking multiple tasks". The network thus…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Kevis-Kokitsi Maninis , Ilija Radosavovic , Iasonas Kokkinos

The benefit of multi-task learning over single-task learning relies on the ability to use relations across tasks to improve performance on any single task. While sharing representations is an important mechanism to share information across…

Machine Learning · Computer Science 2021-06-14 Shagun Sodhani , Amy Zhang , Joelle Pineau

In this paper, we propose a novel semi-supervised feature selection framework by mining correlations among multiple tasks and apply it to different multimedia applications. Instead of independently computing the importance of features for…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Yi Yang

Multi-task learning in Convolutional Networks has displayed remarkable success in the field of recognition. This success can be largely attributed to learning shared representations from multiple supervisory tasks. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Ishan Misra , Abhinav Shrivastava , Abhinav Gupta , Martial Hebert

Multi-task learning (MTL) is a supervised learning paradigm in which the prediction models for several related tasks are learned jointly to achieve better generalization performance. When there are only a few training examples per task, MTL…

Machine Learning · Computer Science 2017-06-07 Azad Naik , Anveshi Charuvaka , Huzefa Rangwala

Many real-world data can be represented as heterogeneous graphs with different types of nodes and connections. Heterogeneous graph neural network model aims to embed nodes or subgraphs into low-dimensional vector space for various…

Artificial Intelligence · Computer Science 2024-12-24 Xinjun Cai , Jiaxing Shang , Fei Hao , Dajiang Liu , Linjiang Zheng

Many complex real-world tasks are composed of several levels of sub-tasks. Humans leverage these hierarchical structures to accelerate the learning process and achieve better generalization. In this work, we study the inductive bias and…

Machine Learning · Computer Science 2021-03-23 Yuchen Lu , Yikang Shen , Siyuan Zhou , Aaron Courville , Joshua B. Tenenbaum , Chuang Gan

Automated protein function prediction is a challenging problem with distinctive features, such as the hierarchical organization of protein functions and the scarcity of annotated proteins for most biological functions. We propose a…

Machine Learning · Statistics 2019-04-09 Marco Frasca , Nicolò Cesa Bianchi

Multitask learning is a methodology to boost generalization performance and also reduce computational intensity and memory usage. However, learning multiple tasks simultaneously can be more difficult than learning a single task because it…

Machine Learning · Computer Science 2020-06-03 Sungjae Lee , Youngdoo Son

Multi-task learning (MTL) jointly learns a set of tasks by sharing parameters among tasks. It is a promising approach for reducing storage costs while improving task accuracy for many computer vision tasks. The effective adoption of MTL…

Machine Learning · Computer Science 2022-10-03 Lijun Zhang , Xiao Liu , Hui Guan

The pre-training and fine-tuning methods have gained widespread attention in the field of heterogeneous graph neural networks due to their ability to leverage large amounts of unlabeled data during the pre-training phase, allowing the model…

Machine Learning · Computer Science 2025-07-11 Pengfei Jiao , Jialong Ni , Di Jin , Xuan Guo , Huan Liu , Hongjiang Chen , Yanxian Bi

Streamflow, vital for water resource management, is governed by complex hydrological systems involving intermediate processes driven by meteorological forces. While deep learning models have achieved state-of-the-art results of streamflow…

Training multiple tasks jointly in one deep network yields reduced latency during inference and better performance over the single-task counterpart by sharing certain layers of a network. However, over-sharing a network could erroneously…

Machine Learning · Computer Science 2020-06-11 Pengsheng Guo , Chen-Yu Lee , Daniel Ulbricht

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool