English
Related papers

Related papers: Feature Partitioning for Efficient Multi-Task Arch…

200 papers

Solving multiple visual tasks using individual models can be resource-intensive, while multi-task learning can conserve resources by sharing knowledge across different tasks. Despite the benefits of multi-task learning, such techniques can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Sara Shoouri , Mingyu Yang , Zichen Fan , Hun-Seok Kim

Multi-task learning aims to improve generalization performance of multiple prediction tasks by appropriately sharing relevant information across them. In the context of deep neural networks, this idea is often realized by hand-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Yongxi Lu , Abhishek Kumar , Shuangfei Zhai , Yu Cheng , Tara Javidi , Rogerio Feris

We propose a novel neural architecture search algorithm via reinforcement learning by decoupling structure and operation search processes. Our approach samples candidate models from the multinomial distribution on the policy vectors defined…

Machine Learning · Computer Science 2020-04-28 Heung-Chang Lee , Do-Guk Kim , Bohyung Han

Most existing deep multi-task learning models are based on parameter sharing, such as hard sharing, hierarchical sharing, and soft sharing. How choosing a suitable sharing mechanism depends on the relations among the tasks, which is not…

Computation and Language · Computer Science 2019-11-19 Tianxiang Sun , Yunfan Shao , Xiaonan Li , Pengfei Liu , Hang Yan , Xipeng Qiu , Xuanjing Huang

In this paper, we propose a novel semi-supervised feature selection framework by mining correlations among multiple tasks and apply it to different multimedia applications. Instead of independently computing the importance of features for…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Yi Yang

When faced with learning a set of inter-related tasks from a limited amount of usable data, learning each task independently may lead to poor generalization performance. Multi-Task Learning (MTL) exploits the latent relations between tasks…

Machine Learning · Computer Science 2015-08-14 Niloofar Yousefi , Michael Georgiopoulos , Georgios C. Anagnostopoulos

The multi-modal nature of many vision problems calls for neural network architectures that can perform multiple tasks concurrently. Typically, such architectures have been handcrafted in the literature. However, given the size and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 David Bruggemann , Menelaos Kanakis , Stamatios Georgoulis , Luc Van Gool

One of the main motivations of MTL is to develop neural networks capable of inferring multiple tasks simultaneously. While countless methods have been proposed in the past decade investigating robust model architectures and efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Dayou Mao , Yuhao Chen , Yifan Wu , Maximilian Gilles , Alexander Wong

Multi-task learning is a powerful method for solving several tasks jointly by learning robust representation. Optimization of the multi-task learning model is a more complex task than a single-task due to task conflict. Based on theoretical…

Machine Learning · Computer Science 2021-10-05 Andrey Filatov , Daniil Merkulov

There is a growing interest in designing models that can deal with images from different visual domains. If there exists a universal structure in different visual domains that can be captured via a common parameterization, then we can use a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Yunhui Guo , Yandong Li , Rogerio Feris , Liqiang Wang , Tajana Rosing

Multi-task learning is an open and challenging problem in computer vision. The typical way of conducting multi-task learning with deep neural networks is either through handcrafted schemes that share all initial layers and branch out at an…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Ximeng Sun , Rameswar Panda , Rogerio Feris , Kate Saenko

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

As deep learning applications continue to become more diverse, an interesting question arises: Can general problem solving arise from jointly learning several such diverse tasks? To approach this question, deep multi-task learning is…

Machine Learning · Computer Science 2019-10-29 Elliot Meyerson , Risto Miikkulainen

The design of neural network architectures is an important component for achieving state-of-the-art performance with machine learning systems across a broad array of tasks. Much work has endeavored to design and build architectures…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Liang-Chieh Chen , Maxwell D. Collins , Yukun Zhu , George Papandreou , Barret Zoph , Florian Schroff , Hartwig Adam , Jonathon Shlens

We aim to train a multi-task model such that users can adjust the desired compute budget and relative importance of task performances after deployment, without retraining. This enables optimizing performance for dynamically varying user…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Abhishek Aich , Samuel Schulter , Amit K. Roy-Chowdhury , Manmohan Chandraker , Yumin Suh

One approach for improving sample efficiency in cooperative multi-agent learning is to decompose overall tasks into sub-tasks that can be assigned to individual agents. We study this problem in the context of reward machines: symbolic tasks…

Multiagent Systems · Computer Science 2025-02-20 Ameesh Shah , Niklas Lauffer , Thomas Chen , Nikhil Pitta , Sanjit A. Seshia

This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Abrar H. Abdulnabi , Gang Wang , Jiwen Lu , Kui Jia

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

Traditional distributed detection systems are often designed for a single target application. However, with the emergence of the Internet of Things (IoT) paradigm, next-generation systems are expected to be a shared infrastructure for…

Systems and Control · Computer Science 2017-05-10 Long N. Le , Douglas L. Jones

Multi-task networks rely on effective parameter sharing to achieve robust generalization across tasks. In this paper, we present a novel parameter sharing method for multi-task learning that conditions parameter sharing on both the task and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Elahe Rahimian , Golara Javadi , Frederick Tung , Gabriel Oliveira
‹ Prev 1 2 3 10 Next ›