English
Related papers

Related papers: Multi-Task Learning with Sequence-Conditioned Tran…

200 papers

Multitask learning is a framework that enforces multiple learning tasks to share knowledge to improve their generalization abilities. While shallow multitask learning can learn task relations, it can only handle predefined features. Modern…

Machine Learning · Computer Science 2022-07-05 Guangji Bai , Liang Zhao

Optimizing the performance of many objectives (instantiated by tasks or clients) jointly with a few Pareto stationary solutions (models) is critical in machine learning. However, previous multi-objective optimization methods often focus on…

Machine Learning · Computer Science 2024-03-08 Ziyue Li , Tian Li , Virginia Smith , Jeff Bilmes , Tianyi Zhou

Artificial neural networks suffer from catastrophic forgetting when they are sequentially trained on multiple tasks. To overcome this problem, we present a novel approach based on task-conditioned hypernetworks, i.e., networks that generate…

Machine Learning · Computer Science 2022-04-12 Johannes von Oswald , Christian Henning , Benjamin F. Grewe , João Sacramento

With increasing complexity of modern communication systems, machine learning algorithms have become a focal point of research. However, performance demands have tightened in parallel to complexity. For some of the key applications targeted…

Machine Learning · Computer Science 2023-04-26 Steffen Gracla , Carsten Bockelmann , Armin Dekorsy

We present a novel approach for constrained Bayesian inference. Unlike current methods, our approach does not require convexity of the constraint set. We reduce the constrained variational inference to a parametric optimization over the…

Machine Learning · Computer Science 2013-09-27 Oluwasanmi Koyejo , Joydeep Ghosh

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

Machine Learning · Computer Science 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

We address the problem of modeling and prediction of a set of temporal events in the context of intelligent transportation systems. To leverage the information shared by different events, we propose a multi-task learning framework. We…

Machine Learning · Computer Science 2017-12-25 Boris Chidlovskii

In multi-task learning, difficulty levels of different tasks are varying. There are many works to handle this situation and we classify them into five categories, including the direct sum approach, the weighted sum approach, the maximum…

Machine Learning · Computer Science 2020-02-13 Sicong Liang , Yu Zhang

Text classification is a challenging problem which aims to identify the category of texts. In the process of training, word embeddings occupy a large part of parameters. Under the limitation of limited computing resources, it indirectly…

Machine Learning · Computer Science 2022-06-03 Hao Ren , Hong Lu

Multi-task learning (MTL) aims to improve the performance of multiple related prediction tasks by leveraging useful information from them. Due to their flexibility and ability to reduce unknown coefficients substantially, the…

Machine Learning · Computer Science 2022-12-01 Yuzhao Zhang , Yifan Sun

Autonomous multi-agent systems such as hospital robots and package delivery drones often operate in highly uncertain environments and are expected to achieve complex temporal task objectives while ensuring safety. While learning-based…

Multiagent Systems · Computer Science 2024-11-19 Sheryl Paul , Anand Balakrishnan , Xin Qin , Jyotirmoy V. Deshmukh

Financial forecasting is challenging and attractive in machine learning. There are many classic solutions, as well as many deep learning based methods, proposed to deal with it yielding encouraging performance. Stock time series forecasting…

Machine Learning · Computer Science 2019-01-23 Tao Ma

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

Training a single model on multiple input domains and/or output tasks allows for compressing information from multiple sources into a unified backbone hence improves model efficiency. It also enables potential positive knowledge transfer…

Machine Learning · Computer Science 2023-10-16 Amelie Royer , Tijmen Blankevoort , Babak Ehteshami Bejnordi

Multi-task reinforcement learning (MTRL) aims to train a single agent to efficiently optimize performance across multiple tasks simultaneously. However, jointly optimizing all tasks often yields imbalanced learning: agents quickly solve…

Machine Learning · Computer Science 2026-05-15 Nicholas E. Corrado , Wenyuan Huang , Josiah P. Hanna

Reinforcement Learning (RL) has made significant strides in enabling artificial agents to learn diverse behaviors. However, learning an effective policy often requires a large number of environment interactions. To mitigate sample…

Artificial Intelligence · Computer Science 2024-04-04 Yash Shukla , Tanushree Burman , Abhishek Kulkarni , Robert Wright , Alvaro Velasquez , Jivko Sinapov

This paper presents a new multitask learning framework that learns a shared representation among the tasks, incorporating both task and feature clusters. The jointly-induced clusters yield a shared latent subspace where task relationships…

Machine Learning · Statistics 2017-03-06 Keerthiram Murugesan , Jaime Carbonell , Yiming Yang

This paper presents a general framework to integrate prior knowledge in the form of logic constraints among a set of task functions into kernel machines. The logic propositions provide a partial representation of the environment, in which…

Machine Learning · Computer Science 2024-02-19 Michelangelo Diligenti , Marco Gori , Marco Maggini , Leonardo Rigutini

The vast network of bridges in the United States raises a high requirement for maintenance and rehabilitation. The massive cost of manual visual inspection to assess bridge conditions is a burden to some extent. Advanced robots have been…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Chenyu Zhang , Muhammad Monjurul Karim , Ruwen Qin

We propose a general framework for creating parameterized control schemes for decentralized multi-robot systems. A variety of tasks can be seen in the decentralized multi-robot literature, each with many possible control schemes. For…

Robotics · Computer Science 2022-03-24 Stephen Jacobs , R. Michael Butts , Yu Gu , Ali Baheri , Guilherme A. S. Pereira