English
Related papers

Related papers: A Unifying Framework for Typical Multi-Task Multip…

200 papers

We investigate a general framework of multiplicative multitask feature learning which decomposes each task's model parameters into a multiplication of two components. One of the components is used across all tasks and the other component is…

Machine Learning · Computer Science 2016-10-25 Xin Wang , Jinbo Bi , Shipeng Yu , Jiangwen Sun

Despite the recent progress towards efficient multiple kernel learning (MKL), the structured output case remains an open research front. Current approaches involve repeatedly solving a batch learning problem, which makes them inadequate for…

Machine Learning · Statistics 2010-10-15 Andre F. T. Martins , Mario A. T. Figueiredo , Pedro M. Q. Aguiar , Noah A. Smith , Eric P. Xing

This paper presents a new multitask learning framework that learns a shared representation among the tasks, incorporating both task and feature clusters. The jointly-induced clusters yield a shared latent subspace where task relationships…

Machine Learning · Statistics 2017-03-06 Keerthiram Murugesan , Jaime Carbonell , Yiming Yang

This paper develops a novel machine learning-based framework using Semi-Supervised Multi-Task Learning (SS-MTL) for power system dynamic security assessment that is accurate, reliable, and aware of topological changes. The learning…

Machine Learning · Computer Science 2024-07-15 Muhy Eddin Za'ter , Amirhossein Sajadi , Bri-Mathias Hodge

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

Machine Learning · Computer Science 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

The Multi-Task Learning (MTL) technique has been widely studied by word-wide researchers. The majority of current MTL studies adopt the hard parameter sharing structure, where hard layers tend to learn general representations over all tasks…

Information Retrieval · Computer Science 2021-01-25 Dehong Gao , Wenjing Yang , Huiling Zhou , Yi Wei , Yi Hu , Hao Wang

We propose a strategy for land use classification which exploits Multiple Kernel Learning (MKL) to automatically determine a suitable combination of a set of features without requiring any heuristic knowledge about the classification task.…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Claudio Cusano , Paolo Napoletano , Raimondo Schettini

Multi-task learning (MTL) is to learn one single model that performs multiple tasks for achieving good performance on all tasks and lower cost on computation. Learning such a model requires to jointly optimize losses of a set of tasks with…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Wei-Hong Li , Hakan Bilen

Large language models (LLM) have recently shown the extraordinary ability to perform unseen tasks based on few-shot examples provided as text, also known as in-context learning (ICL). While recent works have attempted to understand the…

Computation and Language · Computer Science 2024-04-05 Harmon Bhasin , Timothy Ossowski , Yiqiao Zhong , Junjie Hu

Multi-task learning (MTL) is a supervised learning paradigm in which the prediction models for several related tasks are learned jointly to achieve better generalization performance. When there are only a few training examples per task, MTL…

Machine Learning · Computer Science 2017-06-07 Azad Naik , Anveshi Charuvaka , Huzefa Rangwala

We propose a simple yet effective multiple kernel clustering algorithm, termed simple multiple kernel k-means (SimpleMKKM). It extends the widely used supervised kernel alignment criterion to multi-kernel clustering. Our criterion is given…

Machine Learning · Computer Science 2020-05-13 Xinwang Liu , En Zhu , Jiyuan Liu , Timothy Hospedales , Yang Wang , Meng Wang

Multi-task learning (MTL) has shown great potential in medical image analysis, improving the generalizability of the learned features and the performance in individual tasks. However, most of the work on MTL focuses on either architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Fuping Wu , Le Zhang , Yang Sun , Yuanhan Mo , Thomas Nichols , Bartlomiej W. Papiez

Multi-task learning (MTL) jointly learns a set of tasks by sharing parameters among tasks. It is a promising approach for reducing storage costs while improving task accuracy for many computer vision tasks. The effective adoption of MTL…

Machine Learning · Computer Science 2022-10-03 Lijun Zhang , Xiao Liu , Hui Guan

The performance of reproducing kernel Hilbert space-based methods is known to be sensitive to the choice of the reproducing kernel. Choosing an adequate reproducing kernel can be challenging and computationally demanding, especially in…

Machine Learning · Computer Science 2023-11-07 Emilio Ruiz-Moreno , Baltasar Beferull-Lozano

Kernel fusion is a popular and effective approach for combining multiple features that characterize different aspects of data. Traditional approaches for Multiple Kernel Learning (MKL) attempt to learn the parameters for combining the…

In this paper we propose a general framework to integrate supervised and unsupervised examples with background knowledge expressed by a collection of first-order logic clauses into kernel machines. In particular, we consider a multi-task…

Machine Learning · Computer Science 2024-02-06 Michelangelo Diligenti , Marco Gori , Marco Maggini , Leonardo Rigutini

Significant advancements has recently been achieved in the field of multi-modal large language models (MLLMs), demonstrating their remarkable capabilities in understanding and reasoning across diverse tasks. However, these models are often…

Computation and Language · Computer Science 2024-08-06 Zhaowei Li , Wei Wang , YiQing Cai , Xu Qi , Pengyu Wang , Dong Zhang , Hang Song , Botian Jiang , Zhida Huang , Tao Wang

Recently, the database management system (DBMS) community has witnessed the power of machine learning (ML) solutions for DBMS tasks. Despite their promising performance, these existing solutions can hardly be considered satisfactory. First,…

Databases · Computer Science 2021-11-29 Ziniu Wu , Pei Yu , Peilun Yang , Rong Zhu , Yuxing Han , Yaliang Li , Defu Lian , Kai Zeng , Jingren Zhou

Activity recognition from first-person (ego-centric) videos has recently gained attention due to the increasing ubiquity of the wearable cameras. There has been a surge of efforts adapting existing feature descriptors and designing new…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Fatih Ozkan , Mehmet Ali Arabaci , Elif Surer , Alptekin Temizel