English
Related papers

Related papers: Network Clustering for Multi-task Learning

200 papers

Neural network based methods have obtained great progress on a variety of natural language processing tasks. However, in most previous works, the models are learned based on single-task supervised objectives, which often suffer from…

Computation and Language · Computer Science 2016-05-18 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Multi-Task Learning (MTL) enables a single model to learn multiple tasks simultaneously, leveraging knowledge transfer among tasks for enhanced generalization, and has been widely applied across various domains. However, task imbalance…

Machine Learning · Computer Science 2025-10-22 Xiaohan Qin , Xiaoxing Wang , Ning Liao , Junchi Yan

Clustering traditionally aims to reveal a natural grouping structure within unlabeled data. However, this structure may not always align with users' preferences. In this paper, we propose a personalized clustering method that explicitly…

Machine Learning · Computer Science 2025-05-28 Xiwen Geng , Suyun Zhao , Yixin Yu , Borui Peng , Pan Du , Hong Chen , Cuiping Li , Mengdie Wang

Multitask learning (MTL) has recently gained a lot of popularity as a learning paradigm that can lead to improved per-task performance while also using fewer per-task model parameters compared to single task learning. One of the biggest…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Dimitrios Sinodinos , Narges Armanfard

In this paper, we introduce Traversal Learning (TL), a novel approach designed to address the problem of decreased quality encountered in popular distributed learning (DL) paradigms such as Federated Learning (FL), Split Learning (SL), and…

Machine Learning · Computer Science 2025-09-11 Erdenebileg Batbaatar , Jeonggeol Kim , Yongcheol Kim , Young Yoon

Clustering a lexicon of words is a well-studied problem in natural language processing (NLP). Word clusters are used to deal with sparse data in statistical language processing, as well as features for solving various NLP tasks (text…

Computation and Language · Computer Science 2018-08-17 Effi Levi , Saggy Herman , Ari Rappoport

Clustering is a class of unsupervised learning methods that has been extensively applied and studied in computer vision. Little work has been done to adapt it to the end-to-end training of visual features on large scale datasets. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Mathilde Caron , Piotr Bojanowski , Armand Joulin , Matthijs Douze

Multi-task learning in Convolutional Networks has displayed remarkable success in the field of recognition. This success can be largely attributed to learning shared representations from multiple supervisory tasks. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Ishan Misra , Abhinav Shrivastava , Abhinav Gupta , Martial Hebert

The human brain can effectively learn a new task from a small number of samples, which indicate that the brain can transfer its prior knowledge to solve tasks in different domains. This function is analogous to transfer learning (TL) in the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Satoshi Nishida , Yusuke Nakano , Antoine Blanc , Naoya Maeda , Masataka Kado , Shinji Nishimoto

This paper introduces a new and effective algorithm for learning kernels in a Multi-Task Learning (MTL) setting. Although, we consider a MTL scenario here, our approach can be easily applied to standard single task learning, as well. As…

Machine Learning · Computer Science 2017-07-13 Niloofar Yousefi , Cong Li , Mansooreh Mollaghasemi , Georgios Anagnostopoulos , Michael Georgiopoulos

Spectral clustering is a powerful technique for clustering high-dimensional data, utilizing graph-based representations to detect complex, non-linear structures and non-convex clusters. The construction of a similarity graph is essential…

Machine Learning · Computer Science 2025-01-27 Kamal Berahmand , Farid Saberi-Movahed , Razieh Sheikhpour , Yuefeng Li , Mahdi Jalili

Short text clustering is a challenging problem due to its sparseness of text representation. Here we propose a flexible Self-Taught Convolutional neural network framework for Short Text Clustering (dubbed STC^2), which can flexibly and…

Information Retrieval · Computer Science 2017-01-03 Jiaming Xu , Bo Xu , Peng Wang , Suncong Zheng , Guanhua Tian , Jun Zhao , Bo Xu

Recent approaches to multi-task learning (MTL) have focused on modelling connections between tasks at the decoder level. This leads to a tight coupling between tasks, which need retraining if a new task is inserted or removed. We argue that…

Machine Learning · Computer Science 2022-04-13 Jaime Spencer , Richard Bowden , Simon Hadfield

Contrastive learning has been frequently investigated to learn effective representations for text clustering tasks. While existing contrastive learning-based text clustering methods only focus on modeling instance-wise semantic similarity…

Computation and Language · Computer Science 2024-08-27 Qian Yong , Chen Chen , Xiabing Zhou

Multi-task learning (MTL) has recently contributed to learning better representations in service of various NLP tasks. MTL aims at improving the performance of a primary task, by jointly training on a secondary task. This paper introduces…

Machine Learning · Computer Science 2017-09-21 Davis Liang , Yan Shu

Standard meta-learning for representation learning aims to find a common representation to be shared across multiple tasks. The effectiveness of these methods is often limited when the nuances of the tasks' distribution cannot be captured…

Machine Learning · Computer Science 2021-03-31 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

Multi-view subspace clustering aims to divide a set of multisource data into several groups according to their underlying subspace structure. Although the spectral clustering based methods achieve promotion in multi-view clustering, their…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Zhiqiang Lu , Hao Tang , Yan Yan , Songhao Zhu , Xiao-Yuan Jing , Zuoyong Li

This work proposes Multi-task Meta Learning (MTML), integrating two learning paradigms Multi-Task Learning (MTL) and meta learning, to bring together the best of both worlds. In particular, it focuses simultaneous learning of multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Richa Upadhyay , Prakash Chandra Chhipa , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Transfer and multi-task learning have traditionally focused on either a single source-target pair or very few, similar tasks. Ideally, the linguistic levels of morphology, syntax and semantics would benefit each other by being trained in a…

Computation and Language · Computer Science 2017-07-25 Kazuma Hashimoto , Caiming Xiong , Yoshimasa Tsuruoka , Richard Socher

We propose a novel framework for image clustering that incorporates joint representation learning and clustering. Our method consists of two heads that share the same backbone network - a "representation learning" head and a "clustering"…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Kien Do , Truyen Tran , Svetha Venkatesh