English
Related papers

Related papers: A Multi-Task Gradient Descent Method for Multi-Lab…

200 papers

This paper investigates the stochastic optimization problem with a focus on developing scalable parallel algorithms for deep learning tasks. Our solution involves a reformation of the objective function for stochastic optimization in neural…

Machine Learning · Computer Science 2020-04-09 Pengzhan Guo , Zeyang Ye , Keli Xiao , Wei Zhu

Multi-grade deep learning (MGDL) has been shown to significantly outperform the standard single-grade deep learning (SGDL) across various applications. This work aims to investigate the computational advantages of MGDL focusing on its…

Machine Learning · Computer Science 2025-07-29 Ronglong Fang , Yuesheng Xu

Conventional gradient descent methods compute the gradients for multiple variables through the partial derivative. Treating the coupled variables independently while ignoring the interaction, however, leads to an insufficient optimization…

Machine Learning · Computer Science 2021-06-22 Runqi Wang , Baochang Zhang , Li'an Zhuo , Qixiang Ye , David Doermann

Despite the success of deep learning in computer vision and natural language processing, Gradient Boosted Decision Tree (GBDT) is yet one of the most powerful tools for applications with tabular data such as e-commerce and FinTech. However,…

Machine Learning · Computer Science 2022-01-25 ZhenZhe Ying , Zhuoer Xu , Zhifeng Li , Weiqiang Wang , Changhua Meng

Since annotating medical images for segmentation tasks commonly incurs expensive costs, it is highly desirable to design an annotation-efficient method to alleviate the annotation burden. Recently, contrastive learning has exhibited a great…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yixuan Wu , Jintai Chen , Jiahuan Yan , Yiheng Zhu , Danny Z. Chen , Jian Wu

Medical image classification involves thresholding of labels that represent malignancy risk levels. Usually, a task defines a single threshold, and when developing computer-aided diagnosis tools, a single network is trained per such…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Vadim Ratner , Yoel Shoshan , Tal Kachman

The cost of labeling data often limits the performance of machine learning systems. In multi-task learning, related tasks provide information to each other and improve overall performance, but the label cost can vary among tasks. How should…

Machine Learning · Computer Science 2023-08-25 Ximeng Sun , Kihyuk Sohn , Kate Saenko , Clayton Mellina , Xiao Bian

The learning from imbalanced data is a deeply studied problem in standard classification and, in recent times, also in multilabel classification. A handful of multilabel resampling methods have been proposed in late years, aiming to balance…

Machine Learning · Computer Science 2018-02-15 Francisco Charte , Antonio J. Rivera , María J. del Jesus , Francisco Herrera

Currently there are several well-known approaches to non-intrusive appliance load monitoring rule based, stochastic finite state machines, neural networks and sparse coding. Recently several studies have proposed a new approach based on…

Signal Processing · Electrical Eng. & Systems 2019-12-17 Vanika Singhal , Jyoti Maggu , Angshul Majumdar

We combine multi-task learning and semi-supervised learning by inducing a joint embedding space between disparate label spaces and learning transfer functions between label embeddings, enabling us to jointly leverage unlabelled data and…

Computation and Language · Computer Science 2018-04-10 Isabelle Augenstein , Sebastian Ruder , Anders Søgaard

Edge detection is among the most fundamental vision problems for its role in perceptual grouping and its wide applications. Recent advances in representation learning have led to considerable improvements in this area. Many state of the art…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Zhiding Yu , Weiyang Liu , Yang Zou , Chen Feng , Srikumar Ramalingam , B. V. K. Vijaya Kumar , Jan Kautz

Multi-label text classification (MLTC) is an attractive and challenging task in natural language processing (NLP). Compared with single-label text classification, MLTC has a wider range of applications in practice. In this paper, we propose…

Computation and Language · Computer Science 2022-05-24 Irene Li , Aosong Feng , Hao Wu , Tianxiao Li , Toyotaro Suzumura , Ruihai Dong

Label Distribution Learning (LDL) is an effective approach for handling label ambiguity, as it can analyze all labels at once and indicate the extent to which each label describes a given sample. Most existing LDL methods consider the…

Machine Learning · Computer Science 2024-11-21 Ziqi Jia , Xiaoyang Qu , Chenghao Liu , Jianzong Wang

In Multi-Label Text Classification (MLTC), one sample can belong to more than one class. It is observed that most MLTC tasks, there are dependencies or correlations among labels. Existing methods tend to ignore the relationship among…

Computation and Language · Computer Science 2020-03-27 Ankit Pal , Muru Selvakumar , Malaikannan Sankarasubbu

Representation learning is a widely adopted framework for learning in data-scarce environments to obtain a feature extractor or representation from various different yet related tasks. Despite extensive research on representation learning,…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

We address the challenge of getting efficient yet accurate recognition systems with limited labels. While recognition models improve with model size and amount of data, many specialized applications of computer vision have severe resource…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Kenneth Borup , Cheng Perng Phoo , Bharath Hariharan

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

Machine Learning · Statistics 2023-09-19 Yaqi Duan , Kaizheng Wang

Multi-label classification is an approach which allows a datapoint to be labelled with more than one class at the same time. A common but trivial approach is to train individual binary classifiers per label, but the performance can be…

Machine Learning · Computer Science 2019-04-25 Arjun Pakrashi , Brian Mac Namee

Multi-label learning deals with the problem that each instance is associated with multiple labels simultaneously. Most of the existing approaches aim to improve the performance of multi-label learning by exploiting label correlations.…

Machine Learning · Computer Science 2022-01-19 Senlin Shu , Fengmao Lv , Yan Yan , Li Li , Shuo He , Jun He

This paper presents a novel graph-theoretic deep representation learning method in the framework of multi-label remote sensing (RS) image retrieval problems. The proposed method aims to extract and exploit multi-label co-occurrence…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Gencer Sumbul , Begüm Demir