English
Related papers

Related papers: Multi-Task Learning with Loop Specific Attention f…

200 papers

Tasks that involve interaction with various targets are called multi-target tasks. When applying general reinforcement learning approaches for such tasks, certain targets that are difficult to access or interact with may be neglected…

Machine Learning · Computer Science 2023-05-24 Kibeom Kim , Hyundo Lee , Min Whoo Lee , Moonheon Lee , Minsu Lee , Byoung-Tak Zhang

In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method for learning region-level feature representation for dense prediction tasks. Our method is motivated by the three…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Qiushan Guo , Yizhou Yu , Yi Jiang , Jiannan Wu , Zehuan Yuan , Ping Luo

Pre-training has been an important ingredient in developing strong monocular depth estimation models in recent years. For instance, self-supervised learning (SSL) is particularly effective by alleviating the need for large datasets with…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Muhammad Osama Khan , Junbang Liang , Chun-Kai Wang , Shan Yang , Yu Lou

Magnetic resonance imaging (MRI) acquisition, reconstruction, and segmentation are usually processed independently in the conventional practice of MRI workflow. It is easy to notice that there are significant relevances among these tasks…

Image and Video Processing · Electrical Eng. & Systems 2021-05-17 Zhiwen Wang , Wenjun Xia , Zexin Lu , Yongqiang Huang , Yan Liu , Hu Chen , Jiliu Zhou , Yi Zhang

Real-time lower limb movement resistance monitoring is critical for various applications in clinical and sports settings, such as rehabilitation and athletic training. Current methods often face limitations in accuracy, computational…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Buren Batu , Yuanmeng Liu , Tianyi Lyu

Low-Rank Adaptation (LoRA) has gained popularity for fine-tuning large foundation models, leveraging low-rank matrices $\mathbf{A}$ and $\mathbf{B}$ to represent weight changes (i.e., $\Delta \mathbf{W} = \mathbf{B} \mathbf{A}$). This…

Machine Learning · Computer Science 2025-07-02 Aochuan Chen , Jiashun Cheng , Zijing Liu , Ziqi Gao , Fugee Tsung , Yu Li , Jia Li

Foundation models pretrained on large-scale 3D medical imaging data face challenges when adapted to multiple downstream tasks under continual learning with limited labeled data. We address few-shot continual learning for 3D brain MRI by…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Chi-Sheng Chen , Xinyu Zhang , Guan-Ying Chen , Qiuzhe Xie , Fan Zhang , En-Jui Kuo

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

The research addresses sensor task management for radar systems, focusing on efficiently searching and tracking multiple targets using reinforcement learning. The approach develops a 3D simulation environment with an active electronically…

Machine Learning · Computer Science 2025-02-20 Jan-Hendrik Ewers , David Cormack , Joe Gibbs , David Anderson

To leverage the copious amount of data from source tasks and overcome the scarcity of the target task samples, representation learning based on multi-task pretraining has become a standard approach in many applications. However, up until…

Machine Learning · Computer Science 2023-06-06 Yiping Wang , Yifang Chen , Kevin Jamieson , Simon S. Du

In applications such as e-commerce, online education, and streaming services, sequential recommendation systems play a critical role. Despite the excellent performance of self-attention-based sequential recommendation models in capturing…

Information Retrieval · Computer Science 2026-02-06 Jinzhao Su , Zhenhua Huang

Representation-based multi-task learning (MTL) improves efficiency by learning a shared structure across tasks, but its practical application is often hindered by contamination, outliers, or adversarial tasks. Most existing methods and…

Machine Learning · Statistics 2025-09-09 Yian Huang , Yang Feng , Zhiliang Ying

Although deep convolutional networks have been widely studied for head and neck (HN) organs at risk (OAR) segmentation, their use for routine clinical treatment planning is limited by a lack of robustness to imaging artifacts, low soft…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Harini Veeraraghavan , Jue Jiang , Sharif Elguindi , Sean L. Berry , Ifeanyirochukwu Onochie , Aditya Apte , Laura Cervino , Joseph O. Deasy

LoRA achieves remarkable resource efficiency and comparable performance when adapting LLMs for specific tasks. Since ChatGPT demonstrated superior performance on various tasks, there has been a growing desire to adapt one model for all…

Machine Learning · Computer Science 2023-11-21 Yiming Wang , Yu Lin , Xiaodong Zeng , Guannan Zhang

Semi-supervised domain adaptation (SSDA) aims to apply knowledge learned from a fully labeled source domain to a scarcely labeled target domain. In this paper, we propose a Multi-level Consistency Learning (MCL) framework for SSDA.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Zizheng Yan , Yushuang Wu , Guanbin Li , Yipeng Qin , Xiaoguang Han , Shuguang Cui

Multi-task learning (MTL) aims to improve estimation and prediction performance by sharing common information among related tasks. One natural assumption in MTL is that tasks are classified into clusters based on their characteristics.…

Methodology · Statistics 2024-05-28 Akira Okazaki , Shuichi Kawano

In the field of multi-task reinforcement learning, the modular principle, which involves specializing functionalities into different modules and combining them appropriately, has been widely adopted as a promising approach to prevent the…

Machine Learning · Computer Science 2023-11-03 Siming Lan , Rui Zhang , Qi Yi , Jiaming Guo , Shaohui Peng , Yunkai Gao , Fan Wu , Ruizhi Chen , Zidong Du , Xing Hu , Xishan Zhang , Ling Li , Yunji Chen

Accurate identification of late-life depression (LLD) using structural brain MRI is essential for monitoring disease progression and facilitating timely intervention. However, existing learning-based approaches for LLD detection are often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Yuzhen Gao , Qianqian Wang , Yongheng Sun , Cui Wang , Yongquan Liang , Mingxia Liu

In line with recent advances in neural drug design and sensitivity prediction, we propose a novel architecture for interpretable prediction of anticancer compound sensitivity using a multimodal attention-based convolutional encoder. Our…

Multi-task learning has the potential to improve generalization by maximizing positive transfer between tasks while reducing task interference. Fully achieving this potential is hindered by manually designed architectures that remain static…

Machine Learning · Computer Science 2023-05-02 Naresh Kumar Gurulingan , Bahram Zonooz , Elahe Arani