English
Related papers

Related papers: Learning A Multi-Task Transformer Via Unified And …

200 papers

Machine learning and deep learning methods have become essential for computer-assisted prediction in medicine, with a growing number of applications also in the field of mammography. Typically these algorithms are trained for a specific…

Image and Video Processing · Electrical Eng. & Systems 2021-12-03 Maria Wimmer , Gert Sluiter , David Major , Dimitrios Lenis , Astrid Berg , Theresa Neubauer , Katja Bühler

Lung cancer and covid-19 have one of the highest morbidity and mortality rates in the world. For physicians, the identification of lesions is difficult in the early stages of the disease and time-consuming. Therefore, multi-task learning is…

Image and Video Processing · Electrical Eng. & Systems 2024-04-10 Weronika Hryniewska-Guzik , Maria Kędzierska , Przemysław Biecek

Although pre-trained transformers and reprogrammed text-based LLMs have shown strong performance on time series tasks, the best-performing architectures vary widely across tasks, with most models narrowly focused on specific areas, such as…

Machine Learning · Computer Science 2024-11-27 Shanghua Gao , Teddy Koker , Owen Queen , Thomas Hartvigsen , Theodoros Tsiligkaridis , Marinka Zitnik

Self-supervised learning has greatly facilitated medical image analysis by suppressing the training data requirement for real-world applications. Current paradigms predominantly rely on self-supervision within uni-modal image data, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Shaohao Rui , Lingzhi Chen , Zhenyu Tang , Lilong Wang , Mianxin Liu , Shaoting Zhang , Xiaosong Wang

BACKGROUND AND OBJECTIVES: The multiple chest x-ray datasets released in the last years have ground-truth labels intended for different computer vision tasks, suggesting that performance in automated chest-xray interpretation might improve…

Foundation models have achieved great advances in multi-task learning with a unified interface of unimodal and multimodal tasks. However, the potential of such multi-task learners has not been exploited during transfer learning. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Chengyue Wu , Teng Wang , Yixiao Ge , Zeyu Lu , Ruisong Zhou , Ying Shan , Ping Luo

A fundamental challenge in federated learning lies in mixing heterogeneous datasets and classification tasks while minimizing the high communication cost caused by clients as well as the exchange of weight updates with the server over a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Atefe Hassani , Islem Rekik

Numerous deep learning applications benefit from multi-task learning with multiple regression and classification objectives. In this paper we make the observation that the performance of such systems is strongly dependent on the relative…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Alex Kendall , Yarin Gal , Roberto Cipolla

In human environments, robots are expected to accomplish a variety of manipulation tasks given simple natural language instructions. Yet, robotic manipulation is extremely challenging as it requires fine-grained motor control, long-term…

Robotics · Computer Science 2022-12-20 Pierre-Louis Guhur , Shizhe Chen , Ricardo Garcia , Makarand Tapaswi , Ivan Laptev , Cordelia Schmid

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Breast ultrasound interpretation requires simultaneous lesion segmentation and tissue classification. However, conventional multi-task learning approaches suffer from task interference and rigid coordination strategies that fail to adapt to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Abdullah Al Shafi , Md Kawsar Mahmud Khan Zunayed , Safin Ahmmed , Sk Imran Hossain , Engelbert Mephu Nguifo

The rapid evolution of artificial intelligence, especially in large language models (LLMs), has significantly impacted various domains, including healthcare. In chest X-ray (CXR) analysis, previous studies have employed LLMs, but with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jonggwon Park , Soobum Kim , Byungmu Yoon , Jihun Hyun , Kyoyun Choi

Although multi-task learning is widely applied in intelligent services, traditional multi-task modeling methods often require customized designs based on specific task combinations, resulting in a cumbersome modeling process. Inspired by…

Machine Learning · Computer Science 2025-04-15 Jingxuan Zhou , Weidong Bao , Ji Wang , Zhengyi Zhong , Dayu Zhang

Pre-trained models, e.g., from ImageNet, have proven to be effective in boosting the performance of many downstream applications. It is too demanding to acquire large-scale annotations to build such models for medical imaging. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xiaosong Wang , Ziyue Xu , Leo Tam , Dong Yang , Daguang Xu

The widespread adoption of CT has notably increased the number of detected lung nodules. However, current deep learning methods for classifying benign and malignant nodules often fail to comprehensively integrate global and local features,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhenchen Zhu , Ge Hu , Weixiong Tan , Kai Gao , Chao Sun , Zhen Zhou , Kepei Xu , Wei Han , Meixia Shang , Xiaoming Qiu , Yiqing Tan , Jinhua Wang , Zhoumeng Ying , Li Peng , Wei Song , Lan Song , Zhengyu Jin , Nan Hong , Yizhou Yu

Deep convolutional neural networks (CNNs) have been widely used in various medical imaging tasks. However, due to the intrinsic locality of convolution operation, CNNs generally cannot model long-range dependencies well, which are important…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Xuxin Chen , Ke Zhang , Neman Abdoli , Patrik W. Gilley , Ximin Wang , Hong Liu , Bin Zheng , Yuchen Qiu

Automatic segmentation of medical images is an important task for many clinical applications. In practice, a wide range of anatomical structures are visualised using different imaging modalities. In this paper, we investigate whether a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Pim Moeskops , Jelmer M. Wolterink , Bas H. M. van der Velden , Kenneth G. A. Gilhuijs , Tim Leiner , Max A. Viergever , Ivana Išgum

Radiological analysis increasingly benefits from pretrained visual representations that can support heterogeneous downstream tasks across imaging modalities. In this work, we introduce OmniRad, a self-supervised radiological foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Luca Zedda , Andrea Loddo , Cecilia Di Ruberto

By leveraging large amounts of product data collected across hundreds of live e-commerce websites, we construct 1000 unique classification tasks that share similarly-structured input data, comprised of both text and images. These…

Artificial Intelligence · Computer Science 2021-07-29 Cameron R. Wolfe , Keld T. Lundgaard

Neuroimaging is essential in brain studies for the diagnosis and identification of disease, structure, and function of the brain in its healthy and disease states. Literature shows that there are advantages of multitasking with some deep…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Mohammad Eslami , Solale Tabarestani , Malek Adjouadi