English
Related papers

Related papers: MTMed3D: A Multi-Task Transformer-Based Model for …

200 papers

The task of building footprint segmentation has been well-studied in the context of remote sensing (RS) as it provides valuable information in many aspects, however, difficulties brought by the nature of RS images such as variations in the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Burak Ekim , Elif Sertel

Three-dimensional (3D) medical images, such as Computed Tomography (CT) and Magnetic Resonance Imaging (MRI), are essential for clinical applications. However, the need for diverse and comprehensive representations is particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Siwen Wang , Churan Wang , Fei Gao , Lixian Su , Fandong Zhang , Yizhou Wang , Yizhou Yu

Multimodal learning aims to build models that can process and relate information from multiple modalities. Despite years of development in this field, it still remains challenging to design a unified network for processing various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yiyuan Zhang , Kaixiong Gong , Kaipeng Zhang , Hongsheng Li , Yu Qiao , Wanli Ouyang , Xiangyu Yue

This paper presents a data-driven, task-specific paradigm for experimental design, to shorten acquisition time, reduce costs, and accelerate the deployment of imaging devices. Current approaches in experimental design focus on…

Machine Learning · Computer Science 2024-03-19 Stefano B. Blumberg , Paddy J. Slator , Daniel C. Alexander

Developing an integrated many-to-many framework leveraging multimodal data for multiple tasks is crucial to unifying healthcare applications ranging from diagnoses to operations. In resource-constrained hospital environments, a scalable and…

Machine Learning · Computer Science 2024-06-11 Dimitris Bertsimas , Yu Ma

Although single-task medical image restoration (MedIR) has witnessed remarkable success, the limited generalizability of these methods poses a substantial obstacle to wider application. In this paper, we focus on the task of all-in-one…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Zhiwen Yang , Haowei Chen , Ziniu Qian , Yang Yi , Hui Zhang , Dan Zhao , Bingzheng Wei , Yan Xu

Multi-Task Learning (MTL) involves the concurrent training of multiple tasks, offering notable advantages for dense prediction tasks in computer vision. MTL not only reduces training and inference time as opposed to having multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Maxime Fontana , Michael Spratling , Miaojing Shi

Transformers have made remarkable progress towards modeling long-range dependencies within the medical image analysis domain. However, current transformer-based models suffer from several disadvantages: (1) existing methods fail to capture…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Chenyu You , Ruihan Zhao , Fenglin Liu , Siyuan Dong , Sandeep Chinchali , Ufuk Topcu , Lawrence Staib , James S. Duncan

Brain Tumor Segmentation (BraTS) plays a critical role in clinical diagnosis, treatment planning, and monitoring the progression of brain tumors. However, due to the variability in tumor appearance, size, and intensity across different MRI…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Hongjun Zhu , Jiaohang Huang , Kuo Chen , Xuehui Ying , Ying Qian

Whole slide image (WSI) classification is a crucial problem for cancer diagnostics in clinics and hospitals. A WSI, acquired at gigapixel size, is commonly tiled into patches and processed by multiple-instance learning (MIL) models.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Doanh C. Bui , Jin Tae Kwak

Multi-task learning (MTL) compresses the information from multiple tasks into a unified backbone to improve computational efficiency and generalization. Recent work directly merges multiple independently trained models to perform MTL…

Machine Learning · Computer Science 2024-05-29 Enneng Yang , Li Shen , Zhenyi Wang , Guibing Guo , Xiaojun Chen , Xingwei Wang , Dacheng Tao

We propose a Transformer architecture for volumetric segmentation, a challenging task that requires keeping a complex balance in encoding local and global spatial cues, and preserving information along all axes of the volume. Encoder of the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-04 Himashi Peiris , Munawar Hayat , Zhaolin Chen , Gary Egan , Mehrtash Harandi

Deep neural networks are commonly used for automated medical image segmentation, but models will frequently struggle to generalize well across different imaging modalities. This issue is particularly problematic due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Malo de Boisredon , Eugene Vorontsov , William Trung Le , Samuel Kadoury

Multi-task learning has garnered widespread attention in the industry due to its efficient data utilization and strong generalization capabilities, making it particularly suitable for providing high-quality intelligent services to users.…

Machine Learning · Computer Science 2026-01-06 Jingxuan Zhou , Weidong Bao , Ji Wang , Zhengyi Zhong

Magnetic resonance imaging (MRI) acquisition, reconstruction, and segmentation are usually processed independently in the conventional practice of MRI workflow. It is easy to notice that there are significant relevances among these tasks…

Image and Video Processing · Electrical Eng. & Systems 2021-05-17 Zhiwen Wang , Wenjun Xia , Zexin Lu , Yongqiang Huang , Yan Liu , Hu Chen , Jiliu Zhou , Yi Zhang

Over the past few years, the rapid development of deep learning technologies for computer vision has significantly improved the performance of medical image segmentation (MedISeg). However, the diverse implementation strategies of various…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Dong Zhang , Yi Lin , Hao Chen , Zhuotao Tian , Xin Yang , Jinhui Tang , Kwang Ting Cheng

Algorithmic image-based diagnosis and prognosis of neurodegenerative diseases on longitudinal data has drawn great interest from computer vision researchers. The current state-of-the-art models for many image classification tasks are based…

Computer Vision and Pattern Recognition · Computer Science 2017-09-04 Jie Zhang , Qingyang Li , Richard J. Caselli , Jieping Ye , Yalin Wang

We propose an end-to-end Multitask Learning Transformer framework, named MulT, to simultaneously learn multiple high-level vision tasks, including depth estimation, semantic segmentation, reshading, surface normal estimation, 2D keypoint…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Deblina Bhattacharjee , Tong Zhang , Sabine Süsstrunk , Mathieu Salzmann

The universal model emerges as a promising trend for medical image segmentation, paving up the way to build medical imaging large model (MILM). One popular strategy to build universal models is to encode each task as a one-hot vector and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Yong Xia