English
Related papers

Related papers: PEMMA: Parameter-Efficient Multi-Modal Adaptation …

200 papers

Medical image segmentation is crucial for diagnosis and treatment planning. Traditional CNN-based models, like U-Net, have shown promising results but struggle to capture long-range dependencies and global context. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Marzia Binta Nizam , Marian Zlateva , James Davis

We propose a novel transformer model, capable of segmenting medical images of varying modalities. Challenges posed by the fine grained nature of medical image analysis mean that the adaptation of the transformer for their analysis is still…

Image and Video Processing · Electrical Eng. & Systems 2023-01-31 Athanasios Tragakis , Chaitanya Kaul , Roderick Murray-Smith , Dirk Husmeier

Artificial intelligence (AI) techniques for image-based segmentation have garnered much attention in recent years. Convolutional neural networks (CNNs) have shown impressive results and potential towards fully automated segmentation in…

Medical Physics · Physics 2021-11-17 Fereshteh Yousefirizi , Abhinav K. Jha , Julia Brosch-Lenz , Babak Saboury , Arman Rahmim

Test time Adaptation is a promising approach for mitigating domain shift in medical image segmentation; however, current evaluations remain limited in terms of modality coverage, task diversity, and methodological consistency. We present…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Wenjing Yu , Shuo Jiang , Yifei Chen , Shuo Chang , Yuanhan Wang , Beining Wu , Jie Dong , Mingxuan Liu , Shenghao Zhu , Feiwei Qin , Changmiao Wang , Qiyuan Tian

As Deep Convolutional Neural Networks (DCNNs) have shown robust performance and results in medical image analysis, a number of deep-learning-based tumor detection methods were developed in recent years. Nowadays, the automatic detection of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Zhengdong Zhang , Shuai Li , Ziyang Wang , Yun Lu

Semantic segmentation of functional magnetic resonance imaging (fMRI) makes great sense for pathology diagnosis and decision system of medical robots. The multi-channel fMRI provides more information of the pathological features. But the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-12 Lei Tai , Haoyang Ye , Qiong Ye , Ming Liu

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Current mainstream of CT reconstruction methods based on deep learning usually needs to fix the scanning geometry and dose level, which will significantly aggravate the training cost and need more training data for clinical application. In…

Medical Physics · Physics 2020-10-28 Wenjun Xia , Zexin Lu , Yongqiang Huang , Yan Liu , Hu Chen , Jiliu Zhou , Yi Zhang

Medical image segmentation has been traditionally approached by training or fine-tuning the entire model to cater to any new modality or dataset. However, this approach often requires tuning a large number of parameters during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jay N. Paranjape , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Medical image segmentation, particularly in multi-domain scenarios, requires precise preservation of anatomical structures across diverse representations. While deep learning has advanced this field, existing models often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Afshin Bozorgpour , Sina Ghorbani Kolahi , Reza Azad , Ilker Hacihaliloglu , Dorit Merhof

Sequential whole-body 18F-Fluorodeoxyglucose (FDG) positron emission tomography (PET) scans are regarded as the imaging modality of choice for the assessment of treatment response in the lymphomas because they detect treatment response when…

Image and Video Processing · Electrical Eng. & Systems 2021-06-10 Kai-Chieh Liang , Lei Bi , Ashnil Kumar , Michael Fulham , Jinman Kim

While deep learning has demonstrated considerable promise in computer-aided diagnosis for pulmonary embolism (PE), practical deployment in Computed Tomography Pulmonary Angiography (CTPA) is often hindered by "domain shift" and the…

Image and Video Processing · Electrical Eng. & Systems 2026-02-24 Wen-Liang Lin , Yun-Chien Cheng

Few-shot learning and parameter-efficient fine-tuning (PEFT) are crucial to overcome the challenges of data scarcity and ever growing language model sizes. This applies in particular to specialized scientific domains, where researchers…

Computation and Language · Computer Science 2025-09-18 Jonas Rieger , Mattes Ruckdeschel , Gregor Wiedemann

Deep learning has shown unprecedented success in a variety of applications, such as computer vision and medical image analysis. However, there is still potential to improve segmentation in multimodal images by embedding prior knowledge via…

Image and Video Processing · Electrical Eng. & Systems 2019-10-24 Kibrom Berihu Girum , Gilles Créhange , Raabid Hussain , Paul Michael Walker , Alain Lalande

The early detection of a pulmonary embolism (PE) is critical for enhancing patient survival rates. Both image-based and non-image-based features are of utmost importance in medical classification tasks. In a clinical setting, physicians…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Zhaoxin Guo , Zhipeng Wang , Ruiquan Ge , Jianxun Yu , Feiwei Qin , Yuan Tian , Yuqing Peng , Yonghong Li , Changmiao Wang

Foundation models have revolutionized AI, but adapting them efficiently for multimodal tasks, particularly in dual-stream architectures composed of unimodal encoders, such as DINO and BERT, remains a significant challenge.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Wish Suharitdamrong , Tony Alex , Muhammad Awais , Sara Ahmed

This study introduces PEFT-DML, a parameter-efficient deep metric learning framework for robust multi-modal 3D object detection in autonomous driving. Unlike conventional models that assume fixed sensor availability, PEFT-DML maps diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Abdolazim Rezaei , Mehdi Sookhak

Parameter-efficient transfer learning (PETL) is a promising task, aiming to adapt the large-scale pre-trained model to downstream tasks with a relatively modest cost. However, current PETL methods struggle in compressing computational…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Yurong Zhang , Honghao Chen , Xinyu Zhang , Xiangxiang Chu , Li Song

Over the past two decades, machine analysis of medical imaging has advanced rapidly, opening up significant potential for several important medical applications. As complicated diseases increase and the number of cases rises, the role of…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Fares Bougourzi , Fadi Dornaika , Cosimo Distante , Abdelmalik Taleb-Ahmed

Parameter-efficient fine-tuning (PEFT) techniques, such as prompts and adapters, are widely used in multi-modal tracking because they alleviate issues of full-model fine-tuning, including time inefficiency, high resource consumption,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yabin Zhu , Jianqi Li , Chenglong Li , Jiaxiang Wang , Chengjie Gu , Jin Tang