English
Related papers

Related papers: PEMMA: Parameter-Efficient Multi-Modal Adaptation …

200 papers

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil

Positron Emission Tomography (PET) /Computed Tomography (CT) is crucial for diagnosing, managing, and planning treatment for various cancers. Developing reliable deep learning models for the segmentation of tumor lesions in PET/CT scans in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Tanya Chutani , Saikiran Bonthu , Pranab Samanta , Nitin Singhal

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

State Space Models (SSMs) have emerged as powerful alternatives to attention-based Transformers, with Mamba demonstrating impressive efficiency and scalability. As these models grow increasingly larger, the need for Parameter-Efficient…

Machine Learning · Computer Science 2026-03-03 Donghyun Lee , Yuhang Li , Ruokai Yin , Shiting Xiao , Priyadarshini Panda

Aligning features from different modalities, is one of the most fundamental challenges for cross-modal tasks. Although pre-trained vision-language models can achieve a general alignment between image and text, they often require…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ziqi Jiang , Yanghao Wang , Long Chen

Acquiring high-quality Positron Emission Tomography (PET) images requires administering high-dose radiotracers, which increases radiation exposure risks. Generating standard-dose PET (SPET) from low-dose PET (LPET) has become a potential…

Image and Video Processing · Electrical Eng. & Systems 2025-06-24 Xiaolong Niu , Zanting Ye , Xu Han , Yanchao Huang , Hao Sun , Hubing Wu , Lijun Lu

Tumor segmentation in multimodal medical images has seen a growing trend towards deep learning based methods. Typically, studies dealing with this topic fuse multimodal image data to improve the tumor segmentation contour for a single…

Image and Video Processing · Electrical Eng. & Systems 2020-09-25 Theresa Neubauer , Maria Wimmer , Astrid Berg , David Major , Dimitrios Lenis , Thomas Beyer , Jelena Saponjski , Katja Bühler

Accurate and computationally efficient 3D medical image segmentation remains a critical challenge in clinical workflows. Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

Positron Emission Tomography (PET) is a powerful molecular imaging tool that plays a crucial role in modern medical diagnostics by visualizing radio-tracer distribution to reveal physiological processes. Accurate organ segmentation from PET…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yichi Zhang , Le Xue , Wenbo Zhang , Lanlan Li , Yuchen Liu , Chen Jiang , Yuan Cheng , Yuan Qi

Deep learning has been widely applied to 3D medical image segmentation tasks. However, due to the diversity of imaging modalities, the high-dimensional nature of the data, and the heterogeneity of anatomical structures, achieving both…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Chung-Ming Lo , I-Yun Liu , Wei-Yang Lin

Parameter-Efficient Fine-Tuning (PEFT) is widely used for adapting Large Language Models (LLMs) for various tasks. Recently, there has been an increasing demand for fine-tuning a single LLM for multiple tasks because it requires overall…

Computation and Language · Computer Science 2026-05-15 Anjir Ahmed Chowdhury , Syed Zawad , Xiaolong Ma , Xu Dong , Feng Yan

Parameter-efficient fine-tuning (PEFT) has attracted significant attention due to the growth of pre-trained model sizes and the need to fine-tune (FT) them for superior downstream performance. Despite a surge in new PEFT methods, a…

Machine Learning · Computer Science 2025-03-26 Zheda Mai , Ping Zhang , Cheng-Hao Tu , Hong-You Chen , Li Zhang , Wei-Lun Chao

Automated lesion segmentation in PET/CT scans is crucial for improving clinical workflows and advancing cancer diagnostics. However, the task is challenging due to physiological variability, different tracers used in PET imaging, and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-22 Maximilian Rokuss , Balint Kovacs , Yannick Kirchhoff , Shuhan Xiao , Constantin Ulrich , Klaus H. Maier-Hein , Fabian Isensee

The recent popularity of foundation models and the pre-train-and-adapt paradigm, where a large-scale model is transferred to downstream tasks, is gaining attention for volumetric medical image segmentation. However, current transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Julio Silva-Rodríguez , Jose Dolz , Ismail Ben Ayed

Limited labeled data makes it hard to train models from scratch in medical domain, and an important paradigm is pre-training and then fine-tuning. Large pre-trained models contain rich representations, which can be adapted to downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Along He , Kai Wang , Zhihong Wang , Tao Li , Huazhu Fu

The rise of deep learning has marked significant progress in fields such as computer vision, natural language processing, and medical imaging, primarily through the adaptation of pre-trained models for specific tasks. Traditional…

Machine Learning · Computer Science 2024-04-25 Charith Chandra Sai Balne , Sreyoshi Bhaduri , Tamoghna Roy , Vinija Jain , Aman Chadha

Recently, deep learning methods have achieved state-of-the-art performance in many medical image segmentation tasks. Many of these are based on convolutional neural networks (CNNs). For such methods, the encoder is the key part for global…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Hao Li , Dewei Hu , Han Liu , Jiacheng Wang , Ipek Oguz

Combining dual-energy computed tomography (DECT) with positron emission tomography (PET) offers many potential clinical applications but typically requires expensive hardware upgrades or increases radiation doses on PET/CT scanners due to…

Medical Physics · Physics 2024-06-21 Siqi Li , Yansong Zhu , Benjamin A. Spencer , Guobao Wang

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

An ecosystem of Transformer-based models has been established by building large models with extensive data. Parameter-efficient fine-tuning (PEFT) is a crucial technology for deploying these models to downstream tasks with minimal cost…

Computation and Language · Computer Science 2025-04-02 Masakazu Yoshimura , Teruaki Hayashi , Yota Maeda