English
Related papers

Related papers: Efficient Parameter Adaptation for Multi-Modal Med…

200 papers

Parameter-Efficient FineTuning (PEFT) methods have recently gained significant popularity thanks to the widespread availability of large-scale pretrained models. These methods allow for quick adaptation to downstream tasks with minimal…

Machine Learning · Computer Science 2025-05-20 Massimo Bini , Leander Girrbach , Zeynep Akata

Tumor segmentation in multimodal medical images has seen a growing trend towards deep learning based methods. Typically, studies dealing with this topic fuse multimodal image data to improve the tumor segmentation contour for a single…

Image and Video Processing · Electrical Eng. & Systems 2020-09-25 Theresa Neubauer , Maria Wimmer , Astrid Berg , David Major , Dimitrios Lenis , Thomas Beyer , Jelena Saponjski , Katja Bühler

Breast cancer is one of the leading causes of death globally, and thus there is an urgent need for early and accurate diagnostic techniques. Although ultrasound imaging is a widely used technique for breast cancer screening, it faces…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Pandiyaraju V , Shravan Venkatraman , Pavan Kumar S , Santhosh Malarvannan , Kannan A

Pulmonary embolism (PE) is a life-threatening condition where rapid and accurate diagnosis is imperative yet difficult due to predominantly atypical symptomatology. Computed tomography pulmonary angiography (CTPA) is acknowledged as the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-17 Bizhe Bai , Yan-Jie Zhou , Yujian Hu , Tony C. W. Mok , Yilang Xiang , Le Lu , Hongkun Zhang , Minfeng Xu

Adapting vision transformer foundation models through parameter-efficient fine-tuning (PEFT) methods has become increasingly popular. These methods optimize a limited subset of parameters, enabling efficient adaptation without the need to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Son Thai Ly , Hien V. Nguyen

Parameter-Efficient Fine-tuning (PEFT) facilitates the fine-tuning of Large Language Models (LLMs) under limited resources. However, the fine-tuning performance with PEFT on complex, knowledge-intensive tasks is limited due to the…

Computation and Language · Computer Science 2024-06-10 Jitai Hao , WeiWei Sun , Xin Xin , Qi Meng , Zhumin Chen , Pengjie Ren , Zhaochun Ren

Surgical Video Question Answering (VideoQA) requires accurate temporal grounding while remaining robust to natural variation in how clinicians phrase questions, where linguistic bias can arise. Standard Parameter Efficient Fine Tuning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Luca Carlini , Chiara Lena , Cesare Hassan , Danail Stoyanov , Elena De Momi , Sophia Bano , Mobarak I. Hoque

Parameter-efficient fine-tuning (PEFT) of powerful pre-trained models for complex downstream tasks has proven effective in vision and language processing, yet this paradigm remains unexplored in scientific machine learning, where the…

Machine Learning · Computer Science 2025-10-20 Hangwei Zhang , Chun Kang , Yan Wang , Difan Zou

Positron Emission Tomography (PET) and Computed Tomography (CT) are essential for diagnosing, staging, and monitoring various diseases, particularly cancer. Despite their importance, the use of PET/CT systems is limited by the necessity for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-30 Dac Thai Nguyen , Trung Thanh Nguyen , Huu Tien Nguyen , Thanh Trung Nguyen , Huy Hieu Pham , Thanh Hung Nguyen , Thao Nguyen Truong , Phi Le Nguyen

State-of-the-art computer vision tasks, like monocular depth estimation (MDE), rely heavily on large, modern Transformer-based architectures. However, their application in safety-critical domains demands reliable predictive performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Richard D. Paul , Alessio Quercia , Vincent Fortuin , Katharina Nöh , Hanno Scharr

Full fine-tuning of large language models for alignment and task adaptation has become prohibitively expensive as models have grown in size. Parameter-Efficient Fine-Tuning (PEFT) methods aim at significantly reducing the computational and…

Computation and Language · Computer Science 2025-09-22 Jesus Rios , Pierre Dognin , Ronny Luss , Karthikeyan N. Ramamurthy

Parameter-efficient fine-tuning (PEFT) methods such as \lora{} adapt large pretrained models by adding small weight-space updates. While effective, weight deltas are hard to interpret mechanistically, and they do not directly expose…

Machine Learning · Computer Science 2026-02-13 Shervin Ghasemlou

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

The large models, as predicted by scaling raw forecasts, have made groundbreaking progress in many fields, particularly in natural language generation tasks, where they have approached or even surpassed human levels. However, the…

Computation and Language · Computer Science 2025-04-25 Luping Wang , Sheng Chen , Linnan Jiang , Shu Pan , Runze Cai , Sen Yang , Fei Yang

Parameter-efficient fine-tuning (PEFT) techniques make it possible to efficiently adapt a language model to create "expert" models that specialize to new tasks or domains. Recent techniques in model merging and compositional generalization…

Machine Learning · Computer Science 2025-08-12 Prateek Yadav , Leshem Choshen , Colin Raffel , Mohit Bansal

Parameter-efficient fine-tuning (PEFT) techniques, such as adapter tuning, aim to fine-tune a pre-trained language model (PLM) using a minimal number of parameters for a specific task or profile. Although adapter tuning provides increased…

Machine Learning · Computer Science 2024-01-30 Namju Kwak , Taesup Kim

To obtain high-quality positron emission tomography (PET) scans while reducing radiation exposure to the human body, various approaches have been proposed to reconstruct standard-dose PET (SPET) images from low-dose PET (LPET) images. One…

Image and Video Processing · Electrical Eng. & Systems 2023-08-22 Zeyu Han , Yuhan Wang , Luping Zhou , Peng Wang , Binyu Yan , Jiliu Zhou , Yan Wang , Dinggang Shen

Parameter-efficient fine-tuning (PEFT) has become a common method for fine-tuning large language models, where a base model can serve multiple users through PEFT module switching. To enhance user experience, base models require periodic…

Computation and Language · Computer Science 2025-06-10 Naibin Gu , Peng Fu , Xiyu Liu , Ke Ma , Zheng Lin , Weiping Wang

Survival prediction plays a crucial role in assisting clinicians with the development of cancer treatment protocols. Recent evidence shows that multimodal data can help in the diagnosis of cancer disease and improve survival prediction.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-14 Ruiquan Ge , Xiangyang Hu , Rungen Huang , Gangyong Jia , Yaqi Wang , Renshu Gu , Changmiao Wang , Elazab Ahmed , Linyan Wang , Juan Ye , Ye Li

This paper addresses the domain adaptation challenge for semantic segmentation in medical imaging. Despite the impressive performance of recent foundational segmentation models like SAM on natural images, they struggle with medical domain…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Javier Gamazo Tejero , Moritz Schmid , Pablo Márquez Neila , Martin S. Zinkernagel , Sebastian Wolf , Raphael Sznitman