English
Related papers

Related papers: PEMMA: Parameter-Efficient Multi-Modal Adaptation …

200 papers

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

The Foundation model for image segmentation, Segment Anything (SAM), has been actively researched in various fields since its proposal. Various researches have been proposed to adapt SAM to specific domains, with one notable approach…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Joohyeok Kim , Joonhyeon Song , Seohwan Yun , Seongho Yoon , Sangmin Lee

SPECT (Single-photon Emission Computerized Tomography) and PET (Positron Emission Tomography) are essential medical imaging tools, for which the sampling angle number, scan time should be chosen carefully to compromise between image quality…

Medical Physics · Physics 2015-06-16 Xiaolin Zhou , Minkai Yun , Xuexiang Cao , Shuangquan Liu , Lu Wang , Xianchao Huang , Long Wei

Accurate microscopic medical image segmentation plays a crucial role in diagnosing various cancerous cells and identifying tumors. Driven by advancements in deep learning, convolutional neural networks (CNNs) and transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniya Najiha Abdul Kareem , Abdul Hannan , Mubashir Noman , Jean Lahoud , Mustansar Fiaz , Hisham Cholakkal

Existing parameter-efficient fine-tuning (PEFT) methods primarily fall into two categories: addition-based and selective in-situ adaptation. The former, such as LoRA, introduce additional modules to adapt the model to downstream tasks,…

Machine Learning · Computer Science 2025-10-23 Zhi Zhang , Yixian Shen , Congfeng Cao , Ekaterina Shutova

Parameter-efficient fine-tuning (PEFT) techniques have emerged to address overfitting and high computational costs associated with fully fine-tuning in self-supervised learning. Mainstream PEFT methods add a few trainable parameters while…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xingliang Lei , Yiwen Ye , Zhisong Wang , Ziyang Chen , Minglei Shu , Weidong Cai , Yanning Zhang , Yong Xia

Accurate tumor segmentation is crucial for cancer diagnosis and treatment. While foundation models have advanced general-purpose segmentation, existing methods still struggle with: (1) limited incorporation of medical priors, (2) imbalance…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Runqi Meng , Sifan Song , Pengfei Jin , Yujin Oh , Lin Teng , Yulin Wang , Yiqun Sun , Ling Chen , Xiang Li , Quanzheng Li , Ning Guo , Dinggang Shen

Numerous oncology indications have extensively quantified metabolically active tumors using positron emission tomography (PET) and computed tomography (CT). F-fluorodeoxyglucose-positron emission tomography (FDG-PET) is frequently utilized…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Sepideh Amiri , Bulat Ibragimov

Early and accurate diagnosis and lesion localization of bone infections are crucial for clinical treatment. PET-CT integrates anatomical information from CT with metabolic information from PET, making it an important imaging modality for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zonglin Yang , Xiaolei Diao , Jishizhan Chen , Xiaozhuang Man , Wei Kong , Gen Wen , Pengfei Cheng , Daqian Shi

Multimodal foundation models are transformative in sequential recommender systems, leveraging powerful representation learning capabilities. While Parameter-efficient Fine-tuning (PEFT) is commonly used to adapt foundation models for…

Information Retrieval · Computer Science 2024-07-23 Junchen Fu , Xuri Ge , Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Jie Wang , Joemon M. Jose

Automated digital histopathology image segmentation is an important task to help pathologists diagnose tumors and cancer subtypes. For pathological diagnosis of cancer subtypes, pathologists usually change the magnification of whole-slide…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Hiroki Tokunaga , Yuki Teramoto , Akihiko Yoshizawa , Ryoma Bise

The escalating global cancer burden underscores the critical need for precise diagnostic tools in oncology. This research employs deep learning to enhance lesion segmentation in PET/CT imaging, utilizing a dataset of 900 whole-body…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Jiayi Liu , Qiaoyi Xue , Youdan Feng , Tianming Xu , Kaixin Shen , Chuyun Shen , Yuhang Shi

Image segmentation holds a vital position in the realms of diagnosis and treatment within the medical domain. Traditional convolutional neural networks (CNNs) and Transformer models have made significant advancements in this realm, but they…

Image and Video Processing · Electrical Eng. & Systems 2024-05-06 Hao Tang , Lianglun Cheng , Guoheng Huang , Zhengguang Tan , Junhao Lu , Kaihong Wu

[18F]-Fluorodeoxyglucose (FDG) positron emission tomography - computed tomography (PET-CT) has become the imaging modality of choice for diagnosing many cancers. Co-learning complementary PET-CT imaging features is a fundamental requirement…

Image and Video Processing · Electrical Eng. & Systems 2023-08-08 Lei Bi , Michael Fulham , Shaoli Song , David Dagan Feng , Jinman Kim

Adapters have become a widely adopted strategy for efficient fine-tuning of large pretrained models, particularly in resource-constrained settings. However, their performance under extreme data scarcity, common in medical imaging due to…

Computational Engineering, Finance, and Science · Computer Science 2026-02-24 Ziquan Zhu , Hanruo Zhu , Siyuan Lu , Xiang Li , Yanda Meng , Gaojie Jin , Lu Yin , Lijie Hu , Di Wang , Lu Liu , Tianjin Huang

Survival prediction plays a crucial role in assisting clinicians with the development of cancer treatment protocols. Recent evidence shows that multimodal data can help in the diagnosis of cancer disease and improve survival prediction.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-14 Ruiquan Ge , Xiangyang Hu , Rungen Huang , Gangyong Jia , Yaqi Wang , Renshu Gu , Changmiao Wang , Elazab Ahmed , Linyan Wang , Juan Ye , Ye Li

The accurate segmentation of medical images is a crucial step in obtaining reliable morphological statistics. However, training a deep neural network for this task requires a large amount of labeled data to ensure high-accuracy results. To…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Xianjun Han , Qianqian Chen , Zhaoyang Xie , Xuejun Li , Hongyu Yang

Pathological structures in medical images are typically deviations from the expected anatomy of a patient. While clinicians consider this interplay between anatomy and pathology, recent deep learning algorithms specialize in recognizing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Alexander Jaus , Constantin Seibold , Simon Reiß , Lukas Heine , Anton Schily , Moon Kim , Fin Hendrik Bahnsen , Ken Herrmann , Rainer Stiefelhagen , Jens Kleesiek

Parameter-efficient fine-tuning (PEFT) has become increasingly important as foundation models continue to grow in both popularity and size. Adapter has been particularly well-received due to their potential for parameter reduction and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Minglei Li , Peng Ye , Yongqi Huang , Lin Zhang , Tao Chen , Tong He , Jiayuan Fan , Wanli Ouyang

The Segment Anything Model (SAM) is widely used for segmenting a diverse range of objects in natural images from simple user prompts like points or bounding boxes. However, SAM's performance decreases substantially when applied to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tristan Piater , Björn Barz , Alexander Freytag