中文
相关论文

相关论文: PEMMA: Parameter-Efficient Multi-Modal Adaptation …

200 篇论文

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

The Foundation model for image segmentation, Segment Anything (SAM), has been actively researched in various fields since its proposal. Various researches have been proposed to adapt SAM to specific domains, with one notable approach…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Joohyeok Kim , Joonhyeon Song , Seohwan Yun , Seongho Yoon , Sangmin Lee

SPECT (Single-photon Emission Computerized Tomography) and PET (Positron Emission Tomography) are essential medical imaging tools, for which the sampling angle number, scan time should be chosen carefully to compromise between image quality…

医学物理 · 物理学 2015-06-16 Xiaolin Zhou , Minkai Yun , Xuexiang Cao , Shuangquan Liu , Lu Wang , Xianchao Huang , Long Wei

Accurate microscopic medical image segmentation plays a crucial role in diagnosing various cancerous cells and identifying tumors. Driven by advancements in deep learning, convolutional neural networks (CNNs) and transformer-based models…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Daniya Najiha Abdul Kareem , Abdul Hannan , Mubashir Noman , Jean Lahoud , Mustansar Fiaz , Hisham Cholakkal

Existing parameter-efficient fine-tuning (PEFT) methods primarily fall into two categories: addition-based and selective in-situ adaptation. The former, such as LoRA, introduce additional modules to adapt the model to downstream tasks,…

机器学习 · 计算机科学 2025-10-23 Zhi Zhang , Yixian Shen , Congfeng Cao , Ekaterina Shutova

Parameter-efficient fine-tuning (PEFT) techniques have emerged to address overfitting and high computational costs associated with fully fine-tuning in self-supervised learning. Mainstream PEFT methods add a few trainable parameters while…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Xingliang Lei , Yiwen Ye , Zhisong Wang , Ziyang Chen , Minglei Shu , Weidong Cai , Yanning Zhang , Yong Xia

Accurate tumor segmentation is crucial for cancer diagnosis and treatment. While foundation models have advanced general-purpose segmentation, existing methods still struggle with: (1) limited incorporation of medical priors, (2) imbalance…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Runqi Meng , Sifan Song , Pengfei Jin , Yujin Oh , Lin Teng , Yulin Wang , Yiqun Sun , Ling Chen , Xiang Li , Quanzheng Li , Ning Guo , Dinggang Shen

Numerous oncology indications have extensively quantified metabolically active tumors using positron emission tomography (PET) and computed tomography (CT). F-fluorodeoxyglucose-positron emission tomography (FDG-PET) is frequently utilized…

图像与视频处理 · 电气工程与系统科学 2022-10-17 Sepideh Amiri , Bulat Ibragimov

Early and accurate diagnosis and lesion localization of bone infections are crucial for clinical treatment. PET-CT integrates anatomical information from CT with metabolic information from PET, making it an important imaging modality for…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Zonglin Yang , Xiaolei Diao , Jishizhan Chen , Xiaozhuang Man , Wei Kong , Gen Wen , Pengfei Cheng , Daqian Shi

Multimodal foundation models are transformative in sequential recommender systems, leveraging powerful representation learning capabilities. While Parameter-efficient Fine-tuning (PEFT) is commonly used to adapt foundation models for…

信息检索 · 计算机科学 2024-07-23 Junchen Fu , Xuri Ge , Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Jie Wang , Joemon M. Jose

Automated digital histopathology image segmentation is an important task to help pathologists diagnose tumors and cancer subtypes. For pathological diagnosis of cancer subtypes, pathologists usually change the magnification of whole-slide…

计算机视觉与模式识别 · 计算机科学 2019-04-15 Hiroki Tokunaga , Yuki Teramoto , Akihiko Yoshizawa , Ryoma Bise

The escalating global cancer burden underscores the critical need for precise diagnostic tools in oncology. This research employs deep learning to enhance lesion segmentation in PET/CT imaging, utilizing a dataset of 900 whole-body…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Jiayi Liu , Qiaoyi Xue , Youdan Feng , Tianming Xu , Kaixin Shen , Chuyun Shen , Yuhang Shi

Image segmentation holds a vital position in the realms of diagnosis and treatment within the medical domain. Traditional convolutional neural networks (CNNs) and Transformer models have made significant advancements in this realm, but they…

图像与视频处理 · 电气工程与系统科学 2024-05-06 Hao Tang , Lianglun Cheng , Guoheng Huang , Zhengguang Tan , Junhao Lu , Kaihong Wu

[18F]-Fluorodeoxyglucose (FDG) positron emission tomography - computed tomography (PET-CT) has become the imaging modality of choice for diagnosing many cancers. Co-learning complementary PET-CT imaging features is a fundamental requirement…

图像与视频处理 · 电气工程与系统科学 2023-08-08 Lei Bi , Michael Fulham , Shaoli Song , David Dagan Feng , Jinman Kim

Adapters have become a widely adopted strategy for efficient fine-tuning of large pretrained models, particularly in resource-constrained settings. However, their performance under extreme data scarcity, common in medical imaging due to…

计算工程、金融与科学 · 计算机科学 2026-02-24 Ziquan Zhu , Hanruo Zhu , Siyuan Lu , Xiang Li , Yanda Meng , Gaojie Jin , Lu Yin , Lijie Hu , Di Wang , Lu Liu , Tianjin Huang

Survival prediction plays a crucial role in assisting clinicians with the development of cancer treatment protocols. Recent evidence shows that multimodal data can help in the diagnosis of cancer disease and improve survival prediction.…

图像与视频处理 · 电气工程与系统科学 2023-11-14 Ruiquan Ge , Xiangyang Hu , Rungen Huang , Gangyong Jia , Yaqi Wang , Renshu Gu , Changmiao Wang , Elazab Ahmed , Linyan Wang , Juan Ye , Ye Li

The accurate segmentation of medical images is a crucial step in obtaining reliable morphological statistics. However, training a deep neural network for this task requires a large amount of labeled data to ensure high-accuracy results. To…

图像与视频处理 · 电气工程与系统科学 2023-07-04 Xianjun Han , Qianqian Chen , Zhaoyang Xie , Xuejun Li , Hongyu Yang

Pathological structures in medical images are typically deviations from the expected anatomy of a patient. While clinicians consider this interplay between anatomy and pathology, recent deep learning algorithms specialize in recognizing…

Parameter-efficient fine-tuning (PEFT) has become increasingly important as foundation models continue to grow in both popularity and size. Adapter has been particularly well-received due to their potential for parameter reduction and…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Minglei Li , Peng Ye , Yongqi Huang , Lin Zhang , Tao Chen , Tong He , Jiayuan Fan , Wanli Ouyang

The Segment Anything Model (SAM) is widely used for segmenting a diverse range of objects in natural images from simple user prompts like points or bounding boxes. However, SAM's performance decreases substantially when applied to…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Tristan Piater , Björn Barz , Alexander Freytag