中文
相关论文

相关论文: Parameter-Efficient VLMs for Gastrointestinal Endo…

200 篇论文

AI foundation models have recently demonstrated impressive capabilities across a wide range of tasks. Fine-tuning (FT) is a method of customizing a pre-trained AI foundation model by further training it on a smaller, targeted dataset. In…

密码学与安全 · 计算机科学 2025-10-14 Yang Li , Wenhan Yu , Jun Zhao

Medical foundation models have achieved remarkable clinical performance, yet their robustness under real-world perturbations remains underexplored. We present a robustness benchmark comprising 40 perturbation types (12 base, 28…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Xiangxiang Cui , Tianjin Huang , Yifang Wang , Lijie Hu , Lu Yin

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

机器学习 · 计算机科学 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

Adapting pretrained language models to novel domains, such as clinical applications, traditionally involves retraining their entire set of parameters. Parameter-Efficient Fine-Tuning (PEFT) techniques for fine-tuning language models…

计算与语言 · 计算机科学 2024-06-11 Aryo Pradipta Gema , Pasquale Minervini , Luke Daines , Tom Hope , Beatrice Alex

The application of artificial intelligence (AI) in IVF has shown promise in improving consistency and standardization of decisions, but often relies on annotated data and does not make use of the multimodal nature of IVF data. We…

The rapid growth of model scale has necessitated substantial computational resources for fine-tuning. Existing approach such as Low-Rank Adaptation (LoRA) has sought to address the problem of handling the large updated parameters in full…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Yiming Shi , Jiwei Wei , Yujia Wu , Ran Ran , Chengwei Sun , Shiyuan He , Yang Yang

Recent advances in vision-language models (VLMs) have demonstrated the advantages of processing images at higher resolutions and utilizing multi-crop features to preserve native resolution details. However, despite these improvements,…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Rahul Thapa , Kezhen Chen , Ian Covert , Rahul Chalamala , Ben Athiwaratkun , Shuaiwen Leon Song , James Zou

Medical vision-language models (VLMs) and AI agents have made significant progress in learning to analyze and reason about clinical images. However, existing medical visual question answering (VQA) benchmarks collapse model capabilities…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Yixiong Chen , Wenjie Xiao , Pedro R. A. S. Bassi , Boyan Wang , Liang He , Xinze Zhou , Sezgin Er , Ibrahim Ethem Hamamci , Zongwei Zhou , Alan Yuille

In order to take advantage of AI solutions in endoscopy diagnostics, we must overcome the issue of limited annotations. These limitations are caused by the high privacy concerns in the medical field and the requirement of getting aid from…

图像与视频处理 · 电气工程与系统科学 2023-04-12 Roman Macháček , Leila Mozaffari , Zahra Sepasdar , Sravanthi Parasa , Pål Halvorsen , Michael A. Riegler , Vajira Thambawita

Adapting pre-trained models has become an effective strategy in artificial intelligence, offering a scalable and efficient alternative to training models from scratch. In the context of remote sensing (RS), where visual grounding(VG)…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Hasan Moughnieh , Mohamad Chalhoub , Hasan Nasrallah , Cristiano Nattero , Paolo Campanella , Giovanni Nico , Ali J. Ghandour

Parameter-Efficient Fine-Tuning (PEFT) has emerged as a key strategy for adapting large-scale pre-trained models to downstream tasks, but existing approaches face notable limitations. Addition-based methods, such as Adapters, introduce…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Kenneth Yang , Wen-Li Wei , Jen-Chun Lin

The labor-intensive nature of medical data annotation presents a significant challenge for respiratory disease diagnosis, resulting in a scarcity of high-quality labeled datasets in resource-constrained settings. Moreover, patient privacy…

机器学习 · 计算机科学 2025-07-14 Ming Wang , Zhaoyang Duan , Dong Xue , Fangzhou Liu , Zhongheng Zhang

Parameter-efficient fine-tuning (PEFT) of pre-trained foundation models is increasingly attracting interest in medical imaging due to its effectiveness and computational efficiency. Among these methods, Low-Rank Adaptation (LoRA) is a…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Ghassen Baklouti , Julio Silva-Rodríguez , Jose Dolz , Houda Bahig , Ismail Ben Ayed

Fine-tuning large language models for domain-specific tasks such as medical text summarization demands substantial computational resources. Parameter-efficient fine-tuning (PEFT) methods offer promising alternatives by updating only a small…

计算与语言 · 计算机科学 2026-03-26 Ulugbek Shernazarov , Rostislav Svitsov , Bin Shi

Medical imaging quality control (QC) is essential for accurate diagnosis, yet traditional QC methods remain labor-intensive and subjective. To address this challenge, in this study, we establish a standardized dataset and evaluation…

In endoscopic procedures, autonomous tracking of abnormal regions and following circumferential cutting markers can significantly reduce the cognitive burden on endoscopists. However, conventional model-based pipelines are fragile for each…

机器人学 · 计算机科学 2025-08-21 Chi Kit Ng , Long Bai , Guankun Wang , Yupeng Wang , Huxin Gao , Kun Yuan , Chenhan Jin , Tieyong Zeng , Hongliang Ren

Despite the notable success of current Parameter-Efficient Fine-Tuning (PEFT) methods across various domains, their effectiveness on medical datasets falls short of expectations. This limitation arises from two key factors: (1) medical…

计算工程、金融与科学 · 计算机科学 2025-09-03 Ziquan Zhu , Si-Yuan Lu , Tianjin Huang , Lu Liu , Zhe Liu

Reducing radiation doses benefits patients, however, the resultant low-dose computed tomography (LDCT) images often suffer from clinically unacceptable noise and artifacts. While deep learning (DL) shows promise in LDCT reconstruction, it…

图像与视频处理 · 电气工程与系统科学 2025-03-04 Ziyuan Yang , Yingyu Chen , Zhiwen Wang , Hongming Shan , Yang Chen , Yi Zhang

Parameter-efficient fine-tuning (PEFT) allows model builders to capture the task-specific parameters into adapters, which are a fraction of the size of the original base model. Popularity of PEFT technique for fine-tuning has led to the…

分布式、并行与集群计算 · 计算机科学 2025-10-24 Saransh Gupta , Umesh Deshpande , Travis Janssen , Swami Sundararaman

State-of-the-art computer vision tasks, like monocular depth estimation (MDE), rely heavily on large, modern Transformer-based architectures. However, their application in safety-critical domains demands reliable predictive performance and…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Richard D. Paul , Alessio Quercia , Vincent Fortuin , Katharina Nöh , Hanno Scharr