中文
相关论文

相关论文: Prompt Tuning for Parameter-efficient Medical Imag…

200 篇论文

Distribution shift widely exists in medical images acquired from different medical centres and poses a significant obstacle to deploying the pre-trained semantic segmentation model in real-world applications. Test-time adaptation has proven…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Ziyang Chen , Yongsheng Pan , Yiwen Ye , Mengkang Lu , Yong Xia

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI tools such as Topaz and…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Fei He , Zhiyuan Yang , Mingyue Gao , Biplab Poudel , Newgin Sam Ebin Sam Dhas , Rajan Gyawali , Ashwin Dhakal , Jianlin Cheng , Dong Xu

Whole-body PET/CT is a cornerstone of oncological imaging, yet accurate lesion segmentation remains challenging due to tracer heterogeneity, physiological uptake, and multi-center variability. While fully automated methods have advanced…

计算机视觉与模式识别 · 计算机科学 2025-09-01 Maximilian Rokuss , Yannick Kirchhoff , Fabian Isensee , Klaus H. Maier-Hein

Generalized Category Discovery (GCD) aims to classify unlabelled images from both `seen' and `unseen' classes by transferring knowledge from a set of labelled `seen' class images. A key theme in existing GCD approaches is adapting…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Hongjun Wang , Sagar Vaze , Kai Han

In the context of medical imaging and machine learning, one of the most pressing challenges is the effective adaptation of pre-trained models to specialized medical contexts. Despite the availability of advanced pre-trained models, their…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

While originally designed for image generation, diffusion models have recently shown to provide excellent pretrained feature representations for semantic segmentation. Intrigued by this result, we set out to explore how well…

计算机视觉与模式识别 · 计算机科学 2023-07-06 Rui Gong , Martin Danelljan , Han Sun , Julio Delgado Mangas , Luc Van Gool

Prompt tuning learns soft prompts to condition frozen Pre-trained Language Models (PLMs) for performing downstream tasks in a parameter-efficient manner. While prompt tuning has gradually reached the performance level of fine-tuning as the…

计算与语言 · 计算机科学 2022-10-11 Fang Ma , Chen Zhang , Lei Ren , Jingang Wang , Qifan Wang , Wei Wu , Xiaojun Quan , Dawei Song

In recent years, deep neural networks have known a wide success in various application domains. However, they require important computational and memory resources, which severely hinders their deployment, notably on mobile devices or for…

计算机视觉与模式识别 · 计算机科学 2021-12-16 Nathan Hubens , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

Medical imaging plays a crucial role in modern healthcare by providing non-invasive visualisation of internal structures and abnormalities, enabling early disease detection, accurate diagnosis, and treatment planning. This study aims to…

图像与视频处理 · 电气工程与系统科学 2023-09-25 Walid Ehab , Yongmin Li

Despite the remarkable success of the end-to-end paradigm in deep learning, it often suffers from slow convergence and heavy reliance on large-scale datasets, which fundamentally limits its efficiency and applicability in data-scarce…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Feifei Zhang , Zhenhong Jia , Sensen Song , Fei Shi , Dayong Ren

Since its introduction, UNet has been leading a variety of medical image segmentation tasks. Although numerous follow-up studies have also been dedicated to improving the performance of standard UNet, few have conducted in-depth analyses of…

图像与视频处理 · 电气工程与系统科学 2024-06-24 Wenhui Zhu , Xiwen Chen , Peijie Qiu , Mohammad Farazi , Aristeidis Sotiras , Abolfazl Razi , Yalin Wang

Medical image segmentation is a difficult but important task for many clinical operations such as cardiac bi-ventricular volume estimation. More recently, there has been a shift to utilizing deep learning and fully convolutional neural…

图像与视频处理 · 电气工程与系统科学 2020-03-17 Jesse Sun , Fatemeh Darbehani , Mark Zaidi , Bo Wang

Parameter-efficient fine-tuning strategies for foundation models in 1D textual and 2D visual analysis have demonstrated remarkable efficacy. However, due to the scarcity of point cloud data, pre-training large 3D models remains a…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Mengke Li , Lihao Chen , Peng Zhang , Yiu-ming Cheung , Hui Huang

Context-based fine-tuning methods, including prompting, in-context learning, soft prompting (also known as prompt tuning), and prefix-tuning, have gained popularity due to their ability to often match the performance of full fine-tuning…

机器学习 · 计算机科学 2024-04-10 Aleksandar Petrov , Philip H. S. Torr , Adel Bibi

Pre-trained graph neural networks (GNNs) transfer well, but adapting them to downstream tasks remains challenging due to mismatches between pre-training objectives and task requirements. Graph prompt tuning offers a parameter-efficient…

机器学习 · 计算机科学 2026-02-06 Long D. Nguyen , Binh P. Nguyen

Prompt tuning prepends a soft prompt to the input embeddings or hidden states and only optimizes the prompt to adapt pretrained models (PTMs) to downstream tasks. The previous work manually selects prompt layers which are far from optimal…

计算与语言 · 计算机科学 2023-11-01 Wei Zhu , Ming Tan

Deep convolutional neural networks (CNNs) have shown excellent performance in object recognition tasks and dense classification problems such as semantic segmentation. However, training deep neural networks on large and sparse datasets is…

计算机视觉与模式识别 · 计算机科学 2017-12-25 Lorenz Berger , Eoin Hyde , M. Jorge Cardoso , Sebastien Ourselin

Medication recommendation is one of the most critical health-related applications, which has attracted extensive research interest recently. Most existing works focus on a single hospital with abundant medical data. However, many small…

信息检索 · 计算机科学 2024-12-31 Qidong Liu , Zhaopeng Qiu , Xiangyu Zhao , Xian Wu , Zijian Zhang , Tong Xu , Feng Tian

Prompt tuning is a technology that tunes a small set of parameters to steer a pre-trained language model (LM) to directly generate the output for downstream tasks. Recently, prompt tuning has demonstrated its storage and computation…

音频与语音处理 · 电气工程与系统科学 2023-03-02 Kai-Wei Chang , Yu-Kai Wang , Hua Shen , Iu-thing Kang , Wei-Cheng Tseng , Shang-Wen Li , Hung-yi Lee

As deep neural networks are growing in size and being increasingly deployed to more resource-limited devices, there has been a recent surge of interest in network pruning methods, which aim to remove less important weights or activations of…

机器学习 · 计算机科学 2020-06-23 Minyoung Song , Jaehong Yoon , Eunho Yang , Sung Ju Hwang