English
Related papers

Related papers: Efficient Parameter Adaptation for Multi-Modal Med…

200 papers

Many recent studies have focused on fine-tuning pre-trained models for speech emotion recognition (SER), resulting in promising performance compared to traditional methods that rely largely on low-level, knowledge-inspired acoustic…

Sound · Computer Science 2024-02-15 Tiantian Feng , Shrikanth Narayanan

Fine-tuning large language models is essential for task-specific adaptation, yet it remains computationally prohibitive. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a solution, but current approaches typically ignore the…

Computation and Language · Computer Science 2025-12-01 Dayan Pan , Jingyuan Wang , Yilong Zhou , Jiawei Cheng , Pengyue Jia , Xiangyu Zhao

This study introduces PEFT-DML, a parameter-efficient deep metric learning framework for robust multi-modal 3D object detection in autonomous driving. Unlike conventional models that assume fixed sensor availability, PEFT-DML maps diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Abdolazim Rezaei , Mehdi Sookhak

We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs). We present a new PEFT method called Robust…

Computation and Language · Computer Science 2024-06-04 Mahdi Nikdan , Soroush Tabesh , Elvir Crnčević , Dan Alistarh

Foundation models have achieved great success across diverse domains, including remote sensing (RS), thanks to their versatility and strong generalization abilities. However, most RS foundation models are designed for multispectral data,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Bernardin Ligan , Khalide Jbilou , Fahd Kalloubi , Ahmed Ratnani

With the rapid development of deep learning and computer vision technologies, medical image segmentation plays a crucial role in the early diagnosis of breast cancer. However, due to the characteristics of breast ultrasound images, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jiajun Ding , Beiyao Zhu , Wenjie Wang , Shurong Zhang , Dian Zhua , Zhao Liua

It has been shown that traditional deep learning methods for electronic microscopy segmentation usually suffer from low transferability when samples and annotations are limited, while large-scale vision foundation models are more robust…

Image and Video Processing · Electrical Eng. & Systems 2024-03-14 Yiran Wang , Li Xiao

Fine-tuning is widely used to tailor large language models for specific tasks such as neural machine translation (NMT). However, leveraging transfer learning is computationally expensive when fine-tuning large multilingual models with…

Computation and Language · Computer Science 2025-10-22 Josh McGiff , Nikola S. Nikolov

The escalating global cancer burden underscores the critical need for precise diagnostic tools in oncology. This research employs deep learning to enhance lesion segmentation in PET/CT imaging, utilizing a dataset of 900 whole-body…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Jiayi Liu , Qiaoyi Xue , Youdan Feng , Tianming Xu , Kaixin Shen , Chuyun Shen , Yuhang Shi

Parameter-Efficient Fine-Tuning (PEFT) is an efficient alternative to full scale fine-tuning, gaining popularity recently. With pre-trained model sizes growing exponentially, PEFT can be effectively utilized to fine-tune compact modules,…

Machine Learning · Computer Science 2025-01-27 Mann Patel , Divyajyoti Panda , Hilay Mehta , Parth Patel , Dhruv Parikh

As an efficient alternative to conventional full finetuning, parameter-efficient finetuning (PEFT) is becoming the prevailing method to adapt pretrained language models. In PEFT, a lightweight module is learned on each dataset while the…

Computation and Language · Computer Science 2023-12-12 Jinghan Zhang , Shiqi Chen , Junteng Liu , Junxian He

Pretrained equivariant graph neural networks based on spherical harmonics offer efficient and accurate alternatives to computationally expensive ab-initio methods, yet adapting them to new tasks and chemical environments still requires…

Machine Learning · Computer Science 2025-12-12 Dian Jin , Yancheng Yuan , Xiaoming Tao

Over the past decade, convolutional neural networks (CNN) have shown very competitive performance in medical image analysis tasks, such as disease classification, tumor segmentation, and lesion detection. CNN has great advantages in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Yin Dai , Yifan Gao

The fine-tuning of Large Language Models (LLMs) is pivotal for achieving optimal performance across diverse downstream tasks. However, while full fine-tuning delivers superior results, it entails significant computational and resource…

Computation and Language · Computer Science 2025-01-15 Yao Liang , Yuwei Wang , Yi Zeng

Parameter-efficient tuning (PET) techniques calibrate the model's predictions on downstream tasks by freezing the pre-trained models and introducing a small number of learnable parameters. However, despite the numerous PET methods proposed,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jiacheng Ruan , Xian Gao , Suncheng Xiang , Mingye Xie , Ting Liu , Yuzhuo Fu

The success of large-scale pre-trained models has established fine-tuning as a standard method for achieving significant improvements in downstream tasks. However, fine-tuning the entire parameter set of a pre-trained model is costly.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Yijin Huang , Pujin Cheng , Roger Tam , Xiaoying Tang

Accurate and efficient brain tumor segmentation remains a critical challenge in neuroimaging due to the heterogeneous nature of tumor subregions and the high computational cost of volumetric inference. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Fatemeh Ziaeetabar

Medical image segmentation, a crucial task in computer vision, facilitates the automated delineation of anatomical structures and pathologies, supporting clinicians in diagnosis, treatment planning, and disease monitoring. Notably,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Fuchen Zheng , Xinyi Chen , Xuhang Chen , Haolun Li , Xiaojiao Guo , Weihuang Liu , Chi-Man Pun , Shoujun Zhou

With the rise of cloud-edge collaboration, recommendation services are increasingly trained in distributed environments. Federated Recommendation (FR) enables such multi-end collaborative training while preserving privacy by sharing model…

Machine Learning · Computer Science 2025-12-17 Haochen Yuan , Yang Zhang , Xiang He , Quan Z. Sheng , Zhongjie Wang

Deep neural networks have been a prevailing technique in the field of medical image processing. However, the most popular convolutional neural networks (CNNs) based methods for medical image segmentation are imperfect because they model…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Zhuangzhuang Zhang , Weixiong Zhang