English
Related papers

Related papers: Exploring Foundation Models Fine-Tuning for Cytolo…

200 papers

In biomedical imaging, deep learning-based methods are state-of-the-art for every modality (virtual slides, MRI, etc.) In histopathology, these methods can be used to detect certain biomarkers or classify lesions. However, such techniques…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Adrien Nivaggioli , Nicolas Pozin , Rémy Peyret , Stéphane Sockeel , Marie Sockeel , Nicolas Nerrienet , Marceau Clavel , Clara Simmat , Catherine Miquel

Advancements in artificial intelligence have driven the development of numerous pathology foundation models capable of extracting clinically relevant information. However, there is currently limited literature independently evaluating these…

Foundation models pretrained on large-scale histopathology data have found great success in various fields of computational pathology, but their impact on regressive biomarker prediction remains underexplored. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Alexander Blezinger , Wolfgang Nejdl , Ming Tang

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Since the emergence of the ImageNet dataset, the pretraining and fine-tuning approach has become widely adopted in computer vision due to the ability of ImageNet-pretrained models to learn a wide variety of visual features. However, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Pablo Meseguer , Rocío del Amor , Adrian Colomer , Valery Naranjo

Recently, multimodal deep learning, which integrates histopathology slides and molecular biomarkers, has achieved a promising performance in glioma grading. Despite great progress, due to the intra-modality complexity and inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Li Pan , Yupei Zhang , Qiushi Yang , Tan Li , Xiaohan Xing , Maximus C. F. Yeung , Zhen Chen

Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an…

Image and Video Processing · Electrical Eng. & Systems 2025-01-27 Fuping Wu , Bartlomiej W. Papiez

Recently, pre-trained model and efficient parameter tuning have achieved remarkable success in natural language processing and high-level computer vision with the aid of masked modeling and prompt tuning. In low-level computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Donwon Park , Hayeon Kim , Se Young Chun

Foundation models have transformed medical image analysis by providing robust feature representations that reduce the need for large-scale task-specific training. However, current benchmarks in dermatology often reduce the complex…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Furkan Yuceyalcin , Abdurrahim Yilmaz , Burak Temelkuran

Low-Rank Adaptation (LoRA) is one of the most widely used techniques for fine-tuning large language models (LLMs). By introducing a small number of trainable low-rank weight matrices, LoRA substantially reduces the number of parameters that…

Machine Learning · Computer Science 2025-07-15 Seokmin Ko

The recent surge in large-scale foundation models has spurred the development of efficient methods for adapting these models to various downstream tasks. Low-rank adaptation methods, such as LoRA, have gained significant attention due to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Sanghyeon Kim , Hyunmo Yang , Younghyun Kim , Youngjoon Hong , Eunbyung Park

Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bilel Guetarni , Feryal Windal , Halim Benhabiles , Mahfoud Chaibi , Romain Dubois , Emmanuelle Leteurtre , Dominique Collard

Chromosome analysis is vital for diagnosing genetic disorders and guiding cancer therapy decisions through the identification of somatic clonal aberrations. However, developing an AI model are hindered by the overwhelming complexity and…

Quantitative Methods · Quantitative Biology 2025-05-23 Changchun Yang , Weiqian Dai , Yilan Zhang , Siyuan Chen , Jingdong Hu , Junkai Su , Yuxuan Chen , Ao Xu , Na Li , Xin Gao , Yongguo Yu

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Pathological is crucial to cancer diagnosis. Usually, Pathologists draw their conclusion based on observed cell and tissue structure on histology slides. Rapid development in machine learning, especially deep learning have established…

Image and Video Processing · Electrical Eng. & Systems 2020-01-15 Jiangbo Shi , Zeyu Gao , Haichuan Zhang , Pargorn Puttapirat , Chunbao Wang , Xiangrong Zhang , Chen Li

We explore efficient strategies to fine-tune decoder-only Large Language Models (LLMs) for downstream text classification under resource constraints. Two approaches are investigated: (1) attaching a classification head to a pretrained…

Computation and Language · Computer Science 2026-05-26 Amirhossein Yousefiramandi , Ciaran Cooney

Deployment of deep neural networks in real-world settings typically requires adaptation to new tasks with few examples. Few-shot classification (FSC) provides a solution to this problem by leveraging pre-trained backbones for fast…

Machine Learning · Computer Science 2025-03-19 Rui Li , Martin Trapp , Marcus Klasson , Arno Solin

Analyzing Pap cytology slides is an important tasks in detecting and grading precancerous and cancerous cervical cancer stages. Processing cytology images usually involve segmenting nuclei and overlapping cells. We introduce a cervical…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Hady Ahmady Phoulady , Peter R. Mouton

Low-Rank Adaptation (LoRA) is a widely used technique for fine-tuning large pre-trained or foundational models across different modalities and tasks. However, its application to time series data, particularly within foundational models,…

Machine Learning · Computer Science 2024-10-24 Divij Gupta , Anubhav Bhatti , Suraj Parmar , Chen Dan , Yuwei Liu , Bingjie Shen , San Lee

In order to streamline the fine-tuning of foundation models, Low-Rank Adapters (LoRAs) have been substantially adopted across various fields, including instruction tuning and domain adaptation. The underlying concept of LoRA involves…

Machine Learning · Computer Science 2025-02-25 Mengyang Sun , Yihao Wang , Tao Feng , Dan Zhang , Yifan Zhu , Jie Tang