English
Related papers

Related papers: Are Vision Foundation Models Foundational for Elec…

200 papers

Vision Foundation Models (VFMs) have become the cornerstone of modern computer vision, offering robust representations across a wide array of tasks. While recent advances allow these models to handle varying input sizes during training,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Bocheng Zou , Mu Cai , Mark Stanley , Dingfu Lu , Yong Jae Lee

Medical image segmentation is a vital healthcare endeavor requiring precise and efficient models for appropriate diagnosis and treatment. Vision transformer (ViT)-based segmentation models have shown great performance in accomplishing this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Numan Saeed , Muhammad Ridzuan , Roba Al Majzoub , Mohammad Yaqub

Vision foundation models have demonstrated exceptional generalization capabilities in segmentation tasks for both generic and specialized images. However, a performance gap persists between foundation models and task-specific, specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Chengxi Zeng , David Smithard , Alberto M Gambaruto , Tilo Burghardt

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou

Vision transformer based models bring significant improvements for image segmentation tasks. Although these architectures offer powerful capabilities irrespective of specific segmentation tasks, their use of computational resources can be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Manyi Yao , Abhishek Aich , Yumin Suh , Amit Roy-Chowdhury , Christian Shelton , Manmohan Chandraker

The limited data availability and the low signal-to-noise ratio of fMRI signals lead to the challenging task of fMRI-to-image retrieval. State-of-the-art MindEye remarkably improves fMRI-to-image retrieval performance by leveraging a large…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Zixuan Gong , Qi Zhang , Guangyin Bao , Lei Zhu , Ke Liu , Liang Hu , Duoqian Miao , Yu Zhang

Foundation models, pre-trained on large image datasets and capable of capturing rich feature representations, have recently shown potential for zero-shot image registration. However, their performance has mostly been tested in the context…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Hanxue Gu , Yaqian Chen , Nicholas Konz , Qihang Li , Maciej A. Mazurowski

Background: RETFound, a self-supervised, retina-specific foundation model (FM), showed potential in downstream applications. However, its comparative performance with traditional deep learning (DL) models remains incompletely understood.…

Parameter-Efficient Fine-Tuning (PEFT) of text-to-image models has become an increasingly popular technique with many applications. Among the various PEFT methods, Low-Rank Adaptation (LoRA) and its variants have gained significant…

Machine Learning · Computer Science 2025-08-01 Zerui Tao , Yuhta Takida , Naoki Murata , Qibin Zhao , Yuki Mitsufuji

Recent advancements in pre-trained large foundation models (LFM) have yielded significant breakthroughs across various domains, including natural language processing and computer vision. These models have been particularly impactful in the…

Image and Video Processing · Electrical Eng. & Systems 2024-05-22 Ziqin Lin , Heng Li , Zinan Li , Huazhu Fu , Jiang Liu

Existing vision tokenization isolates the optimization of vision tokenizers from downstream training, implicitly assuming the visual tokens can generalize well across various tasks, e.g., image generation and visual question answering. The…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Wenxuan Wang , Fan Zhang , Yufeng Cui , Haiwen Diao , Zhuoyan Luo , Huchuan Lu , Jing Liu , Xinlong Wang

Integrating image and text data through multi-modal learning has emerged as a new approach in medical imaging research, following its successful deployment in computer vision. While considerable efforts have been dedicated to establishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Fereshteh Shakeri , Yunshi Huang , Julio Silva-Rodríguez , Houda Bahig , An Tang , Jose Dolz , Ismail Ben Ayed

Vision Foundation Models(VFMs) have achieved remarkable success in various computer vision tasks. However, their application to semantic segmentation is hindered by two significant challenges: (1) the disparity in data scale, as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhixiang Wei , Xiaoxiao Ma , Ruishen Yan , Tao Tu , Huaian Chen , Jinjin Zheng , Yi Jin , Enhong Chen

Recent advancements in foundation models have transformed computer vision, driving significant performance improvements across diverse domains, including digital histopathology. However, the advantages of domain-specific histopathology…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Valentina Vadori , Antonella Peruffo , Jean-Marie Graïc , Livio Finos , Enrico Grisan

Fine-tuning large language models (LLMs) is crucial for improving their performance on downstream tasks, but full-parameter fine-tuning (Full-FT) is computationally expensive and memory-intensive. Parameter-efficient fine-tuning (PEFT)…

Computation and Language · Computer Science 2026-05-12 Longteng Zhang , Lin Zhang , Shaohuai Shi , Xiaowen Chu , Bo Li

State-of-the-art vessel segmentation methods typically require large-scale annotated datasets and suffer from severe performance degradation under domain shifts. In clinical practice, however, acquiring extensive annotations for every new…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Kirato Yoshihara , Yohei Sugawara , Yuta Tokuoka , Lihang Hong

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Medical image segmentation is crucial for computer-aided diagnosis, yet privacy constraints hinder data sharing across institutions. Federated learning addresses this limitation, but existing approaches often rely on lightweight…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Tong Wang , Xingyue Zhao , Linghao Zhuang , Haoyu Zhao , Jiayi Yin , Yuyang He , Gang Yu , Bo Lin

Large-scale Vision-Language Foundation Models (VLFMs), such as CLIP, now underpin a wide range of computer vision research and applications. VLFMs are often adapted to various domain-specific tasks. However, VLFM performance on novel,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Chris Vorster , Mayug Maniparambil , Noel E. O'Connor , Noel Murphy , Derek Molloy

In recent years, foundation models such as CLIP, DINO,and CONCH have demonstrated remarkable domain generalization and unsupervised feature extraction capabilities across diverse imaging tasks. However, systematic and independent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lavish Ramchandani , Aashay Tinaikar , Dev Kumar Das , Rohit Garg , Tijo Thomas