English
Related papers

Related papers: LapFM: A Laparoscopic Segmentation Foundation Mode…

200 papers

Current methods for developing foundation models in medical image segmentation rely on two primary assumptions: a fixed set of classes and the immediate availability of a substantial and diverse training dataset. However, this can be…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaoyang Chen , Hao Zheng , Yifang Xie , Yuncong Ma , Tengfei Li

Cells are the fundamental unit of biological organization, and identifying them in imaging data - cell segmentation - is a critical task for various cellular imaging experiments. While deep learning methods have led to substantial progress…

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou

Nucleus segmentation is an important analysis task in digital pathology. However, methods for automatic segmentation often struggle with new data from a different distribution, requiring users to manually annotate nuclei and retrain…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Titus Griebel , Anwai Archit , Constantin Pape

Foundation models are currently driving a paradigm shift in computer vision tasks for various fields including biology, astronomy, and robotics among others, leveraging user-generated prompts to enhance their performance. In the Laser…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Israt Zarin Era , Imtiaz Ahmed , Zhichao Liu , Srinjoy Das

Large unimodal foundation models for vision and language encode rich semantic structures, yet aligning them typically requires computationally intensive multimodal fine-tuning. Such approaches depend on large-scale parameter updates, are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Abhishek Dalvi , Vasant Honavar

Accurate segmentation of medical images is essential for diagnosis and treatment of diseases. These problems are solved by highly complex models, such as deep networks (DN), requiring a large amount of labeled data for training. Thereby,…

Image and Video Processing · Electrical Eng. & Systems 2022-04-15 Dario Sitnik , Ivica Kopriva

The landscape of publicly available vision foundation models (VFMs), such as CLIP and Segment Anything Model (SAM), is expanding rapidly. VFMs are endowed with distinct capabilities stemming from their pre-training objectives. For instance,…

This work proposes a novel approach beyond supervised learning for effective pathological image analysis, addressing the challenge of limited robust labeled data. Pathological diagnosis of diseases like cancer has conventionally relied on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Joonhyeon Song , Seohwan Yun , Seongho Yoon , Joohyeok Kim , Sangmin Lee

Robotic Foundation Models (RFMs) hold great promise as generalist, end-to-end systems for robot control. Yet their ability to generalize across new environments, tasks, and embodiments remains limited. We argue that a major bottleneck lies…

Accurate medical image segmentation is essential for clinical diagnosis and treatment planning. While recent interactive foundation models (e.g., nnInteractive) enhance generalization through large-scale multimodal pretraining, they still…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ziyu Zhang , Yi Yu , Simeng Zhu , Ahmed Aly , Yunhe Gao , Ning Gu , Yuan Xue

Medical image segmentation plays a crucial role in clinical workflows, but domain shift often leads to performance degradation when models are applied to unseen clinical domains. This challenge arises due to variations in imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yingkai Wang , Yaoyao Zhu , Xiuding Cai , Yuhao Xiao , Haotian Wu , Yu Yao

Deep learning underlies most modern approaches and tools in computer vision, including biomedical imaging. However, for interactive semantic segmentation (often called pixel classification in this context) and interactive object-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Carolin Teuber , Anwai Archit , Tobias Boothe , Peter Ditte , Jochen Rink , Constantin Pape

Universal medical image segmentation models have emerged as a promising paradigm due to their strong generalizability across diverse tasks, showing great potential for a wide range of clinical applications. This potential has been partly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Yanwu Yang , Guinan Su , Jiesi Hu , Francesco Sammarco , Jonas Geiping , Thomas Wolfers

Most state-of-the-art techniques for medical image segmentation rely on deep-learning models. These models, however, are often trained on narrowly-defined tasks in a supervised fashion, which requires expensive labeled datasets. Recent…

Image and Video Processing · Electrical Eng. & Systems 2023-10-04 Heejong Kim , Victor Ion Butoi , Adrian V. Dalca , Daniel J. A. Margolis , Mert R. Sabuncu

Constructing high-definition (HD) maps is a crucial requirement for enabling autonomous driving. In recent years, several map segmentation algorithms have been developed to address this need, leveraging advancements in Bird's-Eye View (BEV)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Peijin Jia , Tuopu Wen , Ziang Luo , Mengmeng Yang , Kun Jiang , Zhiquan Lei , Xuewei Tang , Ziyuan Liu , Le Cui , Bo Zhang , Long Huang , Diange Yang

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Semi-supervised learning (SSL) has become a promising solution to alleviate the annotation burden of deep learning-based medical image segmentation models. While recent advances in foundation model-driven SSL have pushed the boundary to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yichi Zhang , Le Xue , Bichun Xu , Judong Luo , Zhigang Wu , Yu Fu , Zixin Hu , Yuan Cheng , Yuan Qi

The clinical utility of deep learning models for medical image segmentation is severely constrained by their inability to generalize to unseen domains. This failure is often rooted in the models learning spurious correlations between…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Tao Tang , Shijie Xu , Jionglong Su , Zhixiang Lu

Generative models have achieved remarkable progress with the emergence of flow matching (FM). It has demonstrated strong generative capabilities and attracted significant attention as a simulation-free flow-based framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Huynh Trinh Ngoc , Hoang Anh Nguyen Kim , Toan Nguyen Hai , Long Tran Quoc