English
Related papers

Related papers: Foundation Model for Endoscopy Video Analysis via …

200 papers

Purpose: Data privacy regulations hinder the creation of generalizable foundation models (FMs) for surgery by preventing multi-institutional data aggregation. This study investigates federated learning (FL) as a privacy-preserving solution…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Max Kirchner , Alexander C. Jenke , Sebastian Bodenstedt , Fiona R. Kolbinger , Oliver L. Saldanha , Jakob N. Kather , Martin Wagner , Stefanie Speidel

Ultrasound is widely used in obstetric care due to its safety, accessibility, and real-time imaging. However, interpretation remains operator-dependent and susceptible to noise and artifacts. Deep learning models have shown strong…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Leya Barrientos , Yuexi Du , Nicha C. Dvornek

There is substantial interest in developing artificial intelligence systems to support radiologists across tasks ranging from segmentation to report generation. Existing computed tomography (CT) foundation models have largely focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rubén Moreno-Aguado , Alba Magallón , Victor Moreno , Yingying Fang , Guang Yang

In endovascular surgery, the precise identification of catheters and guidewires in X-ray images is essential for reducing intervention risks. However, accurately segmenting catheter and guidewire structures is challenging due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Tuong Do , Nghia Vu , Tudor Jianu , Baoru Huang , Minh Vu , Jionglong Su , Erman Tjiputra , Quang D. Tran , Te-Chuan Chiu , Anh Nguyen

Video foundation models achieve strong performance across many video understanding tasks, but typically require large-scale pre-training on massive video datasets, resulting in substantial data and compute costs. In contrast, modern image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Svetlana Orlova , Niccolò Cavagnero , Gijs Dubbelman

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Surgical tool segmentation in endoscopic videos is an important component of computer assisted interventions systems. Recent success of image-based solutions using fully-supervised deep learning approaches can be attributed to the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Manish Sahu , Ronja Strömsdörfer , Anirban Mukhopadhyay , Stefan Zachow

Electrocardiogram (ECG) is widely used in healthcare applications, such as arrhythmia detection and sleep monitoring, making accurate ECG analysis critically essential. Traditional deep learning models for ECG are task-specific, with…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Yu Han , Vittorio Murino , Xiaofeng Liu , Xiang Zhang , Cheng Ding

Driven by the recent advances in deep learning methods and, in particular, by the development of modern self-supervised learning algorithms, increased interest and efforts have been devoted to build foundation models (FMs) for medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 kaiko. ai , Nanne Aben , Edwin D. de Jong , Ioannis Gatopoulos , Nicolas Känzig , Mikhail Karasikov , Axel Lagré , Roman Moser , Joost van Doorn , Fei Tang

Electroencephalography provides a non-invasive window into brain activity, offering valuable insights for neurological research, brain-computer interfaces, and clinical diagnostics. However, the development of robust machine learning models…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Chi-Sheng Chen , Ying-Jung Chen , Aidan Hung-Wen Tsai

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an…

Image and Video Processing · Electrical Eng. & Systems 2025-01-27 Fuping Wu , Bartlomiej W. Papiez

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Traditional open-access datasets focusing on surgical procedures are often limited by their small size, typically consisting of fewer than 100 videos and less than 30 hours of footage, which leads to poor model generalization. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Chengan Che , Chao Wang , Tom Vercauteren , Sophia Tsoka , Luis C. Garcia-Peraza-Herrera

Recent advancements in video saliency prediction (VSP) have shown promising performance compared to the human visual system, whose emulation is the primary goal of VSP. However, current state-of-the-art models employ spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Morteza Moradi , Mohammad Moradi , Francesco Rundo , Concetto Spampinato , Ali Borji , Simone Palazzo

Premise. Patterns of electrical brain activity recorded via electroencephalography (EEG) offer immense value for scientific and clinical investigations. The inability of supervised EEG encoders to learn robust EEG patterns and their…

Signal Processing · Electrical Eng. & Systems 2025-12-25 Gayal Kuruppu , Neeraj Wagh , Vaclav Kremen , Sandipan Pati , Gregory Worrell , Yogatheesan Varatharajah

Diffusion models (DMs) have emerged as powerful foundation models for a variety of tasks, with a large focus in synthetic image generation. However, their requirement of large annotated datasets for training limits their applicability in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Guillermo Jimenez-Perez , Pedro Osorio , Josef Cersovsky , Javier Montalt-Tordera , Jens Hooge , Steffen Vogler , Sadegh Mohammadi

With access to large-scale, unlabeled medical datasets, researchers are confronted with two questions: Should they attempt to pretrain a custom foundation model on this medical data, or use transfer-learning from an existing generalist…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Jakob Ambsdorf , Asbjørn Munk , Sebastian Llambias , Anders Nymark Christensen , Kamil Mikolaj , Randall Balestriero , Martin Tolsgaard , Aasa Feragen , Mads Nielsen

Foundation models are becoming increasingly effective in the medical domain, offering pre-trained models on large datasets that can be readily adapted for downstream tasks. Despite progress, fetal ultrasound images remain a challenging…

We evaluate the video understanding capabilities of existing foundation models (FMs) using a carefully designed experiment protocol consisting of three hallmark tasks (action recognition,temporal localization, and spatiotemporal…