English
Related papers

Related papers: SynthFM: Training Modality-agnostic Foundation Mod…

200 papers

We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate…

Image and Video Processing · Electrical Eng. & Systems 2022-03-04 Malte Hoffmann , Benjamin Billot , Douglas N. Greve , Juan Eugenio Iglesias , Bruce Fischl , Adrian V. Dalca

Medical image segmentation is vital for clinical diagnosis, yet current deep learning methods often demand extensive expert effort, i.e., either through annotating large training datasets or providing prompts at inference time for each new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xingjian Li , Qifeng Wu , Adithya S. Ubaradka , Yiran Ding , Colleen Que , Runmin Jiang , Jianhua Xing , Tianyang Wang , Min Xu

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Peirong Liu , Oula Puonti , Xiaoling Hu , Karthik Gopinath , Annabel Sorby-Adams , Daniel C. Alexander , W. Taylor Kimberly , Juan E. Iglesias

The Segment Anything Model (SAM) is a recently developed all-range foundation model for image segmentation. It can use sparse manual prompts such as bounding boxes to generate pixel-level segmentation in natural images but struggles in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xing Yao , Han Liu , Dewei Hu , Daiwei Lu , Ange Lou , Hao Li , Ruining Deng , Gabriel Arenas , Baris Oguz , Nadav Schwartz , Brett C Byram , Ipek Oguz

Synthetic data, an appealing alternative to extensive expert-annotated data for medical image segmentation, consistently fails to improve segmentation performance despite its visual realism. The reason being that synthetic and real medical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 OFM Riaz Rahman Aranya , Kevin Desai

Visual recognition of materials and their states is essential for understanding the physical world, from identifying wet regions on surfaces or stains on fabrics to detecting infected areas on plants or minerals in rocks. Collecting data…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sagi Eppel , Jolina Li , Manuel Drehwald , Alan Aspuru-Guzik

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Tyler Ward , Abdullah-Al-Zubaer Imran

Foundation models for image segmentation have shown strong generalization in natural images, yet their applicability to 3D medical imaging remains limited. In this work, we study the zero-shot use of Segment Anything Model 2 (SAM2) for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Miquel Lopez Escoriza , Pau Amargant Alvarez

Few-shot semantic segmentation (FSS) offers immense potential in the field of medical image analysis, enabling accurate object segmentation with limited training data. However, existing FSS techniques heavily rely on annotated semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Sanaz Karimijafarbigloo , Reza Azad , Dorit Merhof

Grounding DINO and the Segment Anything Model (SAM) have achieved impressive performance in zero-shot object detection and image segmentation, respectively. Together, they have a great potential to revolutionize applications in zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Fuseini Mumuni , Alhassan Mumuni

Surgical image segmentation is highly challenging, primarily due to scarcity of annotated data. Generalist prompted segmentation models like the Segment-Anything Model (SAM) can help tackle this task, but because they require image-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Aditya Murali , Farahdiba Zarin , Adrien Meyer , Pietro Mascagni , Didier Mutter , Nicolas Padoy

Leveraging the Segment Anything Model (SAM) for medical image segmentation remains challenging due to its limited adaptability across diverse medical domains. Although fine-tuned variants, such as MedSAM, improve performance in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jianghao Wu , Yicheng Wu , Yutong Xie , Wenjia Bai , You Zhang , Feilong Tang , Yulong Li , Imran Razzak , Daniel F Schmidt , Yasmeen George

The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Zhiheng Cheng , Qingyue Wei , Hongru Zhu , Yan Wang , Liangqiong Qu , Wei Shao , Yuyin Zhou

Segmentation of anatomical structures and pathological regions in medical images is essential for modern clinical diagnosis, disease research, and treatment planning. While significant advancements have been made in deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

Automated segmentation of ultrasound images can assist medical experts with diagnostic and therapeutic procedures. Although using the common modality of ultrasound, one typically needs separate datasets in order to segment, for example,…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Dongik Shin , Beomsuk Kim , Seungjun Baek

Transformer-based foundation models (FMs) have recently demonstrated remarkable performance in medical image segmentation. However, scaling these models is challenging due to the limited size of medical image datasets within isolated…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Yumin Zhang , Yan Gao , Haoran Duan , Hanqing Guo , Tejal Shah , Rajiv Ranjan , Bo Wei

Domain adaptation is especially important for robotics applications, where target domain training data is usually scarce and annotations are costly to obtain. We present a method for self-supervised domain adaptation for the scenario where…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Mayara E. Bonani , Max Schwarz , Sven Behnke

In the evolving landscape of computer vision, foundation models have emerged as pivotal tools, exhibiting exceptional adaptability to a myriad of tasks. Among these, the Segment Anything Model (SAM) by Meta AI has distinguished itself in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Bo Li , Haoke Xiao , Lv Tang

Affine image registration is a cornerstone of medical image analysis. While classical algorithms can achieve excellent accuracy, they solve a time-consuming optimization for every image pair. Deep-learning (DL) methods learn a function that…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Malte Hoffmann , Andrew Hoopes , Douglas N. Greve , Bruce Fischl , Adrian V. Dalca