English
Related papers

Related papers: Training-free CryoET Tomogram Segmentation

200 papers

The Segment Anything Model (SAM) made an eye-catching debut recently and inspired many researchers to explore its potential and limitation in terms of zero-shot generalization capability. As the first promptable foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dongjie Cheng , Ziyuan Qin , Zekun Jiang , Shaoting Zhang , Qicheng Lao , Kang Li

Pre-trained on a large and diverse dataset, the segment anything model (SAM) is the first promptable foundation model in computer vision aiming at object segmentation tasks. In this work, we evaluate SAM for the task of nuclear instance…

Image and Video Processing · Electrical Eng. & Systems 2024-01-26 Kesi Xu , Lea Goetz , Nasir Rajpoot

Vision foundation models have achieved remarkable progress across various image analysis tasks. In the image segmentation task, foundation models like the Segment Anything Model (SAM) enable generalizable zero-shot segmentation through…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xingxin He , Yifan Hu , Zhaoye Zhou , Mohamed Jarraya , Fang Liu

Current deep learning-based approaches for the segmentation of microscopy images heavily rely on large amount of training data with dense annotation, which is highly costly and laborious in practice. Compared to full annotation where the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Shijie Li , Mengwei Ren , Thomas Ach , Guido Gerig

Cryo-electron microscopy (cryo-EM) has become a major experimental technique to determine the structures of large protein complexes and molecular assemblies, as evidenced by the 2017 Nobel Prize. Although cryo-EM has been drastically…

Biomolecules · Quantitative Biology 2021-06-01 Dong Si , Andrew Nakamura , Runbang Tang , Haowen Guan , Jie Hou , Ammaar Firozi , Renzhi Cao , Kyle Hippe , Minglei Zhao

High-throughput screening using automated microscopes is a key driver in biopharma drug discovery, enabling the parallel evaluation of thousands of drug candidates for diseases such as cancer. Traditional image analysis and deep learning…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Jacob Hanimann , Daniel Siegismund , Mario Wieser , Stephan Steigele

Cryo-EM is a transformational paradigm in molecular biology where computational methods are used to infer 3D molecular structure at atomic resolution from extremely noisy 2D electron microscope images. At the forefront of research is how to…

Quantitative Methods · Quantitative Biology 2025-06-12 Shayan Shekarforoush , David B. Lindell , Marcus A. Brubaker , David J. Fleet

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

We propose a straightforward yet highly effective few-shot fine-tuning strategy for adapting the Segment Anything (SAM) to anatomical segmentation tasks in medical images. Our novel approach revolves around reformulating the mask decoder…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Weiyi Xie , Nathalie Willems , Shubham Patil , Yang Li , Mayank Kumar

Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the structure of proteins and other macromolecular complexes at near-atomic resolution. In single particle cryo-EM, the central problem is to reconstruct the…

Quantitative Methods · Quantitative Biology 2020-02-18 Ellen D. Zhong , Tristan Bepler , Joseph H. Davis , Bonnie Berger

Fundamental models, trained on large-scale datasets and adapted to new data using innovative learning methods, have revolutionized various fields. In materials science, microstructure image segmentation plays a pivotal role in understanding…

Materials Science · Physics 2024-07-09 Xudong Ma , Yuqi Zhang , Chenchong Wang , Wei Xu

The segment anything model (SAM) was released as a foundation model for image segmentation. The promptable segmentation model was trained by over 1 billion masks on 11M licensed and privacy-respecting images. The model supports zero-shot…

The absence of robust segmentation frameworks for noisy liquid phase transmission electron microscopy (LPTEM) videos prevents reliable extraction of particle trajectories, creating a major barrier to quantitative analysis and to connecting…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Alexander Wang , Max Xu , Risha Goel , Zain Shabeeb , Isabel Panicker , Vida Jamali

Accurate tooth identification and segmentation in Cone Beam Computed Tomography (CBCT) dental images can significantly enhance the efficiency and precision of manual diagnoses performed by dentists. However, existing segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Pengyu Dai , Yafei Ou , Yuqiao Yang , Yang Liu , Yue Zhao

The recent advancements in large foundation models have driven the success of open-set image segmentation, a task focused on segmenting objects beyond predefined categories. Among various prompt types (such as points, boxes, texts, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaoqi Wang , Clint Sebastian , Wenbin He , Liu Ren

Medical image segmentation is fundamental for biomedical discovery. Existing methods lack generalizability and demand extensive, time-consuming manual annotation for new clinical application. Here, we propose MedSAM-3, a text promptable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Anglin Liu , Rundong Xue , Xu R. Cao , Yifan Shen , Yi Lu , Xiang Li , Qianqian Chen , Jintai Chen

Efficient and accurate extraction of microstructures in micrographs of materials is essential in process optimization and the exploration of structure-property relationships. Deep learning-based image segmentation techniques that rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Changtai Li , Xu Han , Chao Yao , Xiaojuan Ban

Automatic segmentation of medical images is a key step for diagnostic and interventional tasks. However, achieving this requires large amounts of annotated volumes, which can be tedious and time-consuming task for expert annotators. In this…

Interactive video object segmentation is a crucial video task, having various applications from video editing to data annotating. However, current approaches struggle to accurately segment objects across diverse domains. Recently, Segment…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Xiaoli Wei , Zhaoqing Wang , Yandong Guo , Chunxia Zhang , Tongliang Liu , Mingming Gong

Semantic segmentation is a core task in computer vision. Existing methods are generally divided into two categories: automatic and interactive. Interactive approaches, exemplified by the Segment Anything Model (SAM), have shown promise as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yimu Pan , Sitao Zhang , Alison D. Gernand , Jeffery A. Goldstein , James Z. Wang