English
Related papers

Related papers: A Multimodal 3D Foundation Model for Light Sheet F…

200 papers

Recently, large-scale pre-trained models such as Segment-Anything Model (SAM) and Contrastive Language-Image Pre-training (CLIP) have demonstrated remarkable success and revolutionized the field of computer vision. These foundation vision…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Shichao Dong , Fayao Liu , Guosheng Lin

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

Electron microscopy (EM) imaging offers unparalleled resolution for analyzing neural tissues, crucial for uncovering the intricacies of synaptic connections and neural processes fundamental to understanding behavioral mechanisms. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ruohua Shi , Qiufan Pang , Lei Ma , Lingyu Duan , Tiejun Huang , Tingting Jiang

Fluorescence microscopy is essential to study biological structures and dynamics. However, existing systems suffer from a tradeoff between field-of-view (FOV), resolution, and complexity, and thus cannot fulfill the emerging need of…

Optics · Physics 2022-09-09 Yujia Xue , Qianwan Yang , Guorong Hu , Kehan Guo , Lei Tian

We developed a Bessel light sheet fluorescence microscopy (LSFM) system to enable high-speed, wide-field intra-vital imaging of zebrafish and other thick biological samples. This system uses air objectives for the convenient mounting of…

Optics · Physics 2023-11-07 Chuhui Wang , Jiaju Chen , Cuiyi Peng , Zhenglin Chen , Dongmei Yu , Peiwu Qin

Fluorescence microscopy has been a significant tool to observe long-term imaging of embryos (in vivo) growth over time. However, cumulative exposure is phototoxic to such sensitive live samples. While techniques like light-sheet…

Image and Video Processing · Electrical Eng. & Systems 2022-01-05 Varun Mannam , Jacob Brandt , Cody J. Smith , Scott Howard

Statistical Shape Modeling (SSM) effectively analyzes anatomical variations within populations but is limited by the need for manual localization and segmentation, which relies on scarce medical expertise. Recent advances in deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Janmesh Ukey , Tushar Kataria , Shireen Y. Elhabian

Surgical segmentation is pivotal for scene understanding yet remains hindered by annotation scarcity and semantic inconsistency across diverse procedures. Existing approaches typically fine-tune natural foundation models (e.g., SAM) with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Qing Xu , Kun Yuan , Yuxiang Luo , Yuhao Zhai , Wenting Duan , Nassir Navab , Zhen Chen

Foundation models (FMs) have shown transformative potential in radiology by performing diverse, complex tasks across imaging modalities. Here, we developed CT-FM, a large-scale 3D image-based pre-trained model designed explicitly for…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Suraj Pai , Ibrahim Hadzic , Dennis Bontempi , Keno Bressem , Benjamin H. Kann , Andriy Fedorov , Raymond H. Mak , Hugo J. W. L. Aerts

Volumetric biomedical microscopy has the potential to increase the diagnostic information extracted from clinical tissue specimens and improve the diagnostic accuracy of both human pathologists and computational pathology models.…

Image and Video Processing · Electrical Eng. & Systems 2024-04-16 Cheng Jiang , Alexander Gedeon , Yiwei Lyu , Eric Landgraf , Yufeng Zhang , Xinhai Hou , Akhil Kondepudi , Asadur Chowdury , Honglak Lee , Todd Hollon

The recent popularity of foundation models and the pre-train-and-adapt paradigm, where a large-scale model is transferred to downstream tasks, is gaining attention for volumetric medical image segmentation. However, current transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Julio Silva-Rodríguez , Jose Dolz , Ismail Ben Ayed

Breast-Conserving Surgery (BCS) requires precise intraoperative margin assessment to preserve healthy tissue. Deep Ultraviolet Fluorescence Scanning Microscopy (DUV-FSM) offers rapid, high-resolution surface imaging for this purpose;…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Pouya Afshin , David Helminiak , Tianling Niu , Julie M. Jorns , Tina Yen , Bing Yu , Dong Hye Ye

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Foundation models are emerging as a powerful paradigm for fMRI analysis, but current approaches face a dual bottleneck of data- and training-efficiency. Atlas-based methods aggregate voxel signals into fixed regions of interest, reducing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Mo Wang , Junfeng Xia , Wenhao Ye , Enyu Liu , Kaining Peng , Jianfeng Feng , Quanying Liu , Hongkai Wen

Foundational models (FMs), pretrained on extensive datasets using self-supervised techniques, are capable of learning generalized patterns from large amounts of data. This reduces the need for extensive labeled datasets for each new task,…

Machine Learning · Computer Science 2024-06-19 Quan M. Tran , Suong N. Hoang , Lam M. Nguyen , Dzung Phan , Hoang Thanh Lam

Whole-heart segmentation from CT and MRI scans is crucial for cardiovascular disease analysis, yet existing methods struggle with modality-specific biases and the need for extensive labeled datasets. To address these challenges, we propose…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Abdul Qayyum , Moona Mazher , Devran Ugurlu , Jose Alonso Solis Lemus , Cristobal Rodero , Steven A Niederer

We present Light3R-SfM, a feed-forward, end-to-end learnable framework for efficient large-scale Structure-from-Motion (SfM) from unconstrained image collections. Unlike existing SfM solutions that rely on costly matching and global…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sven Elflein , Qunjie Zhou , Sérgio Agostinho , Laura Leal-Taixé

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Although vision foundation models (VFMs) are increasingly reused for biomedical image analysis, it remains unclear whether the latent representations they provide are general enough to support effective transfer and reuse across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Caterina Fuster-Barceló , Virginie Uhlmann

Imaging through scattering is a pervasive and difficult problem in many biological applications. The high background and the exponentially attenuated target signals due to scattering fundamentally limits the imaging depth of fluorescence…

Signal Processing · Electrical Eng. & Systems 2023-12-11 Jeffrey Alido , Joseph Greene , Yujia Xue , Guorong Hu , Yunzhe Li , Mitchell Gilmore , Kevin J. Monk , Brett T. DiBenedictis , Ian G. Davison , Lei Tian