English
Related papers

Related papers: A Multimodal 3D Foundation Model for Light Sheet F…

200 papers

Lensless imaging stands out as a promising alternative to conventional lens-based systems, particularly in scenarios demanding ultracompact form factors and cost-effective architectures. However, such systems are fundamentally governed by…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Jiesong Bai , Yuhao Yin , Yihang Dong , Xiaofeng Zhang , Chi-Man Pun , Xuhang Chen

Foundation models are used to extract transferable representations from large amounts of unlabeled data, typically via self-supervised learning (SSL). However, many of these models rely on architectures that offer limited interpretability,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Samuel Ofosu Mensah , Camila Roa , Kerol Djoumessi , Philipp Berens

In current biological and medical research, statistical shape modeling (SSM) provides an essential framework for the characterization of anatomy/morphology. Such analysis is often driven by the identification of a relatively small number of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Riddhish Bhalodia , Shireen Elhabian , Ladislav Kavan , Ross Whitaker

Deformable image registration is a fundamental task in medical imaging. Due to the large computational complexity of deformable registration of volumetric images, conventional iterative methods usually face the tradeoff between the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Kaicong Sun , Sven Simon

Accurate automatic medical image segmentation relies on high-quality, dense annotations, which are costly and time-consuming. Weakly supervised learning provides a more efficient alternative by leveraging sparse and coarse annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Dongdong Meng , Sheng Li , Hao Wu , Suqing Tian , Wenjun Ma , Guoping Wang , Xueqing Yan

Labelling data is expensive and time consuming especially for domains such as medical imaging that contain volumetric imaging data and require expert knowledge. Exploiting a larger pool of labeled data available across multiple centers,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Daiqing Li , Amlan Kar , Nishant Ravikumar , Alejandro F Frangi , Sanja Fidler

Ultrasound imaging is a cost-effective and radiation-free modality for visualizing anatomical structures in real-time, making it ideal for guiding surgical interventions. However, its limited field-of-view, speckle noise, and imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-04-26 Remi Delaunay , Ruisi Zhang , Filipe C. Pedrosa , Navid Feizi , Dianne Sacco , Rajni Patel , Jayender Jagadeesan

Fluorescence microscopy allows for a detailed inspection of cells, cellular networks, and anatomical landmarks by staining with a variety of carefully-selected markers visualized as color channels. Quantitative characterization of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Alvaro Gomariz , Tiziano Portenier , Patrick M. Helbling , Stephan Isringhausen , Ute Suessbier , César Nombela-Arrieta , Orcun Goksel

In recent years, researchers pay growing attention to the few-shot learning (FSL) task to address the data-scarce problem. A standard FSL framework is composed of two components: i) Pre-train. Employ the base data to generate a CNN-based…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Shuai Shao , Lei Xing , Rui Xu , Weifeng Liu , Yan-Jiang Wang , Bao-Di Liu

Amyotrophic Lateral Sclerosis (ALS) is a complex neurodegenerative disorder involving motor neuron degeneration. Significant research has begun to establish brain magnetic resonance imaging (MRI) as a potential biomarker to diagnose and…

This research presents a novel framework for the compression and decompression of medical images utilizing the Latent Diffusion Model (LDM). The LDM represents advancement over the denoising diffusion probabilistic model (DDPM) with a…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 InChan Hwang , MinJae Woo

Foundation models have exhibited remarkable success in various applications, such as disease diagnosis and text report generation. To date, a foundation model for endoscopic video analysis is still lacking. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Zhao Wang , Chang Liu , Shaoting Zhang , Qi Dou

Federated Learning (FL) enables collaborative model training across decentralized clients without sharing private data. However, FL suffers from biased global models due to non-IID and long-tail data distributions. We propose…

Machine Learning · Computer Science 2026-01-08 Jingrui Zhang , Yimeng Xu , Shujie Li , Feng Liang , Haihan Duan , Yanjie Dong , Victor C. M. Leung , Xiping Hu

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

Vision foundation models (VFMs) have emerged as powerful tools for surgical scene understanding. However, current approaches predominantly rely on unimodal RGB pre-training, overlooking the complex 3D geometry inherent to surgical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 John J. Han , Adam Schmidt , Muhammad Abdullah Jamal , Chinedu Nwoye , Anita Rau , Jie Ying Wu , Omid Mohareri

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

3D Morphable Models (3DMMs) are generative models for face shape and appearance. However, the shape parameters of traditional 3DMMs satisfy the multivariate Gaussian distribution while the identity embeddings satisfy the hypersphere…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Diqiong Jiang , Yiwei Jin , Fanglue Zhang , Zhe Zhu , Yun Zhang , Ruofeng Tong , Min Tang

Deep learning (DL) methods have shown remarkable successes in medical image segmentation, often using large amounts of annotated data for model training. However, acquiring a large number of diverse labeled 3D medical image datasets is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Delin An , Pengfei Gu , Milan Sonka , Chaoli Wang , Danny Z. Chen