中文
相关论文

相关论文: A Multimodal 3D Foundation Model for Light Sheet F…

200 篇论文

Today the gold standard for in vivo imaging through scattering tissue is the point-scanning two-photon microscope (PSTPM). Especially in neuroscience, PSTPM is widely used for deep-tissue imaging in the brain. However, due to sequential…

图像与视频处理 · 电气工程与系统科学 2020-01-03 Zhun Wei , Josiah R. Boivin , Yi Xue , Xudong Chen , Peter T. C. So , Elly Nedivi , Dushan N. Wadduwage

The Long Short-Term Memory (LSTM) layer is an important advancement in the field of neural networks and machine learning, allowing for effective training and impressive inference performance. LSTM-based neural networks have been…

神经与进化计算 · 计算机科学 2019-01-04 Daniel Kent , Fathi M. Salem

Volumetric medical image segmentation is pivotal in enhancing disease diagnosis, treatment planning, and advancing medical research. While existing volumetric foundation models for medical image segmentation, such as SAM-Med3D and SegVol,…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Guoan Wang , Jin Ye , Junlong Cheng , Tianbin Li , Zhaolin Chen , Jianfei Cai , Junjun He , Bohan Zhuang

Transfer learning leverages pre-trained model features from a large dataset to save time and resources when training new models for various tasks, potentially enhancing performance. Due to the lack of large datasets in the medical imaging…

图像与视频处理 · 电气工程与系统科学 2023-11-10 Gabriel Efrain Humpire-Mamani , Colin Jacobs , Mathias Prokop , Bram van Ginneken , Nikolas Lessmann

Despite the rapid evolution of semantic segmentation for land cover classification in high-resolution remote sensing imagery, integrating multiple data modalities such as Digital Surface Model (DSM), RGB, and Near-infrared (NIR) remains a…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Tong Wang , Guanzhou Chen , Xiaodong Zhang , Chenxi Liu , Xiaoliang Tan , Jiaqi Wang , Chanjuan He , Wenlin Zhou

Statistical shape modeling (SSM) directly from 3D medical images is an underutilized tool for detecting pathology, diagnosing disease, and conducting population-level morphology analysis. Deep learning frameworks have increased the…

计算机视觉与模式识别 · 计算机科学 2022-05-17 Jadie Adams , Shireen Elhabian

Learning versatile, fine-grained representations from irregular event streams is pivotal yet nontrivial, primarily due to the heavy annotation that hinders scalability in dataset size, semantic richness, and application scope. To mitigate…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Zhiwen Chen , Junhui Hou , Zhiyu Zhu , Jinjian Wu , Guangming Shi

Current volumetric biomedical foundation models struggle to generalize as public 3D datasets are small and do not cover the broad diversity of medical procedures, conditions, anatomical regions, and imaging protocols. We address this by…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Neel Dey , Benjamin Billot , Hallee E. Wong , Clinton J. Wang , Mengwei Ren , P. Ellen Grant , Adrian V. Dalca , Polina Golland

Medical image registration is a fundamental task in medical image analysis, aiming to establish spatial correspondences between paired images. However, existing unsupervised deformable registration methods rely solely on intensity-based…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Hao Xu , Tengfei Xue , Jianan Fan , Dongnan Liu , Yuqian Chen , Fan Zhang , Carl-Fredrik Westin , Ron Kikinis , Lauren J. O'Donnell , Weidong Cai

Weakly supervised segmentation is an important problem in medical image analysis due to the high cost of pixelwise annotation. Prior methods, while often focusing on weak labels of 2D images, exploit few structural cues of volumetric…

计算机视觉与模式识别 · 计算机科学 2021-05-07 Qian He , Shuailin Li , Xuming He

Purpose: Automated ultrasound image analysis is challenging due to anatomical complexity and limited annotated data. To tackle this, we take a data-centric approach, assembling the largest public ultrasound segmentation dataset and training…

图像与视频处理 · 电气工程与系统科学 2025-11-13 Adrien Meyer , Aditya Murali , Farahdiba Zarin , Didier Mutter , Nicolas Padoy

Purpose: To investigate whether a vision-language foundation model can enhance undersampled MRI reconstruction by providing high-level contextual information beyond conventional priors. Methods: We proposed a semantic distribution-guided…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Ruimin Feng , Xingxin He , Ronald Mercer , Zachary Stewart , Fang Liu

Foundational models have emerged as a powerful paradigm in deep learning field, leveraging their capacity to learn robust representations from large-scale datasets and effectively to diverse downstream applications such as classification.…

Foundation models, pre-trained on large image datasets and capable of capturing rich feature representations, have recently shown potential for zero-shot image registration. However, their performance has mostly been tested in the context…

图像与视频处理 · 电气工程与系统科学 2025-08-12 Hanxue Gu , Yaqian Chen , Nicholas Konz , Qihang Li , Maciej A. Mazurowski

Existing segmentation models trained on a single medical imaging dataset often lack robustness when encountering unseen organs or tumors. Developing a robust model capable of identifying rare or novel tumor categories not present during…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Rong Wu , Ziqi Chen , Liming Zhong , Heng Li , Hai Shu

Morphology of mitochondria plays critical roles in mediating their physiological functions. Accurate segmentation of mitochondria from 3D electron microscopy (EM) images is essential to quantitative characterization of their morphology at…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Yunpeng Xiao , Youpeng Zhao , Ge Yang

The structured light (SL)-based three-dimensional (3D) measurement techniques with deep learning have been widely studied to improve measurement efficiency, among which fringe projection profilometry (FPP) and speckle projection…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Mingyang Lei , Jingfan Fan , Long Shao , Hong Song , Deqiang Xiao , Danni Ai , Tianyu Fu , Ying Gu , Jian Yang

The application of 3D ViTs to medical image segmentation has seen remarkable strides, somewhat overshadowing the budding advancements in Convolutional Neural Network (CNN)-based models. Large kernel depthwise convolution has emerged as a…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Ho Hin Lee , Quan Liu , Qi Yang , Xin Yu , Shunxing Bao , Yuankai Huo , Bennett A. Landman

This study aimed to enhance disease classification accuracy from retinal fundus images by integrating fine-grained image features and global textual context using a novel multimodal deep learning architecture. Existing multimodal large…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Jason Jordan , Mohammadreza Akbari Lor , Peter Koulen , Mei-Ling Shyu , Shu-Ching Chen

Delineation of anatomical structures is often the first step of many medical image analysis workflows. While convolutional neural networks achieve high performance, these do not incorporate anatomical shape information. We introduce a novel…

图像与视频处理 · 电气工程与系统科学 2023-10-18 Athira J Jacob , Puneet Sharma , Daniel Ruckert