English
Related papers

Related papers: OpenUS: A Fully Open-Source Foundation Model for U…

200 papers

Functional ultrasound (fUS) imaging provides exceptional spatiotemporal resolution for neurovascular mapping, yet its practical application is significantly hampered by critical challenges. Foremost among these are data scarcity, arising…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Xuhang Chen , Zhuo Li , Yanyan Shen , Mufti Mahmud , Hieu Pham , Chi-Man Pun , Shuqiang Wang

Robotic ultrasound (US) imaging has been seen as a promising solution to overcome the limitations of free-hand US examinations, i.e., inter-operator variability. However, the fact that robotic US systems cannot react to subject movements…

Robotics · Computer Science 2022-09-07 Zhongliang Jiang , Nehil Danis , Yuan Bi , Mingchuan Zhou , Markus Kroenke , Thomas Wendler , Nassir Navab

Magnetic Resonance Imaging (MRI) is indispensable in clinical practice but remains constrained by fragmented, multi-stage workflows encompassing acquisition, reconstruction, segmentation, detection, diagnosis, and reporting. While deep…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xingxin He , Aurora Rofena , Ruimin Feng , Haozhe Liao , Zhaoye Zhou , Albert Jang , Fang Liu

In this report, we present OpenUni, a simple, lightweight, and fully open-source baseline for unifying multimodal understanding and generation. Inspired by prevailing practices in unified model learning, we adopt an efficient training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Size Wu , Zhonghua Wu , Zerui Gong , Qingyi Tao , Sheng Jin , Qinyue Li , Wei Li , Chen Change Loy

Rich temporal information and variations in viewpoints make video data an attractive choice for learning image representations using unsupervised contrastive learning (UCL) techniques. State-of-the-art (SOTA) contrastive learning techniques…

Image and Video Processing · Electrical Eng. & Systems 2022-07-28 Soumen Basu , Somanshu Singla , Mayank Gupta , Pratyaksha Rana , Pankaj Gupta , Chetan Arora

With access to large-scale, unlabeled medical datasets, researchers are confronted with two questions: Should they attempt to pretrain a custom foundation model on this medical data, or use transfer-learning from an existing generalist…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Jakob Ambsdorf , Asbjørn Munk , Sebastian Llambias , Anders Nymark Christensen , Kamil Mikolaj , Randall Balestriero , Martin Tolsgaard , Aasa Feragen , Mads Nielsen

Open-sourcing foundation models (FMs) enables broad reuse but also exposes model trainers to economic and safety risks from unrestricted downstream fine-tuning. We address this problem by building non-fine-tunable foundation models: models…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Nizhang Li , Pingzhi Li , Guoheng Sun , Tianlong Chen , Ang Li

Medical foundation models show promise to learn broadly generalizable features from large, diverse datasets. This could be the base for reliable cross-modality generalization and rapid adaptation to new, task-specific goals, with only a few…

Foundation models are used to extract transferable representations from large amounts of unlabeled data, typically via self-supervised learning (SSL). However, many of these models rely on architectures that offer limited interpretability,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Samuel Ofosu Mensah , Camila Roa , Kerol Djoumessi , Philipp Berens

Freehand three-dimensional ultrasound (3D-US) has gained considerable interest in research, but even today suffers from its high inter-operator variability in clinical practice. The high variability mainly arises from tracking inaccuracies…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Rüdiger Göbl , Diana Mateus , Christoph Hennersperger , Maximilian Baust , Nassir Navab

Photoacoustic imaging (PAI) and ultrasound imaging (USI) are important biomedical imaging techniques, due to their unique and complementary advantages in tissue's structure and function visualization. In this Letter, we proposed a coaxial…

Medical Physics · Physics 2024-11-12 Yunhui Jiang , Fan Zhang , Yuwei Zheng , Ruixi Sun , Fei Gao

Ultrasound imaging is widely used in clinical practice due to its cost-effectiveness, mobility, and safety. However, current AI research often treats disease prediction and tissue segmentation as two separate tasks and their model requires…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Zhi Chen , Le Zhang

We consider deep learning strategies in ultrasound systems, from the front-end to advanced applications. Our goal is to provide the reader with a broad understanding of the possible impact of deep learning methodologies on many aspects of…

Signal Processing · Electrical Eng. & Systems 2019-07-30 Ruud JG van Sloun , Regev Cohen , Yonina C Eldar

The integration of deep learning in medical imaging has shown great promise for enhancing diagnostic, therapeutic, and research outcomes. However, applying universal models across multiple modalities remains challenging due to the inherent…

Image and Video Processing · Electrical Eng. & Systems 2024-12-30 Yixin Chen , Lin Gao , Yajuan Gao , Rui Wang , Jingge Lian , Xiangxi Meng , Yanhua Duan , Leiying Chai , Hongbin Han , Zhaoping Cheng , Zhaoheng Xie

It is often desirable to generalize medical imaging AI models trained with dense annotations to data acquired from different ultrasound scanners or clinical sites; however, retraining these models with new annotations is often difficult and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yuyue Zhou , Shrimanti Ghosh , Michael , Xie , Justin JY Kim , Jessica Knight , Steel McDonald , Vincent Man , Jacob L. Jaremko , Abhilash Hareendranathan

Deep learning-based segmentation methods have been widely employed for automatic glaucoma diagnosis and prognosis. In practice, fundus images obtained by different fundus cameras vary significantly in terms of illumination and intensity.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Qianbi Yu , Dongnan Liu , Chaoyi Zhang , Xinwen Zhang , Weidong Cai

In this work, we present MedImageInsight, an open-source medical imaging embedding model. MedImageInsight is trained on medical images with associated text and labels across a diverse collection of domains, including X-Ray, CT, MRI,…

Automatic segmentation of anatomical landmarks from ultrasound (US) plays an important role in the management of preterm neonates with a very low birth weight due to the increased risk of developing intraventricular hemorrhage (IVH) or…

Image and Video Processing · Electrical Eng. & Systems 2019-12-19 Jeya Maria Jose V. , Rajeev Yasarla , Puyang Wang , Ilker Hacihaliloglu , Vishal M. Patel

Foundation models refer to deep learning models pretrained on large unlabeled datasets through self-supervised algorithms. In the Earth science and remote sensing communities, there is growing interest in transforming the use of Earth…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Chuc Man Duc , Hiromichi Fukui

We propose a novel deep-learning framework for super-resolution ultrasound images and videos in terms of spatial resolution and line reconstruction. We up-sample the acquired low-resolution image through a vision-based interpolation method;…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Simone Cammarasana , Paolo Nicolardi , Giuseppe Patanè