English
Related papers

Related papers: Disruptive Autoencoders: Leveraging Low-level feat…

200 papers

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado

Medical imaging tasks are very challenging due to the lack of publicly available labeled datasets. Hence, it is difficult to achieve high performance with existing deep-learning models as they require a massive labeled dataset to be trained…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Anubhav Gupta , Islam Osman , Mohamed S. Shehata , John W. Braun

Although self-supervised learning enables us to bootstrap the training by exploiting unlabeled data, the generic self-supervised methods for natural images do not sufficiently incorporate the context. For medical images, a desirable method…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Li Sun , Ke Yu , Kayhan Batmanghelich

Purpose. Given the high level of expertise required for navigation and interpretation of ultrasound images, computational simulations can facilitate the training of such skills in virtual reality. With ray-tracing based simulations,…

Image and Video Processing · Electrical Eng. & Systems 2021-01-22 Lin Zhang , Tiziano Portenier , Orcun Goksel

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao

The pre-trained transformer demonstrates remarkable generalization ability in natural image processing. However, directly transferring it to magnetic resonance images faces two key challenges: the inability to adapt to the specificity of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jingkai Li , Xiaoze Tian , Yuhang Shen , Jia Wang , Dianjie Lu , Guijuan Zhang , Zhuoran Zheng

Recent self-supervised advances in medical computer vision exploit global and local anatomical self-similarity for pretraining prior to downstream tasks such as segmentation. However, current methods assume i.i.d. image acquisition, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Mengwei Ren , Neel Dey , Martin A. Styner , Kelly Botteron , Guido Gerig

Deep learning has transformed computer vision but relies heavily on large labeled datasets and computational resources. Transfer learning, particularly fine-tuning pretrained models, offers a practical alternative; however, models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Iván Matas , Carmen Serrano , Miguel Nogales , David Moreno , Lara Ferrándiz , Teresa Ojeda , Begoña Acha

Unsupervised learning enables modeling complex images without the need for annotations. The representation learned by such models can facilitate any subsequent analysis of large image datasets. However, some generative factors that cause…

Image and Video Processing · Electrical Eng. & Systems 2020-08-27 Maxime W. Lafarge , Josien P. W. Pluim , Mitko Veta

Shape priors have long been known to be effective when reconstructing 3D shapes from noisy or incomplete data. When using a deep-learning based shape representation, this often involves learning a latent representation, which can be either…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Patrick M. Jensen , Udaranga Wickramasinghe , Anders B. Dahl , Pascal Fua , Vedrana A. Dahl

Deformable templates, or atlases, are images that represent a prototypical anatomy for a population, and are often enhanced with probabilistic anatomical label maps. They are commonly used in medical image analysis for population studies…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Marianne Rakic , Andrew Hoopes , S. Mazdak Abulnaga , Mert R. Sabuncu , John V. Guttag , Adrian V. Dalca

Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shuang Zeng , Lei Zhu , Xinliang Zhang , Micky C Nnamdi , Wenqi Shi , J Ben Tamo , Qian Chen , Hangzhou He , Lujia Jin , Zifeng Tian , Qiushi Ren , Zhaoheng Xie , Yanye Lu

Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , David Cornell , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

We investigated the adaptation and performance of Masked Autoencoders (MAEs) with Vision Transformer (ViT) architectures for self-supervised representation learning on one-dimensional (1D) ultrasound signals. Although MAEs have demonstrated…

Machine Learning · Computer Science 2025-08-29 Immanuel Roßteutscher , Klaus S. Drese , Thorsten Uphues

Self-supervised learning methods based on image patch reconstruction have witnessed great success in training auto-encoders, whose pre-trained weights can be transferred to fine-tune other downstream tasks of image understanding. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Junjia Huang , Haofeng Li , Guanbin Li , Xiang Wan

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

This paper proposes an encoder-decoder network to disentangle shape features during 3D face reconstruction from single 2D images, such that the tasks of reconstructing accurate 3D face shapes and learning discriminative shape features for…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Feng Liu , Ronghang Zhu , Dan Zeng , Qijun Zhao , Xiaoming Liu

The accurate segmentation of lesions in whole-body PET/CT imaging is es-sential for tumor characterization, treatment planning, and response assess-ment, yet current manual workflows are labor-intensive and prone to inter-observer…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Moona Mazher , Steven A Niederer , Abdul Qayyum

Spatially localized deformation components are very useful for shape analysis and synthesis in 3D geometry processing. Several methods have recently been developed, with an aim to extract intuitive and interpretable deformation components.…

Graphics · Computer Science 2017-12-19 Qingyang Tan , Lin Gao , Yu-Kun Lai , Jie Yang , Shihong Xia

Large-scale pre-training holds the promise to advance 3D medical object detection, a crucial component of accurate computer-aided diagnosis. Yet, it remains underexplored compared to segmentation, where pre-training has already demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Katharina Eckstein , Constantin Ulrich , Michael Baumgartner , Jessica Kächele , Dimitrios Bounias , Tassilo Wald , Ralf Floca , Klaus H. Maier-Hein