English
Related papers

Related papers: 3D MRI Image Pretraining via Controllable 2D Slice…

200 papers

Unsupervised representation learning aims at finding methods that learn representations from data without annotation-based signals. Abstaining from annotations not only leads to economic benefits but may - and to some extent already does -…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Bonifaz Stuhr

We propose a self-supervised learning framework that uses unlabeled monocular video sequences to generate large-scale supervision for training a Visual Odometry (VO) frontend, a network which computes pointwise data associations across…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Daniel DeTone , Tomasz Malisiewicz , Andrew Rabinovich

In this work, we explore self-supervised visual pre-training on images from diverse, in-the-wild videos for real-world robotic tasks. Like prior work, our visual representations are pre-trained via a masked autoencoder (MAE), frozen, and…

Robotics · Computer Science 2022-10-07 Ilija Radosavovic , Tete Xiao , Stephen James , Pieter Abbeel , Jitendra Malik , Trevor Darrell

Self-supervised learning (SSL) has been successful in building patch embeddings of small histology images (e.g., 224x224 pixels), but scaling these models to learn slide embeddings from the entirety of giga-pixel whole-slide images (WSIs)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Guillaume Jaume , Lukas Oldenburg , Anurag Vaidya , Richard J. Chen , Drew F. K. Williamson , Thomas Peeters , Andrew H. Song , Faisal Mahmood

MRI and CT are essential clinical cross-sectional imaging techniques for diagnosing complex conditions. However, large 3D datasets with annotations for deep learning are scarce. While methods like DINOv2 are encouraging for 2D image…

Image and Video Processing · Electrical Eng. & Systems 2025-07-10 Gustav Müller-Franzes , Firas Khader , Robert Siepmann , Tianyu Han , Jakob Nikolas Kather , Sven Nebelung , Daniel Truhn

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Vladan Stojnić , Vladimir Risojević

Unlike quasi-static robotic manipulation tasks like pick-and-place, dynamic tasks such as non-prehensile manipulation pose greater challenges, especially for vision-based control. Successful control requires the extraction of features…

Visual SLAM - Simultaneous Localization and Mapping - in dynamic environments typically relies on identifying and masking image features on moving objects to prevent them from negatively affecting performance. Current approaches are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Adrian Bojko , Romain Dupont , Mohamed Tamaazousti , Hervé Le Borgne

The ability to quickly annotate medical imaging data plays a critical role in training deep learning frameworks for segmentation. Doing so for image volumes or video sequences is even more pressing as annotating these is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Laurent Lejeune , Raphael Sznitman

Masked image modeling (MIM) has emerged as a promising approach for pre-training Vision Transformers (ViTs). MIMs predict masked tokens token-wise to recover target signals that are tokenized from images or generated by pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Taekyung Kim , Byeongho Heo , Dongyoon Han

High-quality 3D fetal brain MRI reconstruction from motion-corrupted 2D slices is crucial for clinical diagnosis. Reliable slice-to-volume registration (SVR)-based motion correction and super-resolution reconstruction (SRR) methods are…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Jiangjie Wu , Lixuan Chen , Zhenghao Li , Xin Li , Saban Ozturk , Lihui Wang , Rongpin Wang , Hongjiang Wei , Yuyao Zhang

Recent trends in semi-supervised learning have significantly boosted the performance of 3D semi-supervised medical image segmentation. Compared with 2D images, 3D medical volumes involve information from different directions, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Heng Cai , Shumeng Li , Lei Qi , Qian Yu , Yinghuan Shi , Yang Gao

Training a neural network with a large labeled dataset is still a dominant paradigm in computational histopathology. However, obtaining such exhaustive manual annotations is often expensive, laborious, and prone to inter and Intra-observer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Chetan L. Srinidhi , Seung Wook Kim , Fu-Der Chen , Anne L. Martel

Deep learning techniques have gained considerable attention for their ability to accelerate MRI data acquisition while maintaining scan quality. In this work, we present a convolutional neural network (CNN) based framework for learning…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Aryan Dhar , Siddhant Gautam , Saiprasad Ravishankar

We present streaming self-training (SST) that aims to democratize the process of learning visual recognition models such that a non-expert user can define a new task depending on their needs via a few labeled examples and minimal domain…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Zhiqiu Lin , Deva Ramanan , Aayush Bansal

Self-supervised pre-training has driven rapid progress in foundation models for language, 2D images, and video, yet remains largely unexplored for learning 3D-aware representations from multi-view images. In this paper, we present E-RayZer,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Qitao Zhao , Hao Tan , Qianqian Wang , Sai Bi , Kai Zhang , Kalyan Sunkavalli , Shubham Tulsiani , Hanwen Jiang

Long scan duration remains a challenge for high-resolution MRI. Deep learning has emerged as a powerful means for accelerated MRI reconstruction by providing data-driven regularizers that are directly learned from data. These data-driven…

Image and Video Processing · Electrical Eng. & Systems 2020-09-09 Seyed Amir Hossein Hosseini , Burhaneddin Yaman , Steen Moeller , Mehmet Akçakaya

Self-supervised pretraining has been observed to improve performance in supervised learning tasks in medical imaging. This study investigates the utility of self-supervised pretraining prior to conducting supervised fine-tuning for the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Blake VanBerlo , Brian Li , Alexander Wong , Jesse Hoey , Robert Arntfield

Self-supervised tasks such as colorization, inpainting and zigsaw puzzle have been utilized for visual representation learning for still images, when the number of labeled images is limited or absent at all. Recently, this worthwhile stream…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Dahun Kim , Donghyeon Cho , In So Kweon

We propose to simultaneously learn to sample and reconstruct magnetic resonance images (MRI) to maximize the reconstruction quality given a limited sample budget, in a self-supervised setup. Unlike existing deep methods that focus only on…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Kyong Hwan Jin , Michael Unser , Kwang Moo Yi