English
Related papers

Related papers: 3D MRI Image Pretraining via Controllable 2D Slice…

200 papers

While enabling accelerated acquisition and improved reconstruction accuracy, current deep MRI reconstruction networks are typically supervised, require fully sampled data, and are limited to Cartesian sampling patterns. These factors limit…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Bo Zhou , Jo Schlemper , Neel Dey , Seyed Sadegh Mohseni Salehi , Kevin Sheth , Chi Liu , James S. Duncan , Michal Sofka

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer

In order to provide the right type of assistance at the right time, computer-assisted surgery systems need context awareness. To achieve this, methods for surgical workflow analysis are crucial. Currently, convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Isabel Funke , Alexander Jenke , Sören Torge Mees , Jürgen Weitz , Stefanie Speidel , Sebastian Bodenstedt

Self-supervised learning (SSL) has emerged as a promising paradigm for addressing the annotation bottleneck in medical imaging by learning representations from unlabeled data. However, its effectiveness depends heavily on the design of the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chathura Wimalasiri

We propose a novel unsupervised deep-learning-based algorithm for dynamic magnetic resonance imaging (MRI) reconstruction. Dynamic MRI requires rapid data acquisition for the study of moving organs such as the heart. Existing reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Jaejun Yoo , Kyong Hwan Jin , Harshit Gupta , Jerome Yerly , Matthias Stuber , Michael Unser

In this work we introduce a self-supervised pretraining framework for transformers on functional Magnetic Resonance Imaging (fMRI) data. First, we pretrain our architecture on two self-supervised tasks simultaneously to teach the model a…

Machine Learning · Computer Science 2023-05-17 Sean Paulsen , Michael Casey

Autonomous laparoscopic camera control must maintain a stable and safe surgical view under rapid tool-tissue interactions while remaining interpretable to surgeons. We present a strategy-grounded framework that couples high-level…

Robotics · Computer Science 2026-02-25 Keyu Zhou , Peisen Xu , Yahao Wu , Jiming Chen , Gaofeng Li , Shunlei Li

Large-scale volumetric medical images with annotation are rare, costly, and time prohibitive to acquire. Self-supervised learning (SSL) offers a promising pre-training and feature extraction solution for many downstream tasks, as it only…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Ke Yu , Li Sun , Junxiang Chen , Max Reynolds , Tigmanshu Chaudhary , Kayhan Batmanghelich

To make sense of their surroundings, intelligent systems must transform complex sensory inputs to structured codes that are reduced to task-relevant information such as object category. Biological agents achieve this in a largely autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Robin Weiler , Matthias Brucklacher , Cyriel M. A. Pennartz , Sander M. Bohté

Masked reconstruction serves as a fundamental pretext task for self-supervised learning, enabling the model to enhance its feature extraction capabilities by reconstructing the masked segments from extensive unlabeled data. In human…

Human-Computer Interaction · Computer Science 2023-12-08 Jinqiang Wang , Tao Zhu , Huansheng Ning

Image reconstruction from undersampled k-space data plays an important role in accelerating the acquisition of MR data, and a lot of deep learning-based methods have been exploited recently. Despite the achieved inspiring results, the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Chen Hu , Cheng Li , Haifeng Wang , Qiegen Liu , Hairong Zheng , Shanshan Wang

Magnetic resonance imaging (MRI) is a highly versatile and widely used clinical imaging tool. The content of MRI images is controlled by an acquisition sequence, which coordinates the timing and magnitude of the scanner hardware…

Machine Learning · Computer Science 2023-05-24 Simon Walker-Samuel

Functional Magnetic Resonance Imaging (fMRI) is vital in neuroscience, enabling investigations into brain disorders, treatment monitoring, and brain function mapping. However, head motion during fMRI scans, occurring between shots of slice…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Samah Khawaled , Simon K. Warfield , Moti Freiman

Recent advances in 3D representations, such as Neural Radiance Fields and 3D Gaussian Splatting, have greatly improved realistic scene modeling and novel-view synthesis. However, achieving controllable and consistent editing in dynamic 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Kai He , Chin-Hsuan Wu , Igor Gilitschenski

Recovering high-quality images from undersampled measurements is critical for accelerated MRI reconstruction. Recently, various supervised deep learning-based MRI reconstruction methods have been developed. Despite the achieved promising…

Image and Video Processing · Electrical Eng. & Systems 2022-03-21 Weijian Huang , Cheng Li , Wenxin Fan , Yongjin Zhou , Qiegen Liu , Hairong Zheng , Shanshan Wang

Leveraging pre-trained 2D image representations in behavior cloning policies has achieved great success and has become a standard approach for robotic manipulation. However, such representations fail to capture the 3D spatial information…

Robotics · Computer Science 2026-05-07 I-Chun Arthur Liu , Krzysztof Choromanski , Sandy Huang , Connor Schenck

This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shiyang Lu , Yunfu Deng , Abdeslam Boularias , Kostas Bekris

When using Convolutional Neural Networks (CNNs) for segmentation of organs and lesions in medical images, the conventional approach is to work with inputs and outputs either as single slice (2D) or whole volumes (3D). One common…

Image and Video Processing · Electrical Eng. & Systems 2020-11-17 Minh H. Vu , Guus Grimbergen , Tufve Nyholm , Tommy Löfstedt

In Minimally Invasive Surgery (MIS), tissue scanning with imaging probes is required for subsurface visualisation to characterise the state of the tissue. However, scanning of large tissue surfaces in the presence of deformation is a…

Robotics · Computer Science 2021-01-12 Jian Zhan , Joao Cartucho , Stamatia Giannarou

Deep learning (DL) methods have shown remarkable successes in medical image segmentation, often using large amounts of annotated data for model training. However, acquiring a large number of diverse labeled 3D medical image datasets is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Delin An , Pengfei Gu , Milan Sonka , Chaoli Wang , Danny Z. Chen