English
Related papers

Related papers: The Missing Piece: A Case for Pre-Training in 3D M…

200 papers

Recently, self-supervised learning (SSL) methods have been used in pre-training the segmentation models for 2D and 3D medical images. Most of these methods are based on reconstruction, contrastive learning and consistency regularization.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Haofeng Li , Yiming Ouyang , Xiang Wan

In this work we present point-level region contrast, a self-supervised pre-training approach for the task of object detection. This approach is motivated by the two key factors in detection: localization and recognition. While accurate…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Yutong Bai , Xinlei Chen , Alexander Kirillov , Alan Yuille , Alexander C. Berg

Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , David Cornell , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

Almost all the state-of-the-art neural networks for computer vision tasks are trained by (1) pre-training on a large-scale dataset and (2) finetuning on the target dataset. This strategy helps reduce dependence on the target dataset and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Shuvam Chakraborty , Burak Uzkent , Kumar Ayush , Kumar Tanmay , Evan Sheehan , Stefano Ermon

This research presents a machine-learning approach for tumor detection in medical images using convolutional neural networks (CNNs). The study focuses on preprocessing techniques to enhance image features relevant to tumor detection,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Ha Anh Vu

Lesion detection from computed tomography (CT) scans is challenging compared to natural object detection because of two major reasons: small lesion size and small inter-class variation. Firstly, the lesions usually only occupy a small…

Computer Vision and Pattern Recognition · Computer Science 2019-07-10 Qingyi Tao , Zongyuan Ge , Jianfei Cai , Jianxiong Yin , Simon See

This paper shows the effectiveness of 2D backbone scaling and pretraining for pillar-based 3D object detectors. Pillar-based methods mainly employ randomly initialized 2D convolution neural network (ConvNet) for feature extraction and fail…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Weixin Mao , Tiancai Wang , Diankun Zhang , Junjie Yan , Osamu Yoshie

Convolutional neural networks demonstrated outstanding empirical results in computer vision and speech recognition tasks where labeled training data is abundant. In medical imaging, there is a huge variety of possible imaging modalities and…

Computer Vision and Pattern Recognition · Computer Science 2015-12-21 Vlado Menkovski , Zharko Aleksovski , Axel Saalbach , Hannes Nickisch

Pretraining with large-scale 3D volumes has a potential for improving the segmentation performance on a target medical image dataset where the training images and annotations are limited. Due to the high cost of acquiring pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Guotai Wang , Jianghao Wu , Xiangde Luo , Xinglong Liu , Kang Li , Shaoting Zhang

Large-scale supervised pretraining is rapidly reshaping 3D medical image segmentation. However, existing efforts focus primarily on increasing dataset size and overlook the question of whether the backbone network is an effective…

Image and Video Processing · Electrical Eng. & Systems 2025-12-22 Saikat Roy , Yannick Kirchhoff , Constantin Ulrich , Maximillian Rokuss , Tassilo Wald , Fabian Isensee , Klaus Maier-Hein

Many learning-based approaches have difficulty scaling to unseen data, as the generality of its learned prior is limited to the scale and variations of the training samples. This holds particularly true with 3D learning tasks, given the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Mingyue Yang , Yuxin Wen , Weikai Chen , Yongwei Chen , Kui Jia

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

3D point cloud understanding has made great progress in recent years. However, one major bottleneck is the scarcity of annotated real datasets, especially compared to 2D object detection tasks, since a large amount of labor is involved in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Yongming Rao , Benlin Liu , Yi Wei , Jiwen Lu , Cho-Jui Hsieh , Jie Zhou

The quality of life of many people could be improved by autonomous humanoid robots in the home. To function in the human world, a humanoid household robot must be able to locate itself and perceive the environment like a human; scene…

Computer Vision and Pattern Recognition · Computer Science 2013-01-24 Cheng Zhang , Hedvig Kjellstrom

The technical advances in Computed Tomography (CT) allow to obtain immense amounts of 3D data. For such datasets it is very costly and time-consuming to obtain the accurate 3D segmentation markup to train neural networks. The annotation is…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 Yaroslav Zharov , Alexey Ershov , Tilo Baumbach , Vincent Heuveline

While transformers have surpassed convolutional neural networks (CNNs) in various computer vision tasks, microelectronics defect detection still largely relies on CNNs. We hypothesize that this gap is due to the fact that a) transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Nikolai Röhrich , Alwin Hoffmann , Richard Nordsieck , Emilio Zarbali , Alireza Javanmardi

Understanding 3D medical image volumes is critical in the medical field, yet existing 3D medical convolution and transformer-based self-supervised learning (SSL) methods often lack deep semantic comprehension. Recent advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Qiuhui Chen , Xuancheng Yao , Huping Ye , Yi Hong

In medical imaging analysis, deep learning has shown promising results. We frequently rely on volumetric data to segment medical images, necessitating the use of 3D architectures, which are commended for their capacity to capture interslice…

Image and Video Processing · Electrical Eng. & Systems 2023-05-18 Ikboljon Sobirov , Numan Saeed , Mohammad Yaqub

3D ultrasound (US) is widely used for its rich diagnostic information. However, it is criticized for its limited field of view. 3D freehand US reconstruction is promising in addressing the problem by providing broad range and freeform scan.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Mingyuan Luo , Xin Yang , Xiaoqiong Huang , Yuhao Huang , Yuxin Zou , Xindi Hu , Nishant Ravikumar , Alejandro F Frangi , Dong Ni