English
Related papers

Related papers: Scaling Self-Supervised and Cross-Modal Pretrainin…

200 papers

In computer vision, Single Image Super-Resolution (SISR) is still a difficult problem. We present ViT-SR, a new technique to improve the performance of a Vision Transformer (ViT) employing a two-stage training strategy. In our method, the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Aditya Chaudhary , Prachet Dev Singh , Ankit Jha

In the realm of medical 3D data, such as CT and MRI images, prevalent anisotropic resolution is characterized by high intra-slice but diminished inter-slice resolution. The lowered resolution between adjacent slices poses challenges,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-09 Wei Fang , Yuxing Tang , Heng Guo , Mingze Yuan , Tony C. W. Mok , Ke Yan , Jiawen Yao , Xin Chen , Zaiyi Liu , Le Lu , Ling Zhang , Minfeng Xu

We propose a deep learning method for 3D volumetric reconstruction in low-dose helical cone-beam computed tomography. Prior machine learning approaches require reference reconstructions computed by another algorithm for training. In…

Image and Video Processing · Electrical Eng. & Systems 2023-05-29 Onni Kosomaa , Samuli Laine , Tero Karras , Miika Aittala , Jaakko Lehtinen

Generic re-usable pre-trained image representation encoders have become a standard component of methods for many computer vision tasks. As visual representations for robots however, their utility has been limited, leading to a recent wave…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Jianing Qian , Anastasios Panagopoulos , Dinesh Jayaraman

The quality and richness of feature maps extracted by convolution neural networks (CNNs) and vision Transformers (ViTs) directly relate to the robust model performance. In medical computer vision, these information-rich features are crucial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yassine Barhoumi , Nidhal C. Bouaynaya , Ghulam Rasool

State-of-the-art computer- and robot-assisted surgery systems heavily depend on intraoperative imaging technologies such as CT and fluoroscopy to generate detailed 3D visualization of the patient's anatomy. While imaging techniques are…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Aidana Massalimova , Florentin Liebmann , Sascha Jecklin , Fabio Carrillo , Farshad Mazda , Philipp Fürnstahl

Bone segmentation is an essential step for the preoperative planning of fracture trauma surgery. The automated segmentation of fractured bone from computed tomography (CT) scans remains challenging, due to the large differences of fractures…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Yu Zhou , Xiahao Zou , Yi Wang

Deep neural networks need a big amount of training data, while in the real world there is a scarcity of data available for training purposes. To resolve this issue unsupervised methods are used for training with limited data. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Sayed Hashim , Muhammad Ali

The emergence of Large Language Models (LLMs) presents unprecedented opportunities to revolutionize medical contrastive vision-language pre-training. In this paper, we show how LLMs can facilitate large-scale supervised pre-training,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yingtai Li , Haoran Lai , Xiaoqian Zhou , Shuai Ming , Wenxin Ma , Wei Wei , Shaohua Kevin Zhou

Vision transformers have gained significant attention and achieved state-of-the-art performance in various computer vision tasks, including image classification, instance segmentation, and object detection. However, challenges remain in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Badri N. Patro , Vijay Srinivas Agneeswaran

Self-supervised pre-training has become the priory choice to establish reliable neural networks for automated recognition of massive biomedical microscopy images, which are routinely annotation-free, without semantics, and without guarantee…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Wei Chen , Chen Li , Dan Chen , Xin Luo

Emerging unsupervised implicit neural representation (INR) methods, such as NeRP, NeAT, and SCOPE, have shown great potential to address sparse-view computed tomography (SVCT) inverse problems. Although these INR-based methods perform well…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Xuanyu Tian , Lixuan Chen , Qing Wu , Chenhe Du , Jingjing Shi , Hongjiang Wei , Yuyao Zhang

This paper presents a novel unsupervised segmentation method for 3D medical images. Convolutional neural networks (CNNs) have brought significant advances in image segmentation. However, most of the recent methods rely on supervised…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Takayasu Moriya , Holger R. Roth , Shota Nakamura , Hirohisa Oda , Kai Nagara , Masahiro Oda , Kensaku Mori

Deep learning has significantly advanced PET image re-construction, achieving remarkable improvements in image quality through direct training on sinogram or image data. Traditional methods often utilize masks for inpainting tasks, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Bin Huang , Binzhong He , Yanhan Chen , Zhili Liu , Xinyue Wang , Binxuan Li , Qiegen Liu

Pretrain techniques, whether supervised or self-supervised, are widely used in deep learning to enhance model performance. In real-world clinical scenarios, different sets of magnetic resonance (MR) contrasts are often acquired for…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Badhan Kumar Das , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

Transformer, benefiting from global (long-range) information modeling using self-attention mechanism, has been successful in natural language processing and computer vision recently. Convolutional Neural Networks, capable of capturing local…

Image and Video Processing · Electrical Eng. & Systems 2022-05-18 Jiangyun Li , Wenxuan Wang , Chen Chen , Tianxiang Zhang , Sen Zha , Jing Wang , Hong Yu

Vision Transformer (ViT) architectures represent images as collections of high-dimensional vectorized tokens, each corresponding to a rectangular non-overlapping patch. This representation trades spatial granularity for embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Dong Lao , Yangchao Wu , Tian Yu Liu , Alex Wong , Stefano Soatto

CRATE, a white-box transformer architecture designed to learn compressed and sparse representations, offers an intriguing alternative to standard vision transformers (ViTs) due to its inherent mathematical interpretability. Despite…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Jinrui Yang , Xianhang Li , Druv Pai , Yuyin Zhou , Yi Ma , Yaodong Yu , Cihang Xie

The automatic classification of 3D medical data is memory-intensive. Also, variations in the number of slices between samples is common. Na\"ive solutions such as subsampling can solve these problems, but at the cost of potentially…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Marzieh Oghbaie , Teresa Araujo , Taha Emre , Ursula Schmidt-Erfurth , Hrvoje Bogunovic

The advent of autonomous driving and advanced driver assistance systems necessitates continuous developments in computer vision for 3D scene understanding. Self-supervised monocular depth estimation, a method for pixel-wise distance…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Arnav Varma , Hemang Chawla , Bahram Zonooz , Elahe Arani