English
Related papers

Related papers: Multimodal Self-Supervised Learning for Medical Im…

200 papers

Interpretation of medical images for diagnosis and treatment of complex disease from high-dimensional and heterogeneous data remains a key challenge in transforming healthcare. In the last few years, both supervised and unsupervised deep…

Image and Video Processing · Electrical Eng. & Systems 2018-12-20 Khalid Raza , Nripendra Kumar Singh

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 András Kalapos , Bálint Gyires-Tóth

While self-supervised learning (SSL) algorithms have been widely used to pre-train deep models, few efforts [11] have been done to improve representation learning of X-ray image analysis with SSL pre-trained models. In this work, we study a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weibin Liao , Haoyi Xiong , Qingzhong Wang , Yan Mo , Xuhong Li , Yi Liu , Zeyu Chen , Siyu Huang , Dejing Dou

Introspection of deep supervised predictive models trained on functional and structural brain imaging may uncover novel markers of Alzheimer's disease (AD). However, supervised training is prone to learning from spurious features (shortcut…

Machine Learning · Computer Science 2022-05-24 Alex Fedorov , Lei Wu , Tristan Sylvain , Margaux Luck , Thomas P. DeRamus , Dmitry Bleklov , Sergey M. Plis , Vince D. Calhoun

Augmentation-based self-supervised learning methods have shown remarkable success in self-supervised visual representation learning, excelling in learning invariant features but often neglecting equivariant ones. This limitation reduces the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Qin Wang , Kai Krajsek , Hanno Scharr

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Florian Bernard

In this paper, we address self-supervised representation learning from human skeletons for action recognition. Previous methods, which usually learn feature presentations from a single reconstruction task, may come across the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Lilang Lin , Sijie Song , Wenhan Yan , Jiaying Liu

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

In this paper we present a self-supervised method for representation learning utilizing two different modalities. Based on the observation that cross-modal information has a high semantic meaning we propose a method to effectively exploit…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Nawid Sayed , Biagio Brattoli , Björn Ommer

The reconstruction of a high resolution image given a low resolution observation is an ill-posed inverse problem in imaging. Deep learning methods rely on training data to learn an end-to-end mapping from a low-resolution input to a…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

Multi-Modal Self-Supervised Learning from videos has been shown to improve model's performance on various downstream tasks. However, such Self-Supervised pre-training requires large batch sizes and a large amount of computation resources…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Duo Wang , Salah Karout

The automatic diagnosis of various retinal diseases from fundus images is important to support clinical decision-making. However, developing such automatic solutions is challenging due to the requirement of a large amount of human-annotated…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Xiaomeng Li , Mengyu Jia , Md Tauhidul Islam , Lequan Yu , Lei Xing

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

Self-supervised learning has emerged as a powerful tool for pretraining deep networks on unlabeled data, prior to transfer learning of target tasks with limited annotation. The relevance between the pretraining pretext and target tasks is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tianwei Zhang , Dong Wei , Mengmeng Zhu , Shi Gu , Yefeng Zheng

Joint embeddings between medical imaging modalities and associated radiology reports have the potential to offer significant benefits to the clinical community, ranging from cross-domain retrieval to conditional generation of reports to the…

Machine Learning · Computer Science 2018-11-28 Tzu-Ming Harry Hsu , Wei-Hung Weng , Willie Boag , Matthew McDermott , Peter Szolovits

As digital medical imaging becomes more prevalent and archives increase in size, representation learning exposes an interesting opportunity for enhanced medical decision support systems. On the other hand, medical imaging data is often…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Eduardo Pinho , Carlos Costa

We propose SelfDoc, a task-agnostic pre-training framework for document image understanding. Because documents are multimodal and are intended for sequential reading, our framework exploits the positional, textual, and visual information of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Peizhao Li , Jiuxiang Gu , Jason Kuen , Vlad I. Morariu , Handong Zhao , Rajiv Jain , Varun Manjunatha , Hongfu Liu

Transfer learning has become a standard practice to mitigate the lack of labeled data in medical classification tasks. Whereas finetuning a downstream task using supervised ImageNet pretrained features is straightforward and extensively…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Tuan Truong , Sadegh Mohammadi , Matthias Lenga

Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Burhaneddin Yaman , Hongyi Gu , Seyed Amir Hossein Hosseini , Omer Burak Demirel , Steen Moeller , Jutta Ellermann , Kâmil Uğurbil , Mehmet Akçakaya

Deep learning methods have been successfully applied to various computer vision tasks. However, existing neural network architectures do not per se incorporate domain knowledge about the addressed problem, thus, understanding what the model…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis