English
Related papers

Related papers: Multi-modal Masked Siamese Network Improves Chest …

200 papers

Magnetic resonance imaging (MRI) is indispensable for diagnosing and planning treatment in various medical conditions due to its ability to produce multi-series images that reveal different tissue characteristics. However, integrating these…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Churan Wang , Fei Gao , Lijun Yan , Siwen Wang , Yizhou Yu , Yizhou Wang

Radiomic representations can quantify properties of regions of interest in medical image data. Classically, they account for pre-defined statistics of shape, texture, and other low-level image features. Alternatively, deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Hongwei Li , Fei-Fei Xue , Krishna Chaitanya , Shengda Luo , Ivan Ezhov , Benedikt Wiestler , Jianguo Zhang , Bjoern Menze

Pre-training datasets, like ImageNet, have become the gold standard in medical image analysis. However, the emergence of self-supervised learning (SSL), which leverages unlabeled data to learn robust features, presents an opportunity to…

Image and Video Processing · Electrical Eng. & Systems 2024-02-09 Soroosh Tayebi Arasteh , Leo Misera , Jakob Nikolas Kather , Daniel Truhn , Sven Nebelung

Modern studies in radiograph representation learning rely on either self-supervision to encode invariant semantics or associated radiology reports to incorporate medical expertise, while the complementarity between them is barely noticed.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Hong-Yu Zhou , Chenyu Lian , Liansheng Wang , Yizhou Yu

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

Instance segmentation in electron microscopy (EM) volumes is tough due to complex shapes and sparse annotations. Self-supervised learning helps but still struggles with intricate visual patterns in EM. To address this, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yinda Chen , Wei Huang , Xiaoyu Liu , Shiyu Deng , Qi Chen , Zhiwei Xiong

Learning from electronic health records (EHRs) time series is challenging due to irregular sam- pling, heterogeneous missingness, and the resulting sparsity of observations. Prior self-supervised meth- ods either impute before learning,…

Machine Learning · Computer Science 2026-02-18 Xiao Xiang , David Restrepo , Hyewon Jeong , Yugang Jia , Leo Anthony Celi

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Self-supervised pretraining followed by supervised fine-tuning has seen success in image recognition, especially when labeled examples are scarce, but has received limited attention in medical image analysis. This paper studies the…

Learning Electronic Health Records (EHRs) representation is a preeminent yet under-discovered research topic. It benefits various clinical decision support applications, e.g., medication outcome prediction or patient similarity search.…

Machine Learning · Computer Science 2024-02-22 Hao-Ren Yao , Nairen Cao , Katina Russell , Der-Chen Chang , Ophir Frieder , Jeremy Fineman

Generating medical reports from chest X-ray images is a critical and time-consuming task for radiologists, especially in emergencies. To alleviate the stress on radiologists and reduce the risk of misdiagnosis, numerous research efforts…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Qiang Sun , Zongcheng Ji , Yinlong Xiao , Peng Chang , Jun Yu

The scarcity of labeled data often limits the application of supervised deep learning techniques for medical image segmentation. This has motivated the development of semi-supervised techniques that learn from a mixture of labeled and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Gerda Bortsova , Florian Dubost , Laurens Hogeweg , Ioannis Katramados , Marleen de Bruijne

Recently, a few self-supervised representation learning (SSL) methods have outperformed the ImageNet classification pre-training for vision tasks such as object detection. However, its effects on 3D human body pose and shape estimation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Hongsuk Choi , Hyeongjin Nam , Taeryung Lee , Gyeongsik Moon , Kyoung Mu Lee

Self-supervised learning has greatly facilitated medical image analysis by suppressing the training data requirement for real-world applications. Current paradigms predominantly rely on self-supervision within uni-modal image data, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Shaohao Rui , Lingzhi Chen , Zhenyu Tang , Lilong Wang , Mianxin Liu , Shaoting Zhang , Xiaosong Wang

Computational models that predict cellular phenotypic responses to chemical and genetic perturbations can accelerate drug discovery by prioritizing therapeutic hypotheses and reducing costly wet-lab iteration. However, extracting…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Pin-Jui Huang , Yu-Hsuan Liao , SooHeon Kim , NoSeong Park , JongBae Park , DongMyung Shin

In healthcare and biomedical applications, extreme computational requirements pose a significant barrier to adopting representation learning. Representation learning can enhance the performance of deep learning architectures by learning…

Machine Learning · Computer Science 2023-08-22 Pranav Singh , Jacopo Cirrone

The automatic diagnosis of chest diseases is a popular and challenging task. Most current methods are based on convolutional neural networks (CNNs), which focus on local features while neglecting global features. Recently, self-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Xinran Li , Yu Liu , Xiujuan Xu , Xiaowei Zhao

Deep learning is the state-of-the-art for medical imaging tasks, but requires large, labeled datasets. For risk prediction, large datasets are rare since they require both imaging and follow-up (e.g., diagnosis codes). However, the release…

Image and Video Processing · Electrical Eng. & Systems 2023-06-16 Yanru Chen , Michael T Lu , Vineet K Raghu

The recent progress in self-supervised learning has successfully combined Masked Image Modeling (MIM) with Siamese Networks, harnessing the strengths of both methodologies. Nonetheless, certain challenges persist when integrating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Kirill Vishniakov , Eric Xing , Zhiqiang Shen

Chest radiography is a relatively cheap, widely available medical procedure that conveys key information for making diagnostic decisions. Chest X-rays are almost always used in the diagnosis of respiratory diseases such as pneumonia or the…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Matej Gazda , Jakub Gazda , Jan Plavka , Peter Drotar