English
Related papers

Related papers: SubOmiEmbed: Self-supervised Representation Learni…

200 papers

Self-supervised models allow (pre-)training on unlabeled data and therefore have the potential to overcome the need for large annotated cohorts. One leading self-supervised model is the masked autoencoder (MAE) which was developed on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-13 Daniel M. Lang , Eli Schwartz , Cosmin I. Bercea , Raja Giryes , Julia A. Schnabel

The discovery of disease subtypes is an essential step for developing precision medicine, and disease subtyping via omics data has become a popular approach. While promising, subtypes obtained from conventional approaches may not be…

Applications · Statistics 2023-09-28 Lingsong Meng , Zhiguang Huo

Sparse Autoencoders (SAEs) have emerged as a popular tool for interpreting the hidden states of large language models (LLMs). By learning to reconstruct activations from a sparse bottleneck layer, SAEs discover interpretable features from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Matthew Lyle Olson , Musashi Hinck , Neale Ratzlaff , Changbai Li , Phillip Howard , Vasudev Lal , Shao-Yen Tseng

In contrast to fully-supervised models, self-supervised representation learning only needs a fraction of data to be labeled and often achieves the same or even higher downstream performance. The goal is to pre-train deep neural networks on…

Machine Learning · Computer Science 2025-04-09 Friederike Baier , Sebastian Mair , Samuel G. Fadel

Variational autoencoders (VAEs) learn representations of data by jointly training a probabilistic encoder and decoder network. Typically these models encode all features of the data into a single variable. Here we are interested in learning…

Classification of gigapixel Whole Slide Images (WSIs) is an important prediction task in the emerging area of computational pathology. There has been a surge of research in deep learning models for WSI classification with clinical…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Sajid Javed , Arif Mahmood , Talha Qaiser , Naoufel Werghi , Nasir Rajpoot

Deep learning methods have played a more and more important role in hyperspectral image classification. However, the general deep learning methods mainly take advantage of the information of sample itself or the pairwise information between…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zhiqiang Gong , Weidong Hu , Xiaoyong Du , Ping Zhong , Panhe Hu

Masked Image Modeling (MIM) has garnered significant attention in self-supervised learning, thanks to its impressive capacity to learn scalable visual representations tailored for downstream tasks. However, images inherently contain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Wenzhao Xiang , Chang Liu , Hongyang Yu , Xilin Chen

Classifying breast cancer molecular subtypes is crucial for tailoring treatment strategies. While immunohistochemistry (IHC) and gene expression profiling are standard methods for molecular subtyping, IHC can be subjective, and gene…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Masoud Tafavvoghi , Anders Sildnes , Mehrdad Rakaee , Nikita Shvetsov , Lars Ailo Bongo , Lill-Tove Rasmussen Busund , Kajsa Møllersen

Purpose: To determine whether deep learning models can distinguish between breast cancer molecular subtypes based on dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI). Materials and methods: In this institutional review…

Computer Vision and Pattern Recognition · Computer Science 2017-12-01 Zhe Zhu , Ehab Albadawy , Ashirbani Saha , Jun Zhang , Michael R. Harowicz , Maciej A. Mazurowski

The emergence of novel pathogens and zoonotic diseases like the SARS-CoV-2 have underlined the need for developing novel diagnosis and intervention pipelines that can learn rapidly from small amounts of labeled data. Combined with…

Large and well-annotated datasets are essential for advancing deep learning applications, however often costly or impossible to obtain by a single entity. In many areas, including the medical domain, approaches relying on data sharing have…

Machine Learning · Computer Science 2024-08-02 Francesco Di Salvo , David Tafler , Sebastian Doerrich , Christian Ledig

Deep learning models have had a great success in disease classifications using large data pools of skin cancer images or lung X-rays. However, data scarcity has been the roadblock of applying deep learning models directly on prostate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Weiwei Zong , Joon Lee , Chang Liu , Eric Carver , Aharon Feldman , Branislava Janic , Mohamed Elshaikh , Milan Pantelic , David Hearshen , Indrin Chetty , Benjamin Movsas , Ning Wen

This study explores a data-driven approach to discovering novel clinical and genetic markers in ovarian cancer (OC). Two main analyses were performed: (1) a nonlinear examination of an OC dataset using autoencoders, which compress data into…

To achieve high-levels of autonomy, modern robots require the ability to detect and recover from anomalies and failures with minimal human supervision. Multi-modal sensor signals could provide more information for such anomaly detection…

Robotics · Computer Science 2020-12-17 Tianchen Ji , Sri Theja Vuppala , Girish Chowdhary , Katherine Driggs-Campbell

The shape of objects is an important source of visual information in a wide range of applications. One of the core challenges of shape quantification is to ensure that the extracted measurements remain invariant to transformations that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Anna Foix Romero , Craig Russell , Alexander Krull , Virginie Uhlmann

Learning similarity is a key aspect in medical image analysis, particularly in recommendation systems or in uncovering the interpretation of anatomical data in images. Most existing methods learn such similarities in the embedding space…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Sukesh Adiga , Jose Dolz , Herve Lombaert

Human cancers present a significant public health challenge and require the discovery of novel drugs through translational research. Transcriptomics profiling data that describes molecular activities in tumors and cancer cell lines are…

Cancer, a leading cause of death globally, occurs due to genomic changes and manifests heterogeneously across patients. To advance research on personalized treatment strategies, the effectiveness of various drugs on cells derived from…

Machine Learning · Computer Science 2024-05-08 Kumar Shubham , Aishwarya Jayagopal , Syed Mohammed Danish , Prathosh AP , Vaibhav Rajan

Sensory input from multiple sources is crucial for robust and coherent human perception. Different sources contribute complementary explanatory factors. Similarly, research studies often collect multimodal imaging data, each of which can…