English
Related papers

Related papers: Beyond Labels: A Self-Supervised Framework with Ma…

200 papers

Despite the increasing use of deep learning in medical image segmentation, acquiring sufficient training data remains a challenge in the medical field. In response, data augmentation techniques have been proposed; however, the generation of…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Aghiles Kebaili , Jérôme Lapuyade-Lahorgue , Pierre Vera , Su Ruan

The last years have witnessed the emergence of a promising self-supervised learning strategy, referred to as masked autoencoding. However, there is a lack of theoretical understanding of how masking matters on graph autoencoders (GAEs). In…

Machine Learning · Computer Science 2023-05-30 Jintang Li , Ruofan Wu , Wangbin Sun , Liang Chen , Sheng Tian , Liang Zhu , Changhua Meng , Zibin Zheng , Weiqiang Wang

We present a novel masked image modeling (MIM) approach, context autoencoder (CAE), for self-supervised representation pretraining. We pretrain an encoder by making predictions in the encoded representation space. The pretraining tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Xiaokang Chen , Mingyu Ding , Xiaodi Wang , Ying Xin , Shentong Mo , Yunhao Wang , Shumin Han , Ping Luo , Gang Zeng , Jingdong Wang

Self-supervised learning has become a popular way to pretrain a deep learning model and then transfer it to perform downstream tasks. However, most of these methods are developed on large-scale image datasets that contain natural objects…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Kevin Van Vorst , Li Shen

Histopathological images (HI) encrypt resolution dependent heterogeneous textures & diverse color distribution variability, manifesting in micro-structural surface tissue convolutions. Also, inherently high coherency of cancerous cells…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Sawon Pratiher , Subhankar Chattoraj

There has been a growing interest in using deep learning models for processing long surgical videos, in order to automatically detect clinical/operational activities and extract metrics that can enable workflow efficiency tools and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Muhammad Abdullah Jamal , Omid Mohareri

Most of the data-driven approaches applied to bearing fault diagnosis up to date are established in the supervised learning paradigm, which usually requires a large set of labeled data collected a priori. In practical applications, however,…

Machine Learning · Computer Science 2019-12-10 Shen Zhang , Fei Ye , Bingnan Wang , Thomas G. Habetler

Cellular electron cryo-tomography enables the 3D visualization of cellular organization in the near-native state and at submolecular resolution. However, the contents of cellular tomograms are often complex, making it difficult to…

Quantitative Methods · Quantitative Biology 2017-12-29 Xiangrui Zeng , Miguel Ricardo Leung , Tzviya Zeev-Ben-Mordehai , Min Xu

This study explores the application of supervised and unsupervised autoencoders (AEs) to automate nuclei classification in clear cell renal cell carcinoma (ccRCC) images, a diagnostic task traditionally reliant on subjective visual grading…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Fatemeh Javadian , Zahra Aminparast , Johannes Stegmaier , Abin Jose

Masked AutoEncoders (MAE) have emerged as a robust self-supervised framework, offering remarkable performance across a wide range of downstream tasks. To increase the difficulty of the pretext task and learn richer visual representations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Carlos Hinojosa , Shuming Liu , Bernard Ghanem

Current video-based Masked Autoencoders (MAEs) primarily focus on learning effective spatiotemporal representations from a visual perspective, which may lead the model to prioritize general spatial-temporal patterns but often overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Shihab Aaqil Ahamed , Malitha Gunawardhana , Liel David , Michael Sidorov , Daniel Harari , Muhammad Haris Khan

To overcome the inherent domain gap between remote sensing (RS) images and natural images, some self-supervised representation learning methods have made promising progress. However, they have overlooked the diverse angles present in RS…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zhihao Li , Biao Hou , Siteng Ma , Zitong Wu , Xianpeng Guo , Bo Ren , Licheng Jiao

In biomedical imaging, deep learning-based methods are state-of-the-art for every modality (virtual slides, MRI, etc.) In histopathology, these methods can be used to detect certain biomarkers or classify lesions. However, such techniques…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Adrien Nivaggioli , Nicolas Pozin , Rémy Peyret , Stéphane Sockeel , Marie Sockeel , Nicolas Nerrienet , Marceau Clavel , Clara Simmat , Catherine Miquel

Grapevine varieties are essential for the economies of many wine-producing countries, influencing the production of wine, juice, and the consumption of fruits and leaves. Traditional identification methods, such as ampelography and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Gabriel A. Carneiro , Thierry J. Aubry , António Cunha , Petia Radeva , Joaquim Sousa

Gene expression profiles have been widely used to characterize patterns of cellular responses to diseases. As data becomes available, scalable learning toolkits become essential to processing large datasets using deep learning models to…

Machine Learning · Computer Science 2019-02-01 Ya Ju Fan , Jonathan E. Allen , Sam Ade Jacobs , Brian C. Van Essen

The implementation of deep learning based computer aided diagnosis systems for the classification of mammogram images can help in improving the accuracy, reliability, and cost of diagnosing patients. However, training a deep learning model…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Saul Calderon-Ramirez , Diego Murillo-Hernandez , Kevin Rojas-Salazar , David Elizondo , Shengxiang Yang , Miguel Molina-Cabello

The detection and localization of possible diseases in crops are usually automated by resorting to supervised deep learning approaches. In this work, we tackle these goals with unsupervised models, by applying three different types of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Davide Calabrò , Massimiliano Lupo Pasini , Nicola Ferro , Simona Perotto

Large amounts of unlabelled data are commonplace for many applications in computational pathology, whereas labelled data is often expensive, both in time and cost, to acquire. We investigate the performance of unsupervised and supervised…

Computer Vision and Pattern Recognition · Computer Science 2019-07-27 Koen Dercksen , Wouter Bulten , Geert Litjens

We propose an unsupervised method using self-clustering convolutional adversarial autoencoders to classify prostate tissue as tumor or non-tumor without any labeled training data. The clustering method is integrated into the training of the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Wouter Bulten , Geert Litjens

Through training on unlabeled data, anomaly detection has the potential to impact computer-aided diagnosis by outlining suspicious regions. Previous work on deep-learning-based anomaly detection has primarily focused on the reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2019-12-03 David Zimmerer , Jens Petersen , Simon A. A. Kohl , Klaus H. Maier-Hein