English
Related papers

Related papers: Global Contrast Masked Autoencoders Are Powerful P…

200 papers

Electrocardiogram (ECG) analysis is a fundamental tool for diagnosing cardiovascular conditions, yet anomaly detection in ECG signals remains challenging due to their inherent complexity and variability. We propose Multi-scale Masked…

Machine Learning · Computer Science 2025-02-11 Ya Zhou , Yujie Yang , Jianhuang Gan , Xiangjie Li , Jing Yuan , Wei Zhao

Raman spectroscopy serves as a powerful and reliable tool for analyzing the chemical information of substances. The integration of Raman spectroscopy with deep learning methods enables rapid qualitative and quantitative analysis of…

Signal Processing · Electrical Eng. & Systems 2025-04-24 Pengju Ren , Ri-gui Zhou , Yaochong Li

Supervised deep learning offers great promise to automate analysis of medical images from segmentation to diagnosis. However, their performance highly relies on the quality and quantity of the data annotation. Meanwhile, curating large…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Yuyue Zhou , Jessica Knight , Banafshe Felfeliyan , Christopher Keen , Abhilash Rakkunedeth Hareendranathan , Jacob L. Jaremko

Masked Autoencoder (MAE) has demonstrated superior performance on various vision tasks via randomly masking image patches and reconstruction. However, effective data augmentation strategies for MAE still remain open questions, different…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

Recently, self-supervised pre-training has advanced Vision Transformers on various tasks w.r.t. different data modalities, e.g., image and 3D point cloud data. In this paper, we explore this learning paradigm for 3D mesh data analysis based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yaqian Liang , Shanshan Zhao , Baosheng Yu , Jing Zhang , Fazhi He

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Artificial Intelligence (AI) has the potential to revolutionize diagnosis and segmentation in medical imaging. However, development and clinical implementation face multiple challenges including limited data availability, lack of…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Zelong Liu , Andrew Tieu , Nikhil Patel , Georgios Soultanidis , Louisa Deyer , Ying Wang , Sean Huver , Alexander Zhou , Yunhao Mei , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Wireless goal-oriented semantic communication (GSC) has emerged as a promising paradigm by directly optimizing task performance. However, existing GSC frameworks typically operate on entire images and rely on labeled data for classification…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Zhitong Ni , Yansha Deng , Jinhong Yuan

The characterization of Tumor MicroEnvironment (TME) is challenging due to its complexity and heterogeneity. Relatively consistent TME characteristics embedded within highly specific tissue features, render them difficult to predict. The…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Fangliangzi Meng , Hongrun Zhang , Ruodan Yan , Guohui Chuai , Chao Li , Qi Liu

This study presents Latent Diffusion Autoencoder (LDAE), a novel encoder-decoder diffusion-based framework for efficient and meaningful unsupervised learning in medical imaging, focusing on Alzheimer disease (AD) using brain MR from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Gabriele Lozupone , Alessandro Bria , Francesco Fontanella , Frederick J. A. Meijer , Claudio De Stefano , Henkjan Huisman

Recent research at CHU Sainte Justine's Pediatric Critical Care Unit (PICU) has revealed that traditional machine learning methods, such as semi-supervised label propagation and K-nearest neighbors, outperform Transformer-based models in…

Machine Learning · Computer Science 2025-05-27 Thanh-Dung Le , Clara Macabiau , Kévin Albert , Philippe Jouvet , Rita Noumeir

Unsupervised learning methods have become increasingly important in deep learning due to their demonstrated large utilization of datasets and higher accuracy in computer vision and natural language processing tasks. There is a growing trend…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Guoxin Wang , Qingyuan Wang , Ganesh Neelakanta Iyer , Avishek Nag , Deepu John

Establishing correspondence between images or scenes is a significant challenge in computer vision, especially given occlusions, viewpoint changes, and varying object appearances. In this paper, we present Siamese Masked Autoencoders…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Agrim Gupta , Jiajun Wu , Jia Deng , Li Fei-Fei

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially…

Image and Video Processing · Electrical Eng. & Systems 2020-01-03 David Zimmerer , Simon Kohl , Jens Petersen , Fabian Isensee , Klaus Maier-Hein

Masked Autoencoders (MAEs) learn generalizable representations for image, text, audio, video, etc., by reconstructing masked input data from tokens of the visible data. Current MAE approaches for videos rely on random patch, tube, or…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Wele Gedara Chaminda Bandara , Naman Patel , Ali Gholami , Mehdi Nikkhah , Motilal Agrawal , Vishal M. Patel

Next-generation communication networks are expected to exploit recent advances in data science and cutting-edge communications technologies to improve the utilization of the available communications resources. In this article, we introduce…

Signal Processing · Electrical Eng. & Systems 2024-01-15 Abdullah Zayat , Mahmoud A. Hasabelnaby , Mohanad Obeed , Anas Chaaban

Masked Autoencoders (MAE) have shown great potentials in self-supervised pre-training for language and 2D image transformers. However, it still remains an open question on how to exploit masked autoencoding for learning 3D representations…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Renrui Zhang , Ziyu Guo , Rongyao Fang , Bin Zhao , Dong Wang , Yu Qiao , Hongsheng Li , Peng Gao

Deep neural networks need huge amount of training data, while in real world there is a scarcity of data available for training purposes. To resolve these issues, self-supervised learning (SSL) methods are used. SSL using geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Muhammad Ali , Sayed Hashim

The scarcity of annotated data in LiDAR point cloud understanding hinders effective representation learning. Consequently, scholars have been actively investigating efficacious self-supervised pre-training paradigms. Nevertheless, temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Weijie Wei , Fatemeh Karimi Nejadasl , Theo Gevers , Martin R. Oswald

Wearable sensors provide abundant physiological time series, yet the principles governing their predictive utility remain unclear. We hypothesize that temporal resolution is a fundamental axis of representation learning, with different…