English
Related papers

Related papers: CIG-MAE: Cross-Modal Information-Guided Masked Aut…

200 papers

Masked image modeling has been demonstrated as a powerful pretext task for generating robust representations that can be effectively generalized across multiple downstream tasks. Typically, this approach involves randomly masking patches…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Neelu Madan , Nicolae-Catalin Ristea , Kamal Nasrollahi , Thomas B. Moeslund , Radu Tudor Ionescu

This paper shows that masked autoencoders (MAE) are scalable self-supervised learners for computer vision. Our MAE approach is simple: we mask random patches of the input image and reconstruct the missing pixels. It is based on two core…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Kaiming He , Xinlei Chen , Saining Xie , Yanghao Li , Piotr Dollár , Ross Girshick

A calibration procedure is required in motor imagery-based brain-computer interface (MI-BCI) to tune the system for new users. This procedure is time-consuming and prevents na\"ive users from using the system immediately. Developing a…

Signal Processing · Electrical Eng. & Systems 2022-04-20 Navid Ayoobi , Elnaz Banan Sadeghian

Existing Masked Image Modeling (MIM) depends on a spatial patch-based masking-reconstruction strategy to perceive objects'features from unlabeled images, which may face two limitations when applied to chest CT: 1) inefficient feature…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Jie Zheng , Ru Wen , Haiqin Hu , Lina Wei , Kui Su , Wei Chen , Chen Liu , Jun Wang

In this work, we attempted to extend the thought and showcase a way forward for the Self-supervised Learning (SSL) learning paradigm by combining contrastive learning, self-distillation (knowledge distillation) and masked data modelling,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Maheswar Bora , Saurabh Atreya , Aritra Mukherjee , Abhijit Das

Fully supervised skeleton-based action recognition has achieved great progress with the blooming of deep learning techniques. However, these methods require sufficient labeled data which is not easy to obtain. In contrast, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Wenhan Wu , Yilei Hua , Ce Zheng , Shiqian Wu , Chen Chen , Aidong Lu

This work presents a seminal approach for synthesizing images from WiFi Channel State Information (CSI) in through-wall scenarios. Leveraging the strengths of WiFi, such as cost-effectiveness, illumination invariance, and wall-penetrating…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Julian Strohmayer , Rafael Sterzinger , Christian Stippel , Martin Kampel

Masked image modeling is a promising self-supervised learning method for visual data. It is typically built upon image patches with random masks, which largely ignores the variation of information density between them. The question is: Is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Haijian Chen , Wendong Zhang , Yunbo Wang , Xiaokang Yang

The development of robust and generalisable models for encoding the spatio-temporal dynamics of human brain activity is crucial for advancing neuroscientific discoveries. However, significant individual variation in the organisation of the…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Simon Dahan , Logan Z. J. Williams , Yourong Guo , Daniel Rueckert , Emma C. Robinson

Self-supervised learning has been a powerful training paradigm to facilitate representation learning. In this study, we design a masked autoencoder (MAE) to guide deep learning models to learn electroencephalography (EEG) signal…

Human-Computer Interaction · Computer Science 2024-09-04 Yifei Zhou , Sitong Liu

Self-supervised learning through masked autoencoders (MAEs) has recently attracted great attention for remote sensing (RS) image representation learning, and thus embodies a significant potential for content-based image retrieval (CBIR)…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Jakob Hackstein , Gencer Sumbul , Kai Norman Clasen , Begüm Demir

Masked image modeling (MIM) has achieved promising results on various vision tasks. However, the limited discriminability of learned representation manifests there is still plenty to go for making a stronger vision learner. Towards this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Zhicheng Huang , Xiaojie Jin , Chengze Lu , Qibin Hou , Ming-Ming Cheng , Dongmei Fu , Xiaohui Shen , Jiashi Feng

For a complete comprehension of multi-person scenes, it is essential to go beyond basic tasks like detection and tracking. Higher-level tasks, such as understanding the interactions and social activities among individuals, are also crucial.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mahsa Ehsanpour , Ian Reid , Hamid Rezatofighi

WiFi sensing technology has shown superiority in smart homes among various sensors for its cost-effective and privacy-preserving merits. It is empowered by Channel State Information (CSI) extracted from WiFi signals and advanced machine…

Networking and Internet Architecture · Computer Science 2022-12-13 Jianfei Yang , Xinyan Chen , Han Zou , Dazhuo Wang , Lihua Xie

Masked autoencoding has shown excellent performance on self-supervised video representation learning. Temporal redundancy has led to a high masking ratio and customized masking strategy in VideoMAE. In this paper, we aim to further improve…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Bingkun Huang , Zhiyu Zhao , Guozhen Zhang , Yu Qiao , Limin Wang

Channel state information (CSI)-based human activity recognition (HAR) is vulnerable to performance degradation under domain shifts across varying physical environments. Continual learning (CL) offers a principled way to learn new domains…

Machine Learning · Computer Science 2026-05-08 Wenhan Zheng , Yuyi Mao , Ivan Wang-Hei Ho

Masked autoencoder (MAE) is a promising self-supervised pre-training technique that can improve the representation learning of a neural network without human intervention. However, applying MAE directly to volumetric medical images poses…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Jia-Xin Zhuang , Luyang Luo , Hao Chen

The development of deep learning models in medical image analysis is majorly limited by the lack of large-sized and well-annotated datasets. Unsupervised learning does not require labels and is more suitable for solving medical image…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Zi'an Xu , Yin Dai , Fayu Liu , Weibing Chen , Yue Liu , Lifu Shi , Sheng Liu , Yuhang Zhou

Self-supervised learning (SSL) techniques have recently produced outstanding results in learning visual representations from unlabeled videos. Despite the importance of motion in supervised learning techniques for action recognition, SSL…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Mona Ahmadian , Frank Guerin , Andrew Gilbert

Class Incremental Learning (CIL) aims to sequentially learn new classes while avoiding catastrophic forgetting of previous knowledge. We propose to use Masked Autoencoders (MAEs) as efficient learners for CIL. MAEs were originally designed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiang-Tian Zhai , Xialei Liu , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng