English
Related papers

Related papers: Domain-Guided Masked Autoencoders for Unique Playe…

200 papers

Masked Autoencoders (MAE) play a pivotal role in learning potent representations, delivering outstanding results across various 3D perception tasks essential for autonomous driving. In real-world driving scenarios, it's commonplace to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jian Zou , Tianyu Huang , Guanglei Yang , Zhenhua Guo , Tao Luo , Chun-Mei Feng , Wangmeng Zuo

This paper shows that masked autoencoders (MAE) are scalable self-supervised learners for computer vision. Our MAE approach is simple: we mask random patches of the input image and reconstruct the missing pixels. It is based on two core…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Kaiming He , Xinlei Chen , Saining Xie , Yanghao Li , Piotr Dollár , Ross Girshick

Automated analysis of surgical videos is crucial for improving surgical training, workflow optimization, and postoperative assessment. We introduce a CSMAE, Masked Autoencoder (MAE)-based pretraining approach, specifically developed for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Nisarg A. Shah , Wele Gedara Chaminda Bandara , Shameema Skider , S. Swaroop Vedula , Vishal M. Patel

Masked Autoencoder (MAE) is a self-supervised approach for representation learning, widely applicable to a variety of downstream tasks in computer vision. In spite of its success, it is still not fully uncovered what and how MAE exactly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jeongwoo Shin , Inseo Lee , Junho Lee , Joonseok Lee

Dynamic vision sensors (DVS) are bio-inspired devices that capture visual information in the form of asynchronous events, which encode changes in pixel intensity with high temporal resolution and low latency. These events provide rich…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jingkai Sun , Qiang Zhang , Jiaxu Wang , Jiahang Cao , Renjing Xu

Autoencoders have been widely used for dimensional reduction and feature extraction. Various types of autoencoders have been proposed by introducing regularization terms. Most of these regularizations improve representation learning by…

Machine Learning · Computer Science 2020-06-26 Yuzhu Guo , Kang Pan , Simeng Li , Zongchang Han , Kexin Wang , Li Li

Recently, self-supervised Masked Autoencoders (MAE) have attracted unprecedented attention for their impressive representation learning ability. However, the pretext task, Masked Image Modeling (MIM), reconstructs the missing local patches,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Feng Liang , Yangguang Li , Diana Marculescu

"Masked Autoencoders (MAE) Are Scalable Vision Learners" revolutionizes the self-supervised learning method in that it not only achieves the state-of-the-art for image pre-training, but is also a milestone that bridges the gap between…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Shuhao Cao , Peng Xu , David A. Clifton

Recent video masked autoencoder (MAE) works have designed improved masking algorithms focused on saliency. These works leverage visual cues such as motion to mask the most salient regions. However, the robustness of such visual cues depends…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 David Fan , Jue Wang , Shuai Liao , Zhikang Zhang , Vimal Bhat , Xinyu Li

Masked autoencoders (MAEs) have displayed significant potential in the classification and semantic segmentation of medical images in the last year. Due to the high similarity of human tissues, even slight changes in medical images may…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Jiawei Mao , Shujian Guo , Yuanqi Chang , Xuesong Yin , Binling Nie

In the field of medical image segmentation, challenges such as indistinct lesion features, ambiguous boundaries,and multi-scale characteristics have long revailed. This paper proposes an improved method named Intensity-Spatial Dual Masked…

Image and Video Processing · Electrical Eng. & Systems 2025-02-17 Yuexing Ding , Jun Wang , Hongbing Lyu

Self-supervised representation learning for point cloud videos remains a challenging problem with two key limitations: (1) existing methods rely on explicit knowledge to learn motion, resulting in suboptimal representations; (2) prior…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Zhi Zuo , Chenyi Zhuang , Pan Gao , Jie Qin , Hao Feng , Nicu Sebe

This paper presents a unified framework to (i) locate the ball, (ii) predict the pose, and (iii) segment the instance mask of players in team sports scenes. Those problems are of high interest in automated sports analytics, production, and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Seyed Abolfazl Ghasemzadeh , Gabriel Van Zandycke , Maxime Istasse , Niels Sayez , Amirafshar Moshtaghpour , Christophe De Vleeschouwer

Self-supervised learning has been a powerful training paradigm to facilitate representation learning. In this study, we design a masked autoencoder (MAE) to guide deep learning models to learn electroencephalography (EEG) signal…

Human-Computer Interaction · Computer Science 2024-09-04 Yifei Zhou , Sitong Liu

Masked autoencoders (MAE) have recently been introduced to 3D self-supervised pretraining for point clouds due to their great success in NLP and computer vision. Unlike MAEs used in the image domain, where the pretext task is to restore…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Siming Yan , Yuqi Yang , Yuxiao Guo , Hao Pan , Peng-shuai Wang , Xin Tong , Yang Liu , Qixing Huang

Generalizing learned representations across significantly different visual domains is a fundamental yet crucial ability of the human visual system. While recent self-supervised learning methods have achieved good performances with…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Haiyang Yang , Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Lei Bai , Rui Zhao , Wanli Ouyang

Unsupervised visual anomaly detection conveys practical significance in many scenarios and is a challenging task due to the unbounded definition of anomalies. Moreover, most previous methods are application-specific, and establishing a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Haiming Yao , Xue Wang , Wenyong Yu

Masked image modeling (MIM) has been recognized as a strong self-supervised pre-training approach in the vision domain. However, the mechanism and properties of the learned representations by such a scheme, as well as how to further enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Kevin Zhang , Zhiqiang Shen

Generative self-supervised learning (SSL), especially masked autoencoders (MAE), has greatly succeeded and garnered substantial research interest in graph machine learning. However, the research of MAE in dynamic graphs is still scant. This…

Machine Learning · Computer Science 2024-09-17 Pengfe Jiao , Xinxun Zhang , Mengzhou Gao , Tianpeng Li , Zhidong Zhao

Federated learning is a specific distributed learning paradigm in which a central server aggregates updates from multiple clients' local models, thereby enabling the server to learn without requiring clients to upload their private data,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yuchen He , Xiangfeng Wang