English
Related papers

Related papers: EDMAE: An Efficient Decoupled Masked Autoencoder f…

200 papers

Human face exhibits an inherent hierarchy in its representations (i.e., holistic facial expressions can be encoded via a set of facial action units (AUs) and their intensity). Variational (deep) auto-encoders (VAE) have shown great results…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Dieu Linh Tran , Robert Walecki , Ognjen Rudovic , Stefanos Eleftheriadis , Bjørn Schuller , Maja Pantic

The identification of cardiac phase is an essential step for analysis and diagnosis of cardiac function. Automatic methods, especially data-driven methods for cardiac phase detection, typically require extensive annotations, which is…

Image and Video Processing · Electrical Eng. & Systems 2025-11-17 Yingyu Yang , Qianye Yang , Kangning Cui , Can Peng , Elena D'Alberti , Netzahualcoyotl Hernandez-Cruz , Olga Patey , Aris T. Papageorghiou , J. Alison Noble

Masked Autoencoders (MAE) have been popular paradigms for large-scale vision representation pre-training. However, MAE solely reconstructs the low-level RGB signals after the decoder and lacks supervision upon high-level semantics for the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Peng Gao , Renrui Zhang , Rongyao Fang , Ziyi Lin , Hongyang Li , Hongsheng Li , Qiao Yu

We present EmbodiedMAE, a unified 3D multi-modal representation for robot manipulation. Current approaches suffer from significant domain gaps between training datasets and robot manipulation tasks, while also lacking model architectures…

Robotics · Computer Science 2025-05-16 Zibin Dong , Fei Ni , Yifu Yuan , Yinchuan Li , Jianye Hao

Masked autoencoder (MAE), a simple and effective self-supervised learning framework based on the reconstruction of masked image regions, has recently achieved prominent success in a variety of vision tasks. Despite the emergence of…

Machine Learning · Computer Science 2023-06-09 Lingjing Kong , Martin Q. Ma , Guangyi Chen , Eric P. Xing , Yuejie Chi , Louis-Philippe Morency , Kun Zhang

The goal of universal audio representation learning is to obtain foundational models that can be used for a variety of downstream tasks involving speech, music and environmental sounds. To approach this problem, methods inspired by works on…

Sound · Computer Science 2024-05-22 Leonardo Pepino , Pablo Riera , Luciana Ferrer

An autoencoder (AE) is a neural network that, using self-supervised training, learns a succinct parameterized representation, and a corresponding encoding and decoding process, for all instances in a given class. Here, we introduce the…

Machine Learning · Computer Science 2025-07-15 Assaf Marron , Smadar Szekely , Irun Cohen , David Harel

Dynamic facial expression recognition (DFER) is essential to the development of intelligent and empathetic machines. Prior efforts in this field mainly fall into supervised learning paradigm, which is severely restricted by the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Licai Sun , Zheng Lian , Bin Liu , Jianhua Tao

To achieve reliable mining results for massive vessel trajectories, one of the most important challenges is how to efficiently compute the similarities between different vessel trajectories. The computation of vessel trajectory similarity…

Machine Learning · Computer Science 2021-06-11 Maohan Liang , Ryan Wen Liu , Shichen Li , Zhe Xiao , Xin Liu , Feng Lu

Low-dose computed tomography (LDCT) reduces the X-ray radiation but compromises image quality with more noises and artifacts. A plethora of transformer models have been developed recently to improve LDCT image quality. However, the success…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Dayang Wang , Yongshun Xu , Shuo Han , Hengyong Yu

The goal of anomaly detection is to identify examples that deviate from normal or expected behavior. We tackle this problem for images. We consider a two-phase approach. First, using normal examples, a convolutional autoencoder (CAE) is…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Natasa Sarafijanovic-Djukic , Jesse Davis

Parsing an image into a hierarchy of objects, parts, and relations is important and also challenging in many computer vision tasks. This paper proposes a simple and effective capsule autoencoder to address this issue, called DPR-CAE. In our…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Canqun Xiang , Zhennan Wang , Wenbin Zou , Chen Xu

Masked Autoencoders (MAEs) have emerged as a dominant strategy for self-supervised representation learning in natural images, where models are pre-trained to reconstruct masked patches with a pixel-wise mean squared error (MSE) between…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Chetan Madan , Aarjav Satia , Soumen Basu , Pankaj Gupta , Usha Dutta , Chetan Arora

In this paper, we propose a novel, effective and simpler end-to-end image clustering auto-encoder algorithm: ICAE. The algorithm uses PEDCC (Predefined Evenly-Distributed Class Centroids) as the clustering centers, which ensures the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Qiuyu Zhu , Zhengyong Wang

An efficient and effective decoding mechanism is crucial in medical image segmentation, especially in scenarios with limited computational resources. However, these decoding mechanisms usually come with high computational costs. To address…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Md Mostafijur Rahman , Mustafa Munir , Radu Marculescu

Unsupervised learning is becoming more and more important recently. As one of its key components, the autoencoder (AE) aims to learn a latent feature representation of data which is more robust and discriminative. However, most AE based…

Machine Learning · Computer Science 2019-04-02 Jingcai Guo , Song Guo

Unmanned underwater image analysis for marine monitoring faces two key challenges: (i) degraded image quality due to light attenuation and (ii) hardware storage constraints limiting high-resolution image collection. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Rita Pucci , Niki Martinel

Ultrasound imaging is one of the most widely used diagnostic modalities, offering real-time, radiation-free assessment across diverse clinical domains. However, interpretation of ultrasound images remains challenging due to high noise…

Image and Video Processing · Electrical Eng. & Systems 2025-11-10 Youssef Megahed , Robin Ducharme , Aylin Erman , Mark Walker , Steven Hawken , Adrian D. C. Chan

Automated interpretation of electrocardiograms (ECG) has garnered significant attention with the advancements in machine learning methodologies. Despite the growing interest, most current studies focus solely on classification or regression…

Signal Processing · Electrical Eng. & Systems 2023-11-07 Jielin Qiu , Jiacheng Zhu , Shiqi Liu , William Han , Jingqi Zhang , Chaojing Duan , Michael Rosenberg , Emerson Liu , Douglas Weber , Ding Zhao

Existing anomaly detection (AD) methods often treat the modality and class as independent factors. Although this paradigm has enriched the development of AD research branches and produced many specialized models, it has also led to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuan Zhao , Youwei Pang , Lihe Zhang , Hanqi Liu , Jiaming Zuo , Huchuan Lu , Xiaoqi Zhao