English
Related papers

Related papers: Transformer with Leveraged Masked Autoencoder for …

200 papers

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

There has been a growing interest in using deep learning models for processing long surgical videos, in order to automatically detect clinical/operational activities and extract metrics that can enable workflow efficiency tools and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Muhammad Abdullah Jamal , Omid Mohareri

Transformers have shown significant effectiveness for various vision tasks including both high-level vision and low-level vision. Recently, masked autoencoders (MAE) for feature pre-training have further unleashed the potential of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Huiyu Duan , Wei Shen , Xiongkuo Min , Danyang Tu , Long Teng , Jia Wang , Guangtao Zhai

We propose an automatic method for pain intensity measurement from video. For each video, pain intensity was measured using the dynamics of facial movement using 66 facial points. Gram matrices formulation was used for facial points…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Benjamin Szczapa , Mohamed Daoudi , Stefano Berretti , Pietro Pala , Alberto Del Bimbo , Zakia Hammal

Transfer learning using pre-trained Convolutional Neural Networks (CNNs) has been successfully applied to images for different classification tasks. In this paper, we propose a new pipeline for pain expression recognition in neonates using…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 Ghada Zamzmi , Dmitry Goldgof , Rangachar Kasturi , Yu Sun

Pain is a manifold condition that impacts a significant percentage of the population. Accurate and reliable pain evaluation for the people suffering is crucial to developing effective and advanced pain management protocols. Automatic pain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Stefanos Gkikas , Raul Fernandez Rojas , Manolis Tsiknakis

This research presents a novel multimodal data fusion methodology for pain behavior recognition, integrating statistical correlation analysis with human-centered insights. Our approach introduces two key innovations: 1) integrating…

Artificial Intelligence · Computer Science 2025-01-22 Xingrui Gu , Zhixuan Wang , Irisa Jin , Zekun Wu

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

Building AI models with trustworthiness is important especially in regulated areas such as healthcare. In tackling COVID-19, previous work uses convolutional neural networks as the backbone architecture, which has shown to be prone to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Kai Ma , Pengcheng Xi , Karim Habashy , Ashkan Ebadi , Stéphane Tremblay , Alexander Wong

Pain is a common occurrence among patients admitted to Intensive Care Units. Pain assessment in ICU patients still remains a challenge for clinicians and ICU staff, specifically in cases of non-verbal sedated, mechanically ventilated, and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Subhash Nerella , Kia Khezeli , Andrea Davidson , Patrick Tighe , Azra Bihorac , Parisa Rashidi

An important challenge in emotion recognition is to develop methods that can leverage unlabeled training data. In this paper, we propose the VQ-MAE-AV model, a self-supervised multimodal model that leverages masked autoencoders to learn…

Sound · Computer Science 2025-05-12 Samir Sadok , Simon Leglaive , Renaud Séguier

Emotion being a subjective thing, leveraging knowledge and science behind labeled data and extracting the components that constitute it, has been a challenging problem in the industry for many years. With the evolution of deep learning in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Prudhvi Raj Dachapally

Masked autoencoders (MAEs) have emerged as a powerful approach for pre-training on unlabelled data, capable of learning robust and informative feature representations. This is particularly advantageous in diffused lung disease research,…

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

We propose an automatic method to estimate self-reported pain based on facial landmarks extracted from videos. For each video sequence, we decompose the face into four different regions and the pain intensity is measured by modeling the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Benjamin Szczapa , Mohamed Daoudi , Stefano Berretti , Pietro Pala , Alberto Del Bimbo , Zakia Hammal

Pain is a multifaceted and widespread phenomenon with substantial clinical and societal burden, making reliable automated assessment a critical objective. This paper presents a lightweight transformer architecture that fuses multiple fNIRS…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Stefanos Gkikas , Christian Arzate Cruz , Yu Fang , Lu Cao , Muhammad Umar Khan , Thomas Kassiotis , Giorgos Giannakakis , Raul Fernandez Rojas , Randy Gomez

Previous research on automatic pain estimation from facial expressions has focused primarily on "one-size-fits-all" metrics (such as PSPI). In this work, we focus on directly estimating each individual's self-reported visual-analog scale…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Dianbo Liu , Fengjiao Peng , Andrew Shea , Ognjen , Rudovic , Rosalind Picard

Breast cancer detection through mammography interpretation remains difficult because of the minimal nature of abnormalities that experts need to identify alongside the variable interpretations between readers. The potential of CNNs for…

Image and Video Processing · Electrical Eng. & Systems 2025-08-11 Ojonugwa Oluwafemi Ejiga Peter , Daniel Emakporuena , Bamidele Dayo Tunde , Maryam Abdulkarim , Abdullahi Bn Umar

Automatic pain intensity estimation plays a pivotal role in healthcare and medical fields. While many methods have been developed to gauge human pain using behavioral or physiological indicators, facial expressions have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Issam Serraoui , Eric Granger , Abdenour Hadid , Abdelmalik Taleb-Ahmed

Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Yoni Schirris , Eric Marcus , Jonas Teuwen , Hugo Horlings , Efstratios Gavves