中文
相关论文

相关论文: Transformer with Leveraged Masked Autoencoder for …

200 篇论文

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

计算机视觉与模式识别 · 计算机科学 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

There has been a growing interest in using deep learning models for processing long surgical videos, in order to automatically detect clinical/operational activities and extract metrics that can enable workflow efficiency tools and…

计算机视觉与模式识别 · 计算机科学 2023-05-22 Muhammad Abdullah Jamal , Omid Mohareri

Transformers have shown significant effectiveness for various vision tasks including both high-level vision and low-level vision. Recently, masked autoencoders (MAE) for feature pre-training have further unleashed the potential of…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Huiyu Duan , Wei Shen , Xiongkuo Min , Danyang Tu , Long Teng , Jia Wang , Guangtao Zhai

We propose an automatic method for pain intensity measurement from video. For each video, pain intensity was measured using the dynamics of facial movement using 66 facial points. Gram matrices formulation was used for facial points…

计算机视觉与模式识别 · 计算机科学 2020-06-25 Benjamin Szczapa , Mohamed Daoudi , Stefano Berretti , Pietro Pala , Alberto Del Bimbo , Zakia Hammal

Transfer learning using pre-trained Convolutional Neural Networks (CNNs) has been successfully applied to images for different classification tasks. In this paper, we propose a new pipeline for pain expression recognition in neonates using…

计算机视觉与模式识别 · 计算机科学 2018-07-05 Ghada Zamzmi , Dmitry Goldgof , Rangachar Kasturi , Yu Sun

Pain is a manifold condition that impacts a significant percentage of the population. Accurate and reliable pain evaluation for the people suffering is crucial to developing effective and advanced pain management protocols. Automatic pain…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Stefanos Gkikas , Raul Fernandez Rojas , Manolis Tsiknakis

This research presents a novel multimodal data fusion methodology for pain behavior recognition, integrating statistical correlation analysis with human-centered insights. Our approach introduces two key innovations: 1) integrating…

人工智能 · 计算机科学 2025-01-22 Xingrui Gu , Zhixuan Wang , Irisa Jin , Zekun Wu

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

计算机视觉与模式识别 · 计算机科学 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

Building AI models with trustworthiness is important especially in regulated areas such as healthcare. In tackling COVID-19, previous work uses convolutional neural networks as the backbone architecture, which has shown to be prone to…

图像与视频处理 · 电气工程与系统科学 2022-07-20 Kai Ma , Pengcheng Xi , Karim Habashy , Ashkan Ebadi , Stéphane Tremblay , Alexander Wong

Pain is a common occurrence among patients admitted to Intensive Care Units. Pain assessment in ICU patients still remains a challenge for clinicians and ICU staff, specifically in cases of non-verbal sedated, mechanically ventilated, and…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Subhash Nerella , Kia Khezeli , Andrea Davidson , Patrick Tighe , Azra Bihorac , Parisa Rashidi

An important challenge in emotion recognition is to develop methods that can leverage unlabeled training data. In this paper, we propose the VQ-MAE-AV model, a self-supervised multimodal model that leverages masked autoencoders to learn…

声音 · 计算机科学 2025-05-12 Samir Sadok , Simon Leglaive , Renaud Séguier

Emotion being a subjective thing, leveraging knowledge and science behind labeled data and extracting the components that constitute it, has been a challenging problem in the industry for many years. With the evolution of deep learning in…

计算机视觉与模式识别 · 计算机科学 2017-06-07 Prudhvi Raj Dachapally

Masked autoencoders (MAEs) have emerged as a powerful approach for pre-training on unlabelled data, capable of learning robust and informative feature representations. This is particularly advantageous in diffused lung disease research,…

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

计算机视觉与模式识别 · 计算机科学 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

We propose an automatic method to estimate self-reported pain based on facial landmarks extracted from videos. For each video sequence, we decompose the face into four different regions and the pain intensity is measured by modeling the…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Benjamin Szczapa , Mohamed Daoudi , Stefano Berretti , Pietro Pala , Alberto Del Bimbo , Zakia Hammal

Pain is a multifaceted and widespread phenomenon with substantial clinical and societal burden, making reliable automated assessment a critical objective. This paper presents a lightweight transformer architecture that fuses multiple fNIRS…

Previous research on automatic pain estimation from facial expressions has focused primarily on "one-size-fits-all" metrics (such as PSPI). In this work, we focus on directly estimating each individual's self-reported visual-analog scale…

计算机视觉与模式识别 · 计算机科学 2017-08-17 Dianbo Liu , Fengjiao Peng , Andrew Shea , Ognjen , Rudovic , Rosalind Picard

Breast cancer detection through mammography interpretation remains difficult because of the minimal nature of abnormalities that experts need to identify alongside the variable interpretations between readers. The potential of CNNs for…

图像与视频处理 · 电气工程与系统科学 2025-08-11 Ojonugwa Oluwafemi Ejiga Peter , Daniel Emakporuena , Bamidele Dayo Tunde , Maryam Abdulkarim , Abdullahi Bn Umar

Automatic pain intensity estimation plays a pivotal role in healthcare and medical fields. While many methods have been developed to gauge human pain using behavioral or physiological indicators, facial expressions have emerged as a…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Issam Serraoui , Eric Granger , Abdenour Hadid , Abdelmalik Taleb-Ahmed

Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or,…

图像与视频处理 · 电气工程与系统科学 2025-08-18 Yoni Schirris , Eric Marcus , Jonas Teuwen , Hugo Horlings , Efstratios Gavves