English
Related papers

Related papers: Introducing CALMED: Multimodal Annotated Dataset f…

200 papers

Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this…

Multimedia · Computer Science 2025-09-08 Jianlu Wang , Yanan Wang , Tong Liu

Mental disorders such as Autism Spectrum Disorders (ASD) are heterogeneous disorders that are notoriously difficult to diagnose, especially in children. The current psychiatric diagnostic process is based purely on the behavioural…

Machine Learning · Computer Science 2019-04-17 Taban Eslami , Vahid Mirjalili , Alvis Fong , Angela Laird , Fahad Saeed

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu

Autism Spectrum Disorder (ASD) is characterized by challenges with social interaction and communication and by restricted or repetitive patterns of thought and behavior, with significant variability in presentation. Approximately a quarter…

Artificial Intelligence · Computer Science 2026-05-21 Yadhu Kartha , Conor Anderson , Jenny Foster , Theresa Hamlin , Johanna Lantz , Ryan Lay , Juergen Hahn , Gari D. Clifford , Hyeokhyen Kwon

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu

In human interactions, emotion recognition is crucial. For this reason, the topic of computer-vision approaches for automatic emotion recognition is currently being extensively researched. Processing multi-channel electroencephalogram (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Joshua Bègue , Mohamed Aymen Labiod , Abdelhamid Melloulk

Emotion is an inherently subjective psychophysiological human-state and to produce an agreed-upon representation (gold standard) for continuous emotion requires a time-consuming and costly training procedure of multiple human annotators.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Alice Baird , Lukas Stappen , Lukas Christ , Lea Schumann , Eva-Maria Meßner , Björn W. Schuller

Currently, every 1 in 54 children have been diagnosed with Autism Spectrum Disorder (ASD), which is 178% higher than it was in 2000. An early diagnosis and treatment can significantly increase the chances of going off the spectrum and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Spencer He , Ryan Liu

The study of multimodal interaction in therapy can yield a comprehensive understanding of therapist and patient behavior that can be used to develop a multimodal virtual agent supporting therapy. This investigation aims to uncover how…

Computation and Language · Computer Science 2024-06-25 Lucie Galland , Catherine Pelachaud , Florian Pecune

We introduce a novel multimodal emotion recognition dataset that enhances the precision of Valence-Arousal Model while accounting for individual differences. This dataset includes electroencephalography (EEG), electrocardiography (ECG), and…

Human-Computer Interaction · Computer Science 2025-03-24 Xin Huang , Shiyao Zhu , Ziyu Wang , Yaping He , Hao Jin , Zhengkui Liu

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Mental disorders are among the foremost contributors to the global healthcare challenge. Research indicates that timely diagnosis and intervention are vital in treating various mental disorders. However, the early somatization symptoms of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yichun Li , Shuanglin Li , Syed Mohsen Naqvi

Emotional and mental well-being are vital components of quality of life, and with the rise of smart devices like smartphones, wearables, and artificial intelligence (AI), new opportunities for monitoring emotions in everyday settings have…

Human-Computer Interaction · Computer Science 2025-08-06 Pragya Singh , Ankush Gupta , Mohan Kumar , Pushpendra Singh

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

Micro-expressions (MEs) are subtle, fleeting nonverbal cues that reveal an individual's genuine emotional state. Their analysis has attracted considerable interest due to its promising applications in fields such as healthcare, criminal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Chuang Ma , Yu Pei , Jianhang Zhang , Shaokai Zhao , Bowen Ji , Liang Xie , Ye Yan , Erwei Yin

With the recent proliferation of open textual data on social media platforms, Emotion Detection (ED) from Text has received more attention over the past years. It has many applications, especially for businesses and online service…

Computation and Language · Computer Science 2022-07-26 Hossein Mirzaee , Javad Peymanfard , Hamid Habibzadeh Moshtaghin , Hossein Zeinali

Emotion plays a fundamental role in human interaction, and therefore systems capable of identifying emotions in speech are crucial in the context of human-computer interaction. Speech emotion recognition (SER) is a challenging problem,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Lucas Ueda , João Lima , Leonardo Marques , Paula Costa