English
Related papers

Related papers: A Two-stage Multi-modal Affect Analysis Framework …

200 papers

The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interaction and the growing integration of computer systems across various sectors of society. Affective…

Human-Computer Interaction · Computer Science 2026-05-05 Raziyeh Zall , Alireza Kheyrkhah , Erik Cambria , Zahra Naseri , M. Reza Kangavari

Automatic affect recognition has applications in many areas such as education, gaming, software development, automotives, medical care, etc. but it is non trivial task to achieve appreciable performance on in-the-wild data sets. In-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Darshan Gera , Badveeti Naveen Siva Kumar , Bobbili Veerendra Raj Kumar , S Balasubramanian

In recent decades, the field of affective computing has made substantial progress in advancing the ability of AI systems to recognize and express affective phenomena, such as affect and emotions, during human-human and human-machine…

Human-Computer Interaction · Computer Science 2023-05-19 Leena Mathur , Maja J Matarić , Louis-Philippe Morency

Responding to one's name is among the earliest-emerging social orienting behaviors and is one of the most prominent aspects in the detection of Autism Spectrum Disorder (ASD). Typically developing children exhibit near-reflexive orienting…

Human-Computer Interaction · Computer Science 2026-03-25 Vartika Narayani Srinet , Anirudha Bhattacharjee , Braj Bhushan , Bishakh Bhattacharya

In recent years, much focus has been put on employing technology to make novel behavioural aids for those with autism. Most of these are digital adaptations of tools used in standard behavioural therapy to enforce normative skills. These…

Human-Computer Interaction · Computer Science 2020-02-12 Catalin Voss , Nick Haber , Peter Washington , Aaron Kline , Beth McCarthy , Jena Daniels , Azar Fazel , Titas De , Carl Feinstein , Terry Winograd , Dennis Wall

Rapid identification and accurate documentation of interfering and high-risk behaviors in ASD, such as aggression, self-injury, disruption, and restricted repetitive behaviors, are important in daily classroom environments for tracking…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Barun Das , Conor Anderson , Tania Villavicencio , Johanna Lantz , Jenny Foster , Theresa Hamlin , Ali Bahrami Rad , Gari D. Clifford , Hyeokhyen Kwon

Early diagnosis of autism spectrum disorder (ASD) is known to improve the quality of life of affected individuals. However, diagnosis is often delayed even in wealthier countries including the US, largely due to the fact that gold standard…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Dennis Núñez Fernández , Franklin Barrientos Porras , Robert H. Gilman , Macarena Vittet Mondonedo , Patricia Sheen , Mirko Zimic

Collaborating in a group, whether face-to-face or virtually, involves continuously expressing emotions and interpreting those of other group members. Therefore, understanding group affect is essential to comprehending how groups interact…

Human-Computer Interaction · Computer Science 2024-10-22 Navin Raj Prabhu , Maria Tsfasman , Catharine Oertel , Timo Gerkmann , Nale Lehmann-Willenbrock

Autism Spectrum Disorder (ASD) is marked by action imitation deficits stemming from visuomotor integration impairments, posing challenges to imitation-based learning, such as dance movement therapy in mixed reality (MR-DMT). Previous…

Human-Computer Interaction · Computer Science 2025-10-07 Weiying Liu , Yanran Yuan , Zhiqiang Sheng , Dandan Lian , Sheng Li , Yufan Zhang , Yulong Bian , Juan Liu

An attempt is made to develop a smart toy to help the children suffering with communication disorders. The children suffering with such disorders need additional attention and guidance to understand different types of social events and life…

Human-Computer Interaction · Computer Science 2019-06-12 Amr Jadi

We address the problem of detecting who spoke when in child-inclusive spoken interactions i.e., automatic child-adult speaker classification. Interactions involving children are richly heterogeneous due to developmental differences. The…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-01 Rimita Lahiri , Tiantian Feng , Rajat Hebbar , Catherine Lord , So Hyun Kim , Shrikanth Narayanan

The multifactorial etiology of autism spectrum disorder (ASD) suggests that its study would benefit greatly from multimodal approaches that combine data from widely varying platforms, e.g., neuroimaging, genetics, and clinical…

Quantitative Methods · Quantitative Biology 2023-08-11 Nicha C. Dvornek , Catherine Sullivan , James S. Duncan , Abha R. Gupta

As artificial intelligence (AI) systems become increasingly embedded in everyday life, the ability of interactive agents to express empathy has become critical for effective human-AI interaction, particularly in emotionally sensitive…

Human-Computer Interaction · Computer Science 2025-12-24 Sung Park , Daeho Yoon , Jungmin Lee

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

Facial affect analysis remains a challenging task with its setting transitioned from lab-controlled to in-the-wild situations. In this paper, we present novel frameworks to handle the two challenges in the 4th Affective Behavior Analysis…

Machine Learning · Computer Science 2022-07-21 Siyang Li , Yifan Xu , Huanyu Wu , Dongrui Wu , Yingjie Yin , Jiajiong Cao , Jingting Ding

In this paper we address the problem of multi-cue affect recognition in challenging scenarios such as child-robot interaction. Towards this goal we propose a method for automatic recognition of affect that leverages body expressions…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Panagiotis P. Filntisis , Niki Efthymiou , Petros Koutras , Gerasimos Potamianos , Petros Maragos

Accurate recognition of human emotions is critical for adaptive human-computer interaction, yet remains challenging in dynamic, conversation-like settings. This work presents a personality-aware multimodal framework that integrates…

In recent years, extensive research has emerged in affective computing on topics like automatic emotion recognition and determining the signals that characterize individual emotions. Much less studied, however, is expressiveness, or the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Victoria Lin , Jeffrey M. Girard , Louis-Philippe Morency

Speech patterns have been identified as potential diagnostic markers for neuropsychiatric conditions. However, most studies only compare a single clinical group to healthy controls, whereas clinical practice often requires differentiating…

Interactions involving children span a wide range of important domains from learning to clinical diagnostic and therapeutic contexts. Automated analyses of such interactions are motivated by the need to seek accurate insights and offer…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-13 Anfeng Xu , Kevin Huang , Tiantian Feng , Helen Tager-Flusberg , Shrikanth Narayanan