English
Related papers

Related papers: Hear Me, See Me, Understand Me: Audio-Visual Autis…

200 papers

Autism Spectrum Disorder (ASD) is a neuro-developmental syndrome resulting from alterations in the embryological brain before birth. This disorder distinguishes its patients by special socially restricted and repetitive behavior in addition…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hala Shamseddine , Safa Otoum , Azzam Mourad

Audio-visual navigation combines sight and hearing to navigate to a sound-emitting source in an unmapped environment. While recent approaches have demonstrated the benefits of audio input to detect and find the goal, they focus on clean and…

Sound · Computer Science 2023-01-04 Abdelrahman Younes , Daniel Honerkamp , Tim Welschehold , Abhinav Valada

Activity recognition computer vision algorithms can be used to detect the presence of autism-related behaviors, including what are termed "restricted and repetitive behaviors", or stimming, by diagnostic instruments. The limited data that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Peter Washington , Aaron Kline , Onur Cezmi Mutlu , Emilie Leblanc , Cathy Hou , Nate Stockham , Kelley Paskov , Brianna Chrisman , Dennis P. Wall

Autism Spectrum Disorders (ASD) describe a heterogeneous set of conditions classified as neurodevelopmental disorders. Although the mechanisms underlying ASD are not yet fully understood, more recent literature focused on multiple genetics…

Signal Processing · Electrical Eng. & Systems 2025-01-31 Jessica Vacca , Natascia Brondino , Fabio Dell'Acqua , Anna Vizziello , Pietro Savazzi

Audiovisual active speaker detection (ASD) is conventionally performed by modelling the temporal synchronisation of acoustic and visual speech cues. In egocentric recordings, however, the efficacy of synchronisation-based methods is…

Multimedia · Computer Science 2025-06-24 Jason Clarke , Yoshihiko Gotoh , Stefan Goetze

Computer vision and machine learning are the linchpin of field of automation. The medicine industry has adopted numerous methods to discover the root causes of many diseases in order to automate detection process. But, the biomarkers of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Hamza Sharif , Rizwan Ahmed Khan

The ability to interpret social cues comes naturally for most people, but for those living with Autism Spectrum Disorder (ASD), some experience a deficiency in this area. This paper presents the development of a multimodal augmented reality…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 James Ren Hou Lee , Alexander Wong

Autism Spectrum Disorder (autism) is a neurodevelopmental delay which affects at least 1 in 44 children. Like many neurological disorder phenotypes, the diagnostic features are observable, can be tracked over time, and can be managed or…

Computers and Society · Computer Science 2023-03-08 Peter Washington , Dennis P. Wall

Autism Spectrum Disorders (ASDs) are often associated with specific atypical postural or motor behaviors, of which Stereotypical Motor Movements (SMMs) have a specific visibility. While the identification and the quantification of SMM…

Neural and Evolutionary Computing · Computer Science 2016-06-08 Nastaran Mohammadian Rad , Andrea Bizzego , Seyed Mostafa Kia , Giuseppe Jurman , Paola Venuti , Cesare Furlanello

Autism spectrum disorder ASD is a neurodevelopmental disorder associated with challenges in communication, social interaction, and repetitive behaviors. Getting a clear diagnosis for a child is necessary for starting early intervention and…

Machine Learning · Computer Science 2021-10-05 Afef Saihi , Hussam Alshraideh

With the recent advancements in AI, Intelligent Virtual Assistants (IVA) have become a ubiquitous part of every home. Going forward, we are witnessing a confluence of vision, speech and dialog system technologies that are enabling the IVAs…

Computation and Language · Computer Science 2018-12-21 Shachi H Kumar , Eda Okur , Saurav Sahay , Juan Jose Alvarado Leanos , Jonathan Huang , Lama Nachman

The early detection of developmental disorders is key to child outcome, allowing interventions to be initiated that promote development and improve prognosis. Research on autism spectrum disorder (ASD) suggests behavioral markers can be…

Computer Vision and Pattern Recognition · Computer Science 2012-11-09 Jordan Hashemi , Thiago Vallin Spina , Mariano Tepper , Amy Esler , Vassilios Morellas , Nikolaos Papanikolopoulos , Guillermo Sapiro

In this paper we explore audiovisual emotion recognition under noisy acoustic conditions with a focus on speech features. We attempt to answer the following research questions: (i) How does speech emotion recognition perform on noisy data?…

Sound · Computer Science 2021-03-03 Michael Neumann , Ngoc Thang Vu

Facial expressions and actions differ among different individuals at varying degrees of intensity given responses to external stimuli, particularly among those that are neurodivergent. Such behaviors affect people in terms of overall…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Manuel Serna-Aguilera , Xuan Bac Nguyen , Han-Seok Seo , Khoa Luu

A large amount of recent research has focused on tasks that combine language and vision, resulting in a proliferation of datasets and methods. One such task is action recognition, whose applications include image annotation, scene under-…

Computation and Language · Computer Science 2017-04-25 Spandana Gella , Frank Keller

Explaining the decision of a multi-modal decision-maker requires to determine the evidence from both modalities. Recent advances in XAI provide explanations for models trained on still images. However, when it comes to modeling multiple…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Yanbei Chen , Thomas Hummel , A. Sophia Koepke , Zeynep Akata

Mental disorders are among the foremost contributors to the global healthcare challenge. Research indicates that timely diagnosis and intervention are vital in treating various mental disorders. However, the early somatization symptoms of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yichun Li , Shuanglin Li , Syed Mohsen Naqvi

Eye movements have been widely investigated to study the atypical visual attention in Autism Spectrum Disorder (ASD). The majority of these studies have been focused on limited eye movement features by statistical comparisons between ASD…

Image and Video Processing · Electrical Eng. & Systems 2019-11-27 Jin Xie , Longfei Wang , Paula Webster , Yang Yao , Jiayao Sun , Shuo Wang , Huihui Zhou

Autism spectrum disorder (ASD) is a neurodevelopmental condition characterized by challenges in social communication, repetitive behavior, and sensory processing. One important research area in ASD is evaluating children's behavioral…

Sound · Computer Science 2025-06-03 Tiantian Feng , Anfeng Xu , Xuan Shi , Somer Bishop , Shrikanth Narayanan

This paper strives for activity recognition under domain shift, for example caused by change of scenery or camera viewpoint. The leading approaches reduce the shift in activity appearance by adversarial training and self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yunhua Zhang , Hazel Doughty , Ling Shao , Cees G. M. Snoek