English
Related papers

Related papers: Multimodal Deep Learning for Mental Disorders Pred…

200 papers

Depression has been the leading cause of mental-health illness worldwide. Major depressive disorder (MDD), is a common mental health disorder that affects both psychologically as well as physically which could lead to loss of lives. Due to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Anupama Ray , Siddharth Kumar , Rutvik Reddy , Prerana Mukherjee , Ritu Garg

Mental disorders, such as anxiety and depression, have become a global concern that affects people of all ages. Early detection and treatment are crucial to mitigate the negative effects these disorders can have on daily life. Although…

Computers and Society · Computer Science 2025-02-05 Jinghui Qin , Changsong Liu , Tianchi Tang , Dahuang Liu , Minghao Wang , Qianying Huang , Rumin Zhang

Recent progress has been made in detecting early stage dementia entirely through recordings of patient speech. Multimodal speech analysis methods were applied to the PROCESS challenge, which requires participants to use audio recordings of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-14 Lei Chi , Arav Sharma , Ari Gebhardt , Joseph T. Colonel

During psychiatric assessment, clinicians observe not only what patients report, but important nonverbal signs such as tone, speech rate, fluency, responsiveness, and body language. Weighing and integrating these different information…

Machine Learning · Computer Science 2025-12-19 Agnes Norbury , George Fairs , Alexandra L. Georgescu , Matthew M. Nour , Emilia Molimpakis , Stefano Goria

Word embeddings such as ELMo have recently been shown to model word semantics with greater efficacy through contextualized learning on large-scale language corpora, resulting in significant improvement in state of the art across many…

Computation and Language · Computer Science 2019-09-11 Shao-Yen Tseng , Panayiotis Georgiou , Shrikanth Narayanan

In recent years, we have seen deep learning and distributed representations of words and sentences make impact on a number of natural language processing tasks, such as similarity, entailment and sentiment analysis. Here we introduce a new…

Computation and Language · Computer Science 2018-09-05 Lina Rojas-Barahona , Bo-Hsiang Tseng , Yinpei Dai , Clare Mansfield , Osman Ramadan , Stefan Ultes , Michael Crawford , Milica Gasic

This study focuses on how different modalities of human communication can be used to distinguish between healthy controls and subjects with schizophrenia who exhibit strong positive symptoms. We developed a multi-modal schizophrenia…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Gowtham Premananth , Yashish M. Siriwardena , Philip Resnik , Carol Espy-Wilson

The increasing use of electronic forms of communication presents new opportunities in the study of mental health, including the ability to investigate the manifestations of psychiatric diseases unobtrusively and in the setting of patients'…

Human-Computer Interaction · Computer Science 2018-03-28 Bokai Cao , Lei Zheng , Chenwei Zhang , Philip S. Yu , Andrea Piscitello , John Zulueta , Olu Ajilore , Kelly Ryan , Alex D. Leow

Depression is a mental disorder and can cause a variety of symptoms, including psychological, physical, and social. Speech has been proved an objective marker for the early recognition of depression. For this reason, many studies have been…

Machine Learning · Computer Science 2026-05-12 Loukas Ilias , Dimitris Askounis

Introduction: Alzheimer's disease is a type of dementia in which early diagnosis plays a major rule in the quality of treatment. Among new works in the diagnosis of Alzheimer's disease, there are many of them analyzing the voice stream…

Machine Learning · Computer Science 2019-10-02 S. Soroush Haj Zargarbashi , Bagher Babaali

Deep learning has been recently used for the analysis of neuroimages, such as structural magnetic resonance imaging (MRI), functional MRI, and positron emission tomography (PET), and has achieved significant performance improvements over…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Li Zhang , Mingliang Wang , Mingxia Liu , Daoqiang Zhang

Depression is a widespread mental health disorder, yet its automatic detection remains challenging. Prior work has explored unimodal and multimodal approaches, with multimodal systems showing promise by leveraging complementary signals.…

Artificial Intelligence · Computer Science 2026-03-24 Annisaa Fitri Nurfidausi , Eleonora Mancini , Paolo Torroni

This study investigates explainable machine learning algorithms for identifying depression from speech. Grounded in evidence from speech production that depression affects motor control and vowel generation, pre-trained vowel-based…

Machine Learning · Computer Science 2024-10-25 Kexin Feng , Theodora Chaspari

Mood disorders are common and associated with significant morbidity and mortality. Early diagnosis has the potential to greatly alleviate the burden of mental illness and the ever increasing costs to families and society. Mobile devices…

Human-Computer Interaction · Computer Science 2018-08-30 He Huang , Bokai Cao , Philip S. Yu , Chang-Dong Wang , Alex D. Leow

Dementia, a progressive neurodegenerative disorder, affects memory, reasoning, and daily functioning, creating challenges for individuals and healthcare systems. Early detection is crucial for timely interventions that may slow disease…

Neurons and Cognition · Quantitative Biology 2025-03-04 Sahar Sinene Mehdoui , Abdelhamid Bouzid , Daniel Sierra-Sosa , Adel Elmaghraby

Multimodal schizophrenia assessment systems have gained traction over the last few years. This work introduces a schizophrenia assessment system to discern between prominent symptom classes of schizophrenia and predict an overall…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-19 Gowtham Premananth , Carol Espy-Wilson

Pre-trained deep learning embeddings have consistently shown superior performance over handcrafted acoustic features in speech emotion recognition (SER). However, unlike acoustic features with clear physical meaning, these embeddings lack…

Sound · Computer Science 2024-09-17 Satvik Dixit , Daniel M. Low , Gasser Elbanna , Fabio Catania , Satrajit S. Ghosh

Speech contains information that is clinically relevant to some diseases, which has the potential to be used for health assessment. Recent work shows an interest in applying deep learning algorithms, especially pretrained large speech…

Sound · Computer Science 2024-07-02 Hok-Shing Lau , Mark Huntly , Nathon Morgan , Adesua Iyenoma , Biao Zeng , Tim Bashford

Early identification of stroke symptoms is essential for enabling timely intervention and improving patient outcomes, particularly in prehospital settings. This study presents a fast, non-invasive multimodal deep learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ngoc-Khai Hoang , Thi-Nhu-Mai Nguyen , Huy-Hieu Pham

Depression has been a leading cause of mental-health illnesses across the world. While the loss of lives due to unmanaged depression is a subject of attention, so is the lack of diagnostic tests and subjectivity involved. Using behavioural…

Artificial Intelligence · Computer Science 2020-10-07 Shivani Shimpi , Shyam Thombre , Snehal Reddy , Ritik Sharma , Srijan Singh