English
Related papers

Related papers: Reading Between the Frames: Multi-Modal Depression…

200 papers

Depression is the leading cause of disability worldwide. Initial efforts to detect depression signals from social media posts have shown promising results. Given the high internal validity, results from such analyses are potentially…

Social and Information Networks · Computer Science 2020-06-16 Lucia Lushi Chen , Walid Magdy , Heather Whalley , Maria Wolters

Depression, a prevalent and serious mental health issue, affects approximately 3.8\% of the global population. Despite the existence of effective treatments, over 75\% of individuals in low- and middle-income countries remain untreated,…

Computation and Language · Computer Science 2024-07-19 Shengjie Li , Yinhao Xiao

Understanding uncertainty plays a critical role in achieving common ground (Clark et al.,1983). This is especially important for multimodal AI systems that collaborate with users to solve a problem or guide the user through a challenging…

Computation and Language · Computer Science 2024-10-21 Qi Cheng , Mert İnan , Rahma Mbarki , Grace Grmek , Theresa Choi , Yiming Sun , Kimele Persaud , Jenny Wang , Malihe Alikhani

Major depressive disorder is a common mental disorder that affects almost 7% of the adult U.S. population. The 2017 Audio/Visual Emotion Challenge (AVEC) asks participants to build a model to predict depression levels based on the audio,…

Computation and Language · Computer Science 2018-03-29 Yuan Gong , Christian Poellabauer

The detection of depression through non-verbal cues has gained significant attention. Previous research predominantly centred on identifying depression within the confines of controlled laboratory environments, often with the supervision of…

Computation and Language · Computer Science 2024-06-18 Palash Moon , Pushpak Bhattacharyya

Depression significantly affects emotions, thoughts, and daily activities. Recent research indicates that speech signals contain vital cues about depression, sparking interest in audio-based deep-learning methods for estimating its…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-07 Shuanglin Li , Zhijie Xie , Syed Mohsen Naqvi

Depression has been a leading cause of mental-health illnesses across the world. While the loss of lives due to unmanaged depression is a subject of attention, so is the lack of diagnostic tests and subjectivity involved. Using behavioural…

Artificial Intelligence · Computer Science 2020-10-07 Shivani Shimpi , Shyam Thombre , Snehal Reddy , Ritik Sharma , Srijan Singh

Depression is a serious medical condition that is suffered by a large number of people around the world. It significantly affects the way one feels, causing a persistent lowering of mood. In this paper, we propose a novel attention-based…

Computers and Society · Computer Science 2019-04-17 Syed Arbaaz Qureshi , Mohammed Hasanuzzaman , Sriparna Saha , Gaël Dias

Cognitive decline is a natural part of aging. However, under some circumstances, this decline is more pronounced than expected, typically due to disorders such as Alzheimer's disease. Early detection of an anomalous decline is crucial, as…

Access to non-verbal cues in social interactions is vital for people with visual impairment. It has been shown that non-verbal cues such as eye contact, number of people, their names and positions are helpful for individuals who are blind.…

Computers and Society · Computer Science 2017-11-30 M. Saquib Sarfraz , Angela Constantinescu , Melanie Zuzej , Rainer Stiefelhagen

The increasing prevalence of mental health disorders, such as depression, anxiety, and bipolar disorder, calls for immediate need in developing tools for early detection and intervention. Social media platforms, like Reddit, represent a…

Machine Learning · Computer Science 2025-03-12 Qasim Bin Saeed , Ijaz Ahmed

Depression is the most common psychological disorder and is considered as a leading cause of disability and suicide worldwide. An automated system capable of detecting signs of depression in human speech can contribute to ensuring timely…

Sound · Computer Science 2023-02-21 Mashrura Tasnim , Jekaterina Novikova

Video-based automatic depression analysis provides a fast, objective and repeatable self-assessment solution, which has been widely developed in recent years. While depression clues may be reflected by human facial behaviours of various…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jiaqi Xu , Siyang Song , Keerthy Kusumam , Hatice Gunes , Michel Valstar

Early detection plays a crucial role in the treatment of depression. Therefore, numerous studies have focused on social media platforms, where individuals express their emotions, aiming to achieve early detection of depression. However, the…

Computation and Language · Computer Science 2024-03-26 Junyeop Cha , Seoyun Kim , Dongjae Kim , Eunil Park

We developed a novel, interpretable multimodal classification method to identify symptoms of mood disorders viz. depression, anxiety and anhedonia using audio, video and text collected from a smartphone application. We used CNN-based…

Machine Learning · Computer Science 2021-09-08 Tathagata Banerjee , Matthew Kollada , Pablo Gersberg , Oscar Rodriguez , Jane Tiller , Andrew E Jaffe , John Reynders

Multimodal depression classification has gained immense popularity over the recent years. We develop a multimodal depression classification system using articulatory coordination features extracted from vocal tract variables and text…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-15 Nadee Seneviratne , Carol Espy-Wilson

Mental disorders are among the foremost contributors to the global healthcare challenge. Research indicates that timely diagnosis and intervention are vital in treating various mental disorders. However, the early somatization symptoms of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yichun Li , Shuanglin Li , Syed Mohsen Naqvi

With the acceleration of the pace of work and life, people have to face more and more pressure, which increases the possibility of suffering from depression. However, many patients may fail to get a timely diagnosis due to the serious…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Lang He , Mingyue Niu , Prayag Tiwari , Pekka Marttinen , Rui Su , Jiewei Jiang , Chenguang Guo , Hongyu Wang , Songtao Ding , Zhongmin Wang , Wei Dang , Xiaoying Pan

Depression is a common mental disorder that affects millions of people worldwide. Although promising, current multimodal methods hinge on aligned or aggregated multimodal fusion, suffering two significant limitations: (i) inefficient…

Computers and Society · Computer Science 2024-09-25 Jiaxin Ye , Junping Zhang , Hongming Shan

Every day, users generate digital traces (e.g., social media posts, chats, and online interactions) that are inherently timestamped and may reflect aspects of their mental state. These traces can be organized into temporal trajectories that…

Artificial Intelligence · Computer Science 2026-05-15 Loris Belcastro , Francesco Gervino , Fabrizio Marozzo , Domenico Talia , Paolo Trunfio