English
Related papers

Related papers: Reading Between the Frames: Multi-Modal Depression…

200 papers

Depression is a common mental health issue that requires prompt diagnosis and treatment. Despite the promise of social media data for depression detection, the opacity of employed deep learning models hinders interpretability and raises…

Computation and Language · Computer Science 2024-08-01 Mohammad Saeid Mahdavinejad , Peyman Adibi , Amirhassan Monadjemi , Pascal Hitzler

Predicting the presence of major depressive disorder (MDD) using behavioural and cognitive signals is a highly non-trivial task. The heterogeneous clinical profile of MDD means that any given speech, facial expression and/or observed…

Machine Learning · Computer Science 2023-06-26 Salvatore Fara , Orlaith Hickey , Alexandra Georgescu , Stefano Goria , Emilia Molimpakis , Nicholas Cummins

Many individuals especially those with autism spectrum disorder (ASD), alexithymia, or other neurodivergent profiles face challenges in recognizing, expressing, or interpreting emotions. To support more inclusive and personalized emotion…

Human-Computer Interaction · Computer Science 2025-08-14 Von Ralph Dane Marquez Herbuela , Yukie Nagai

In today's fast-paced world, the rates of stress and depression present a surge. Social media provide assistance for the early detection of mental health conditions. Existing methods mainly introduce feature extraction approaches and train…

Computation and Language · Computer Science 2023-07-07 Loukas Ilias , Spiros Mouzakitis , Dimitris Askounis

Up to now, only limited research has been conducted on cross-modal retrieval of suitable music for a specified video or vice versa. Moreover, much of the existing research relies on metadata such as keywords, tags, or associated description…

Computer Vision and Pattern Recognition · Computer Science 2017-09-04 Sungeun Hong , Woobin Im , Hyun S. Yang

Depression is a severe mental disorder, and reliable identification plays a critical role in early intervention and treatment. Multimodal depression detection aims to improve diagnostic performance by jointly modeling complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chongxiao Wang , Junjie Liang , Peng Cao , Jinzhu Yang , Osmar R. Zaiane

Depression is a common disease worldwide. It is difficult to diagnose and continues to be underdiagnosed. Because depressed patients constantly share their symptoms, major life events, and treatments on social media, researchers are turning…

Computation and Language · Computer Science 2025-10-27 Wenli Zhang , Jiaheng Xie , Zhu Zhang , Xiang Liu

This paper addresses the question of emotion classification. The task consists in predicting emotion labels (taken among a set of possible labels) best describing the emotions contained in short video clips. Building on a standard framework…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Valentin Vielzeuf , Stéphane Pateux , Frédéric Jurie

Stress and depression are prevalent nowadays across people of all ages due to the quick paces of life. People use social media to express their feelings. Thus, social media constitute a valuable form of information for the early detection…

Computation and Language · Computer Science 2023-11-07 Loukas Ilias , Dimitris Askounis

Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications for the…

We present our winning submission to the First International Workshop on Bodily Expressed Emotion Understanding (BEEU) challenge. Based on recent literature on the effect of context/environment on emotion, as well as visual representations…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Panagiotis Paraskevas Filntisis , Niki Efthymiou , Gerasimos Potamianos , Petros Maragos

Computational research on mental health disorders from written texts covers an interdisciplinary area between natural language processing and psychology. A crucial aspect of this problem is prevention and early diagnosis, as suicide…

Machine Learning · Statistics 2020-11-04 Ana-Maria Bucur , Liviu P. Dinu

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Previous studies have demonstrated that emotional features from a single acoustic sentiment label can enhance depression diagnosis accuracy. Additionally, according to the Emotion Context-Insensitivity theory and our pilot study,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-30 Rongfeng Su , Changqing Xu , Xinyi Wu , Feng Xu , Xie Chen , Lan Wangt , Nan Yan

In this work, we provide an extensive part-of-speech analysis of the discourse of social media users with depression. Research in psychology revealed that depressed users tend to be self-focused, more preoccupied with themselves and…

Computation and Language · Computer Science 2021-08-03 Ana-Maria Bucur , Ioana R. Podină , Liviu P. Dinu

Automatic depression detection provides cues for early clinical intervention by clinicians. Clinical interviews for depression detection involve dialogues centered around multiple themes. Existing studies primarily design end-to-end neural…

Computation and Language · Computer Science 2025-08-12 Xianbing Zhao , Yiqing Lyu , Di Wang , Buzhou Tang

Spoken content, such as online videos and podcasts, often spans multiple topics, which makes automatic topic segmentation essential for user navigation and downstream applications. However, current methods do not fully leverage acoustic…

Computation and Language · Computer Science 2026-02-09 Steffen Freisinger , Philipp Seeberger , Tobias Bocklet , Korbinian Riedhammer

Almost 50% depression patients face the risk of going into relapse. The risk increases to 80% after the second episode of depression. Although, depression detection from social media has attained considerable attention, depression relapse…

Understanding emotions in videos is a challenging task. However, videos contain several modalities which make them a rich source of data for machine learning and deep learning tasks. In this work, we aim to improve video sentiment…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Mehrshad Saadatinia , Minoo Ahmadi , Armin Abdollahi

Video caption refers to generating a descriptive sentence for a specific short video clip automatically, which has achieved remarkable success recently. However, most of the existing methods focus more on visual information while ignoring…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Wangli Hao , Zhaoxiang Zhang , He Guan , Guibo Zhu