English
Related papers

Related papers: MOGAM: A Multimodal Object-oriented Graph Attentio…

200 papers

Preliminary detection of mild depression could immensely help in effective treatment of the common mental health disorder. Due to the lack of proper awareness and the ample mix of stigmas and misconceptions present within the society,…

Multi-modal data comprising imaging (MRI, fMRI, PET, etc.) and non-imaging (clinical test, demographics, etc.) data can be collected together and used for disease prediction. Such diverse data gives complementary information about the…

Machine Learning · Computer Science 2018-12-27 Anees Kazi , S. Arvind krishna , Shayan Shekarforoush , Karsten Kortuem , Shadi Albarqouni , Nassir Navab

With ubiquity of social media platforms, millions of people are sharing their online persona by expressing their thoughts, moods, emotions, feelings, and even their daily struggles with mental health issues voluntarily and publicly on…

Major depressive disorder is a prevalent and serious mental health condition that negatively impacts your emotions, thoughts, actions, and overall perception of the world. It is complicated to determine whether a person is depressed due to…

Sound · Computer Science 2024-12-13 Quang-Anh N. D. , Manh-Hung Ha , Thai Kim Dinh , Minh-Duc Pham , Ninh Nguyen Van

Depression is a widespread mental health issue affecting diverse age groups, with notable prevalence among college students and the elderly. However, existing datasets and detection methods primarily focus on young adults, neglecting the…

This study investigates the detection and classification of depressive and non-depressive states using deep learning approaches. Depression is a prevalent mental health disorder that substantially affects quality of life, and early…

Quantitative Methods · Quantitative Biology 2026-01-19 Mohammad Reza Yousefi , Hajar Ismail Al-Tamimi , Amin Dehghani

Depression poses serious public health risks, including suicide, underscoring the urgency of timely and scalable screening. Multimodal automatic depression detection (ADD) offers a promising solution; however, widely studied audio- and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiuyi Chen , Mingkui Tan , Haifeng Lu , Qiuna Xu , Zhihua Wang , Runhao Zeng , Xiping Hu

This study introduces the Hybrid Multi-modal VGG (HM-VGG) model, a cutting-edge deep learning approach for the early diagnosis of glaucoma. The HM-VGG model utilizes an attention mechanism to process Visual Field (VF) data, enabling the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Junliang Du , Yiru Cang , Tong Zhou , Jiacheng Hu , Weijie He

In this study, we focus on automated approaches to detect depression from clinical interviews using multi-modal machine learning (ML). Our approach differentiates from other successful ML methods such as context-aware analysis through…

Machine Learning · Computer Science 2024-12-30 Genevieve Lam , Huang Dongyan , Weisi Lin

Video-based automatic depression analysis provides a fast, objective and repeatable self-assessment solution, which has been widely developed in recent years. While depression clues may be reflected by human facial behaviours of various…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jiaqi Xu , Siyang Song , Keerthy Kusumam , Hatice Gunes , Michel Valstar

Depression detection from user-generated content on the internet has been a long-lasting topic of interest in the research community, providing valuable screening tools for psychologists. The ubiquitous use of social media platforms lays…

Computation and Language · Computer Science 2023-02-07 Ana-Maria Bucur , Adrian Cosma , Paolo Rosso , Liviu P. Dinu

Depression is a widespread mental health disorder, yet its automatic detection remains challenging. Prior work has explored unimodal and multimodal approaches, with multimodal systems showing promise by leveraging complementary signals.…

Artificial Intelligence · Computer Science 2026-03-24 Annisaa Fitri Nurfidausi , Eleonora Mancini , Paolo Torroni

The rapid expansion of social media platforms has provided unprecedented access to massive amounts of multimodal user-generated content. Comprehending user emotions can provide valuable insights for improving communication and understanding…

Social and Information Networks · Computer Science 2025-01-15 Sree Bhattacharyya , Shuhua Yang , James Z. Wang

Limited access to mental healthcare resources hinders timely depression diagnosis, leading to detrimental outcomes. Social media platforms present a valuable data source for early detection, yet this task faces two significant challenges:…

Computation and Language · Computer Science 2025-10-10 Xiaochong Lan , Zhiguang Han , Yiming Cheng , Li Sheng , Jie Feng , Chen Gao , Yong Li

A substantial portion of offensive content on social media is directed towards women. Since the approaches for general offensive content detection face a challenge in detecting misogynistic content, it requires solutions tailored to address…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Mohammad Zia Ur Rehman , Sufyaan Zahoor , Areeb Manzoor , Musharaf Maqbool , Nagendra Kumar

Depression is a severe mental disorder, and reliable identification plays a critical role in early intervention and treatment. Multimodal depression detection aims to improve diagnostic performance by jointly modeling complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chongxiao Wang , Junjie Liang , Peng Cao , Jinzhu Yang , Osmar R. Zaiane

Automatic depression detection using speech signals with acoustic and textual modalities is a promising approach for early diagnosis. Depression-related patterns exhibit sparsity in speech: diagnostically relevant features occur in specific…

Sound · Computer Science 2026-04-14 Hangbin Yu , Yudong Yang , Rongfeng Su , Nan Yan , Lan Wang

Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nojod M. Alotaibi , Areej M. Alhothali

The global increase in mental illness requires innovative detection methods for early intervention. Social media provides a valuable platform to identify mental illness through user-generated content. This systematic review examines machine…

Machine Learning · Computer Science 2025-02-18 Yuchen Cao , Jianglai Dai , Zhongyan Wang , Yeyubei Zhang , Xiaorui Shen , Yunchong Liu , Yexin Tian

Human communication is multimodal in nature; it is through multiple modalities such as language, voice, and facial expressions, that opinions and emotions are expressed. Data in this domain exhibits complex multi-relational and temporal…

Computation and Language · Computer Science 2021-04-30 Jianing Yang , Yongxin Wang , Ruitao Yi , Yuying Zhu , Azaan Rehman , Amir Zadeh , Soujanya Poria , Louis-Philippe Morency