English
Related papers

Related papers: MMFformer: Multimodal Fusion Transformer Network f…

200 papers

As the impact of technology on our lives is increasing, we witness increased use of social media that became an essential tool not only for communication but also for sharing information with community about our thoughts and feelings. This…

Computation and Language · Computer Science 2023-05-10 Ilija Tavchioski , Marko Robnik-Šikonja , Senja Pollak

Background: Mental illnesses such as depression and anxiety require improved methods for early detection and personalized intervention. Traditional predictive models often rely on unimodal data or early fusion strategies that fail to…

Machine Learning · Computer Science 2025-07-22 Youcef Barkat , Dylan Hamitouche , Deven Parekh , Ivy Guo , David Benrimoh

Social media has become an important source for understanding mental health, providing researchers with a way to detect conditions like depression from user-generated posts. This tutorial provides practical guidance to address common…

Computation and Language · Computer Science 2025-08-06 Yeyubei Zhang , Zhongyan Wang , Zhanyi Ding , Yexin Tian , Jianglai Dai , Xiaorui Shen , Yunchong Liu , Yuchen Cao

Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nojod M. Alotaibi , Areej M. Alhothali

Early detection plays a crucial role in the treatment of depression. Therefore, numerous studies have focused on social media platforms, where individuals express their emotions, aiming to achieve early detection of depression. However, the…

Computation and Language · Computer Science 2024-03-26 Junyeop Cha , Seoyun Kim , Dongjae Kim , Eunil Park

Data-driven approaches for depression diagnosis have emerged as a significant research focus in neuromedicine, driven by the development of relevant datasets. Recently, graph neural network (GNN)-based models have gained widespread adoption…

Machine Learning · Computer Science 2025-05-01 Chengkai Yang , Xingping Dong , Xiaofen Zong

Depression is one of the most prevalent mental disorders, which seriously affects one's life. Traditional depression diagnostics commonly depends on rating with scales, which can be labor-intensive and subjective. In this context, Automatic…

Machine Learning · Computer Science 2022-03-02 Yanrong Guo , Chenyang Zhu , Shijie Hao , Richang Hong

With ubiquity of social media platforms, millions of people are sharing their online persona by expressing their thoughts, moods, emotions, feelings, and even their daily struggles with mental health issues voluntarily and publicly on…

Early detection of anxiety is crucial for reducing the suffering of individuals with mental disorders and improving treatment outcomes. Utilizing an mHealth platform for anxiety screening can be particularly practical in improving screening…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haimiao Mo , Yuchen Li , Shanlin Yang , Wei Zhang , Shuai Ding

We present our preliminary work to determine if patient's vocal acoustic, linguistic, and facial patterns could predict clinical ratings of depression severity, namely Patient Health Questionnaire depression scale (PHQ-8). We proposed a…

Computer Vision and Pattern Recognition · Computer Science 2017-12-01 Aven Samareh , Yan Jin , Zhangyang Wang , Xiangyu Chang , Shuai Huang

This study proposes an innovative multimodal fusion model based on a teacher-student architecture to enhance the accuracy of depression classification. Our designed model addresses the limitations of traditional methods in feature fusion…

Computation and Language · Computer Science 2025-02-03 Lindy Gan , Yifan Huang , Xiaoyang Gao , Jiaming Tan , Fujun Zhao , Tao Yang

On the increase of major depressive disorders (MDD), many researchers paid attention to their recognition and treatment. Existing MDD recognition algorithms always use a single time-frequency domain method method, but the single…

Neurons and Cognition · Quantitative Biology 2021-11-03 Xiaofang Sun , Xiangwei Zheng , Yonghui Xu , Lizhen Cui , Bin Hu

Deepfake media is becoming widespread nowadays because of the easily available tools and mobile apps which can generate realistic looking deepfake videos/images without requiring any technical knowledge. With further advances in this field…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Sohail Ahmed Khan , Duc-Tien Dang-Nguyen

We describe the development of a model to detect user-level clinical depression based on a user's temporal social media posts. Our model uses a Depression Symptoms Detection (DSD) classifier, which is trained on the largest existing samples…

Computation and Language · Computer Science 2023-03-31 Nawshad Farruque , Randy Goebel , Sudhakar Sivapalan , Osmar R. Zaïane

Mental disorders such as depression and anxiety have been increasing at alarming rates in the worldwide population. Notably, the major depressive disorder has become a common problem among higher education students, aggravated, and maybe…

Computation and Language · Computer Science 2020-03-31 Paulo Mann , Aline Paes , Elton H. Matsushima

Deep learning models have shown promising results in recognizing depressive states using video-based facial expressions. While successful models typically leverage using 3D-CNNs or video distillation techniques, the different use of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Manuel Lage Cañellas , Constantino Álvarez Casado , Le Nguyen , Miguel Bordallo López

The Early diagnosis and treatment of depression is essential for effective treatment. Depression, while being one of the most common mental illnesses, is still poorly understood in both research and clinical practice. Among different…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Abdolkarim Saeedi , Arash Maghsoudi , Fereidoun Nowshiravan Rahatabad

Survival prediction plays a crucial role in assisting clinicians with the development of cancer treatment protocols. Recent evidence shows that multimodal data can help in the diagnosis of cancer disease and improve survival prediction.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-14 Ruiquan Ge , Xiangyang Hu , Rungen Huang , Gangyong Jia , Yaqi Wang , Renshu Gu , Changmiao Wang , Elazab Ahmed , Linyan Wang , Juan Ye , Ye Li

Depression is a common mental illness that has to be detected and treated at an early stage to avoid serious consequences. There are many methods and modalities for detecting depression that involves physical examination of the individual.…

Artificial Intelligence · Computer Science 2022-02-08 Kayalvizhi S , Thenmozhi D

The increasing global prevalence of mental disorders, such as depression and PTSD, requires objective and scalable diagnostic tools. Traditional clinical assessments often face limitations in accessibility, objectivity, and consistency.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-03 Abdelrahaman A. Hassan , Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda