English
Related papers

Related papers: Depression Diagnosis and Analysis via Multimodal M…

200 papers

For most problems in science and engineering we can obtain data sets that describe the observed system from various perspectives and record the behavior of its individual components. Heterogeneous data sets can be collectively mined by data…

Machine Learning · Computer Science 2015-02-09 Marinka Žitnik , Blaž Zupan

Dynamic functional connectivity (dFC) derived from resting-state functional magnetic resonance imaging (fMRI) has been extensively utilized in brain science research. The sliding window correlation (SWC) method is a widely used approach for…

Neurons and Cognition · Quantitative Biology 2026-03-27 Jinlong Hu , Jiatong Huang , Zijian Cai

Multi-modal fusion approaches aim to integrate information from different data sources. Unlike natural datasets, such as in audio-visual applications, where samples consist of "paired" modalities, data in healthcare is often collected…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Nasir Hayat , Krzysztof J. Geras , Farah E. Shamout

Real-world problems are often dependent on multiple data modalities, making multimodal fusion essential for leveraging diverse information sources. In high-stakes domains, such as in healthcare, understanding how each modality contributes…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Mafalda Malafaia , Thalea Schlender , Tanja Alderliesten , Peter A. N. Bosman

Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valuable information,…

Machine Learning · Computer Science 2019-05-15 Yao-Hung Hubert Tsai , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency , Ruslan Salakhutdinov

As a vital aspect of affective computing, Multimodal Emotion Recognition has been an active research area in the multimedia community. Despite recent progress, this field still confronts two major challenges in real-world applications: 1)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Chengxin Chen , Pengyuan Zhang

Multimodal federated learning (MFL) aims to enrich model training in FL settings where clients are collecting measurements across multiple modalities. However, key challenges to MFL remain unaddressed, particularly in heterogeneous network…

Machine Learning · Computer Science 2026-03-12 Liangqi Yuan , Dong-Jun Han , Su Wang , Devesh Upadhyay , Christopher G. Brinton

Depression is a common yet serious mental disorder that affects millions of U.S. high schoolers every year. Still, accurate diagnosis and early detection remain significant challenges. In the field of public health, research shows that…

Machine Learning · Computer Science 2023-08-23 Nathan Zhong , Nikhil Yadav

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

The Early diagnosis and treatment of depression is essential for effective treatment. Depression, while being one of the most common mental illnesses, is still poorly understood in both research and clinical practice. Among different…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Abdolkarim Saeedi , Arash Maghsoudi , Fereidoun Nowshiravan Rahatabad

Clinical depression or Major Depressive Disorder (MDD) is a common and serious medical illness. In this paper, a deep recurrent neural network-based framework is presented to detect depression and to predict its severity level from speech.…

Human-Computer Interaction · Computer Science 2020-03-13 Emna Rejaibi , Ali Komaty , Fabrice Meriaudeau , Said Agrebi , Alice Othmani

Depression poses significant challenges to patients and healthcare organizations, necessitating efficient assessment methods. Existing paradigms typically focus on a patient-doctor way that overlooks multi-role interactions, such as family…

Human-Computer Interaction · Computer Science 2026-03-10 Zhiyuan Zhou , Jilong Liu , Sanwang Wang , Shijie Hao , Yanrong Guo , Richang Hong

Multi-modal fusion is of great significance in neuroscience which integrates information from different modalities and can achieve better performance than uni-modal methods in downstream tasks. Current multi-modal fusion methods in brain…

Artificial Intelligence · Computer Science 2026-04-03 Rui Dong , Xiaotong Zhang , Jiaxing Li , Yueying Li , Jiayin Wei , Youyong Kong

Major depressive disorder (MDD) is a common neuropsychiatric condition whose accurate diagnosis from resting-state functional magnetic resonance imaging (rs-fMRI) remains difficult. Dynamic functional connectivity (DFC) captures…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Muhammad Asif Hasan , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

The fusion of complementary multimodal information is crucial in computational pathology for accurate diagnostics. However, existing multimodal learning approaches necessitate access to users' raw data, posing substantial privacy risks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yuanzhe Peng , Jieming Bian , Jie Xu

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

Mental disorders such as depression and anxiety have been increasing at alarming rates in the worldwide population. Notably, the major depressive disorder has become a common problem among higher education students, aggravated, and maybe…

Computation and Language · Computer Science 2020-03-31 Paulo Mann , Aline Paes , Elton H. Matsushima

INTRODUCTION: The pharmacological treatment of Major Depressive Disorder (MDD) relies on a trial-and-error approach. We introduce an artificial intelligence (AI) model aiming to personalize treatment and improve outcomes, which was deployed…

Accurate diagnosis of Alzheimer's disease (AD) is essential for enabling timely intervention and slowing disease progression. Multimodal diagnostic approaches offer considerable promise by integrating complementary information across…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Yujie Nie , Jianzhang Ni , Yonglong Ye , Yuan-Ting Zhang , Yun Kwok Wing , Xiangqing Xu , Xin Ma , Lizhou Fan

Visual recognition inside the vehicle cabin leads to safer driving and more intuitive human-vehicle interaction but such systems face substantial obstacles as they need to capture different granularities of driver behaviour while dealing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , Zdravko Marinov , Constantin Seibold , David Schneider , Rainer Stiefelhagen