English
Related papers

Related papers: Enhancing Depression Detection via Question-wise M…

200 papers

Model interpretability has become important to engenders appropriate user trust by providing the insight into the model prediction. However, most of the existing machine learning methods provide no interpretability for depression…

Information Retrieval · Computer Science 2021-04-29 Hamad Zogan , Imran Razzak , Xianzhi Wang , Shoaib Jameel , Guandong Xu

Speech is a scalable and non-invasive biomarker for early mental health screening. However, widely used depression datasets like DAIC-WOZ exhibit strong coupling between linguistic sentiment and diagnostic labels, encouraging models to…

Computation and Language · Computer Science 2026-01-05 Yuxin Li , Xiangyu Zhang , Yifei Li , Zhiwei Guo , Haoyang Zhang , Eng Siong Chng , Cuntai Guan

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

Information Retrieval · Computer Science 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang

Background: Reliable prediction of clinical progression over time can improve the outcomes of depression. Little work has been done integrating various risk factors for depression, to determine the combinations of factors with the greatest…

Machine Learning · Statistics 2023-07-06 Runa Bhaumik , Jonathan Stange

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Automated mental health prediction using textual data has shown promising results with deep learning and large language models. However, deploying these models in high-stakes real-world settings remains challenging, as existing approaches…

Computation and Language · Computer Science 2026-05-07 Yucheng Ruan , Ling Huang , Qika Lin , Kai He , Mengling Feng

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

Computation and Language · Computer Science 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu

Depression is a common mental illness that has to be detected and treated at an early stage to avoid serious consequences. There are many methods and modalities for detecting depression that involves physical examination of the individual.…

Artificial Intelligence · Computer Science 2022-02-08 Kayalvizhi S , Thenmozhi D

Learning from multimodal datasets can leverage complementary information and improve performance in prediction tasks. A commonly used strategy to account for feature correlations in high-dimensional datasets is the latent variable approach.…

Machine Learning · Computer Science 2024-10-01 Lingchao Mao , Qi wang , Yi Su , Fleming Lure , Jing Li

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Multi-modal fusion approaches aim to integrate information from different data sources. Unlike natural datasets, such as in audio-visual applications, where samples consist of "paired" modalities, data in healthcare is often collected…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Nasir Hayat , Krzysztof J. Geras , Farah E. Shamout

Traditional screening practices for anxiety and depression pose an impediment to monitoring and treating these conditions effectively. However, recent advances in NLP and speech modelling allow textual, acoustic, and hand-crafted…

Sound · Computer Science 2023-01-02 Brian Diep , Marija Stanojevic , Jekaterina Novikova

Alzheimer's disease (AD) is a prevalent and debilitating neurodegenerative disorder impacting a large aging population. Detecting AD in all its presymptomatic and symptomatic stages is crucial for early intervention and treatment. An active…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yasmine Mustafa , Tie Luo

Deep learning models have shown promising results in recognizing depressive states using video-based facial expressions. While successful models typically leverage using 3D-CNNs or video distillation techniques, the different use of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Manuel Lage Cañellas , Constantino Álvarez Casado , Le Nguyen , Miguel Bordallo López

Gaining insights into the structural and functional mechanisms of the brain has been a longstanding focus in neuroscience research, particularly in the context of understanding and treating neuropsychiatric disorders such as Schizophrenia…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Badhan Mazumder , Lei Wu , Vince D. Calhoun , Dong Hye Ye

Link prediction aims to identify potential missing triples in knowledge graphs. To get better results, some recent studies have introduced multimodal information to link prediction. However, these methods utilize multimodal information…

Artificial Intelligence · Computer Science 2023-03-21 Xinhang Li , Xiangyu Zhao , Jiaxing Xu , Yong Zhang , Chunxiao Xing

Twitter is currently a popular online social media platform which allows users to share their user-generated content. This publicly-generated user data is also crucial to healthcare technologies because the discovered patterns would hugely…

Machine Learning · Computer Science 2021-05-25 Hamad Zogan , Imran Razzak , Shoaib Jameel , Guandong Xu

Depression commonly co-occurs with neurodegenerative disorders like Multiple Sclerosis (MS), yet the potential of speech-based Artificial Intelligence for detecting depression in such contexts remains unexplored. This study examines the…

Computation and Language · Computer Science 2025-08-26 Monica Gonzalez-Machorro , Uwe Reichel , Pascal Hecker , Helly Hammer , Hesam Sagha , Florian Eyben , Robert Hoepner , Björn W. Schuller

The early identification and intervention of latent depression are of significant societal importance for mental health governance. While current automated detection methods based on social media have shown progress, their decision-making…

Quantitative Methods · Quantitative Biology 2025-12-17 Junwei Kuang , Jiaheng Xie , Zhijun Yan

This study focuses on the feature extraction problem in multi-modal data regression. To address three core challenges in real-world scenarios: limited and non-IID data, effective extraction and fusion of multi-modal information, and…

Machine Learning · Computer Science 2025-12-03 Haozhe Wu