English
Related papers

Related papers: Context-Aware Deep Learning for Multi Modal Depres…

200 papers

Depression is a global health concern with a critical need for increased patient screening. Speech technology offers advantages for remote screening but must perform robustly across patients. We have described two deep learning models…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-30 Y. Lu , A. Harati , T. Rutowski , R. Oliveira , P. Chlebek , E. Shriberg

The early detection of drowsiness has become vital to ensure the correct and safe development of several industries' tasks. Due to the transient mental state of a human subject between alertness and drowsiness, automated drowsiness…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Luis Guarda , Juan Tapia , Enrique Lopez Droguett , Marcelo Ramos

This paper presents our solution to the Multimodal Personality-aware Depression Detection (MPDD) challenge at ACM MM 2025. We propose a multimodal depression detection model in the Elderly that incorporates personality characteristics. We…

Sound · Computer Science 2025-10-10 Honghong Wang , Jing Deng , Rong Zheng

Current automatic depression detection systems provide predictions directly without relying on the individual symptoms/items of depression as denoted in the clinical depression rating scales. In contrast, clinicians assess each item in the…

The people with Major Depressive Disorder (MDD) exhibit the symptoms of tonal variations in their speech compared to the healthy counterparts. However, these tonal variations not only confine to the state of MDD but also on the language,…

Computation and Language · Computer Science 2024-09-24 Sona Binu , Jismi Jose , Fathima Shimna K , Alino Luke Hans , Reni K. Cherian , Starlet Ben Alex , Priyanka Srivastava , Chiranjeevi Yarra

Deep learning (DL) has gained popularity in recent years as an effective tool for classifying the current health and predicting the future of industrial equipment. However, most DL models have black-box components with an underlying…

Machine Learning · Computer Science 2023-08-22 Hao Lu , Austin M. Bray , Chao Hu , Andrew T. Zimmerman , Hongyi Xu

This paper addresses the problem of dense depth predictions from sparse distance sensor data and a single camera image on challenging weather conditions. This work explores the significance of different sensor modalities such as camera,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Sadique Adnan Siddiqui , Axel Vierling , Karsten Berns

This study introduces a novel method that transforms multimodal physiological signalsphotoplethysmography (PPG), galvanic skin response (GSR), and acceleration (ACC) into 2D image matrices to enhance stress detection using convolutional…

Machine Learning · Computer Science 2025-09-18 Yasin Hasanpoor , Bahram Tarvirdizadeh , Khalil Alipour , Mohammad Ghamari

Multimodal sentiment analysis and depression estimation are two important research topics that aim to predict human mental states using multimodal data. Previous research has focused on developing effective fusion strategies for exchanging…

Multimedia · Computer Science 2022-09-14 Hao Sun , Hongyi Wang , Jiaqing Liu , Yen-Wei Chen , Lanfen Lin

Depression is a common disease worldwide. It is difficult to diagnose and continues to be underdiagnosed. Because depressed patients constantly share their symptoms, major life events, and treatments on social media, researchers are turning…

Computation and Language · Computer Science 2025-10-27 Wenli Zhang , Jiaheng Xie , Zhu Zhang , Xiang Liu

In this paper, we aimed at reviewing several different approaches present today in the search for more accurate diagnostic and treatment management in mental healthcare. Our focus is on mood disorders, and in particular on the major…

Neurons and Cognition · Quantitative Biology 2019-03-28 Milena Cukic Radenkovic

The development of various sensing technologies is improving measurements of stress and the well-being of individuals. Although progress has been made with single signal modalities like wearables and facial emotion recognition, integrating…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Majid Hosseini , Morteza Bodaghi , Ravi Teja Bhupatiraju , Anthony Maida , Raju Gottumukkala

Machine learning (ML) tools such as encoder-decoder convolutional neural networks (CNN) can represent incredibly complex nonlinear functions which map between combinations of images and scalars. For example, CNNs can be used to map…

Machine Learning · Computer Science 2021-10-27 Alexander Scheinker

Accurate identification of late-life depression (LLD) using structural brain MRI is essential for monitoring disease progression and facilitating timely intervention. However, existing learning-based approaches for LLD detection are often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Yuzhen Gao , Qianqian Wang , Yongheng Sun , Cui Wang , Yongquan Liang , Mingxia Liu

Smartphone sensing offers an unobtrusive and scalable way to track daily behaviors linked to mental health, capturing changes in sleep, mobility, and phone use that often precede symptoms of stress, anxiety, or depression. While most prior…

Machine Learning · Computer Science 2026-01-14 Kaidong Feng , Zhu Sun , Roy Ka-Wei Lee , Xun Jiang , Yin-Leng Theng , Yi Ding

Alzheimers Disease (AD) is a progressive neurodegenerative disorder that poses significant challenges in its early diagnosis, often leading to delayed treatment and poorer outcomes for patients. Traditional diagnostic methods, typically…

Machine Learning · Computer Science 2025-08-06 Tatwadarshi P Nagarhalli , Sanket Patil , Vishal Pande , Uday Aswalekar , Prafulla Patil

In this paper, we aimed at reviewing present literature on employing nonlinear analysis in combination with machine learning methods, in depression detection or prediction task. We are focusing on an affordable data-driven approach,…

Signal Processing · Electrical Eng. & Systems 2019-09-10 Milena Čukić Radenković , Victoria Lopez Lopez

We present a novel multimodal deep learning framework for cardiac resynchronisation therapy (CRT) response prediction from 2D echocardiography and cardiac magnetic resonance (CMR) data. The proposed method first uses the `nnU-Net'…

Image and Video Processing · Electrical Eng. & Systems 2021-07-23 Esther Puyol-Antón , Baldeep S. Sidhu , Justin Gould , Bradley Porter , Mark K. Elliott , Vishal Mehta , Christopher A. Rinaldi , Andrew P. King

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

In recent years, Deep Learning has been successfully applied to multimodal learning problems, with the aim of learning useful joint representations in data fusion applications. When the available modalities consist of time series data such…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Xitong Yang , Palghat Ramesh , Radha Chitta , Sriganesh Madhvanath , Edgar A. Bernal , Jiebo Luo