English
Related papers

Related papers: Dynamic Fusion Multimodal Network for SpeechWellne…

200 papers

Traditional multimodal methods often assume static modality quality, which limits their adaptability in dynamic real-world scenarios. Thus, dynamical multimodal methods are proposed to assess modality quality and adjust their contribution…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Shicai Wei , Kaijie Zhang , Luyi Chen , Tao He , Guiduo Duan

In this study, we focus on automated approaches to detect depression from clinical interviews using multi-modal machine learning (ML). Our approach differentiates from other successful ML methods such as context-aware analysis through…

Machine Learning · Computer Science 2024-12-30 Genevieve Lam , Huang Dongyan , Weisi Lin

Depression is a mental disorder and can cause a variety of symptoms, including psychological, physical, and social. Speech has been proved an objective marker for the early recognition of depression. For this reason, many studies have been…

Machine Learning · Computer Science 2026-05-12 Loukas Ilias , Dimitris Askounis

The early detection of suicide risk is important since it enables the intervention to prevent potential suicide attempts. This paper studies the automatic detection of suicide risk based on spontaneous speech from adolescents, and collects…

Computation and Language · Computer Science 2024-09-25 Ziyun Cui , Chang Lei , Wen Wu , Yinan Duan , Diyang Qu , Ji Wu , Runsen Chen , Chao Zhang

Traditional sentiment analysis has long been a unimodal task, relying solely on text. This approach overlooks non-verbal cues such as vocal tone and prosody that are essential for capturing true emotional intent. We introduce Dynamic…

Computation and Language · Computer Science 2025-09-30 Sadia Abdulhalim , Muaz Albaghdadi , Moshiur Farazi

Intelligently reasoning about the world often requires integrating data from multiple modalities, as any individual modality may contain unreliable or incomplete information. Prior work in multimodal learning fuses input modalities only…

Machine Learning · Computer Science 2020-11-17 George Barnum , Sabera Talukder , Yisong Yue

Multimodal fusion focuses on integrating information from multiple modalities with the goal of more accurate prediction, which has achieved remarkable progress in a wide range of scenarios, including autonomous driving and medical…

Machine Learning · Computer Science 2024-11-04 Qingyang Zhang , Yake Wei , Zongbo Han , Huazhu Fu , Xi Peng , Cheng Deng , Qinghua Hu , Cai Xu , Jie Wen , Di Hu , Changqing Zhang

Depression has been a leading cause of mental-health illnesses across the world. While the loss of lives due to unmanaged depression is a subject of attention, so is the lack of diagnostic tests and subjectivity involved. Using behavioural…

Artificial Intelligence · Computer Science 2020-10-07 Shivani Shimpi , Shyam Thombre , Snehal Reddy , Ritik Sharma , Srijan Singh

Multimodal learning has been lacking principled ways of combining information from different modalities and learning a low-dimensional manifold of meaningful representations. We study multimodal learning and sensor fusion from a latent…

Machine Learning · Computer Science 2019-04-24 Lijiang Guo

Suicide remains a public health challenge, necessitating improved detection methods to facilitate timely intervention and treatment. This systematic review evaluates the role of Artificial Intelligence (AI) and Machine Learning (ML) in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Ambre Marie , Marine Garnier , Thomas Bertin , Laura Machart , Guillaume Dardenne , Gwenolé Quellec , Sofian Berrouiguet

The proliferation of multi-modal fake news on social media poses a significant threat to public trust and social stability. Traditional detection methods, primarily text-based, often fall short due to the deceptive interplay between…

Cryptography and Security · Computer Science 2025-08-11 Junhao He , Tianyu Liu , Jingyuan Zhao , Benjamin Turner

This study investigates explainable machine learning algorithms for identifying depression from speech. Grounded in evidence from speech production that depression affects motor control and vowel generation, pre-trained vowel-based…

Machine Learning · Computer Science 2024-10-25 Kexin Feng , Theodora Chaspari

Multimodal learning enhances the perceptual capabilities of cognitive systems by integrating information from different sensory modalities. However, existing multimodal fusion research typically assumes static integration, not fully…

Neural and Evolutionary Computing · Computer Science 2025-05-16 Xiang He , Dongcheng Zhao , Yang Li , Qingqun Kong , Xin Yang , Yi Zeng

Depression, as a typical mental disorder, has become a prevalent issue significantly impacting public health. However, the prevention and treatment of depression still face multiple challenges, including complex diagnostic procedures,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yu Luo , Nan Huang , Sophie Yu , Hendry Xu , Jerry Wang , Colin Wang , Zhichao Liu , Chen Zeng

Neuropsychiatric disorders, such as Alzheimer's disease (AD), depression, and autism spectrum disorder (ASD), are characterized by linguistic and acoustic abnormalities, offering potential biomarkers for early detection. Despite the promise…

Computation and Language · Computer Science 2025-12-25 Zhongren Dong , Haotian Guo , Weixiang Xu , Huan Zhao , Zixing Zhang

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Early detection of anxiety is crucial for reducing the suffering of individuals with mental disorders and improving treatment outcomes. Utilizing an mHealth platform for anxiety screening can be particularly practical in improving screening…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haimiao Mo , Yuchen Li , Shanlin Yang , Wei Zhang , Shuai Ding

Millimeter wave (mmWave) communication, utilizing beamforming techniques to address the inherent path loss limitation, is considered as one of the key technologies to support ever increasing high throughput and low latency demands of…

Networking and Internet Architecture · Computer Science 2026-02-17 Muhammad Baqer Mollah , Honggang Wang , Mohammad Ataul Karim , Hua Fang

Autonomous soundscape augmentation systems typically use trained models to pick optimal maskers to effect a desired perceptual change. While acoustic information is paramount to such systems, contextual information, including participant…

Sound · Computer Science 2024-07-03 Kenneth Ooi , Karn N. Watcharasupat , Bhan Lam , Zhen-Ting Ong , Woon-Seng Gan

Depression, a prevalent and serious mental health issue, affects approximately 3.8\% of the global population. Despite the existence of effective treatments, over 75\% of individuals in low- and middle-income countries remain untreated,…

Computation and Language · Computer Science 2024-07-19 Shengjie Li , Yinhao Xiao