English
Related papers

Related papers: Hierarchical Self-Supervised Representation Learni…

200 papers

Speech is a scalable and non-invasive biomarker for early mental health screening. However, widely used depression datasets like DAIC-WOZ exhibit strong coupling between linguistic sentiment and diagnostic labels, encouraging models to…

Computation and Language · Computer Science 2026-01-05 Yuxin Li , Xiangyu Zhang , Yifei Li , Zhiwei Guo , Haoyang Zhang , Eng Siong Chng , Cuntai Guan

This study examines the relationship between speech representations and the hierarchical structure of cognitive assessment in mild cognitive impairment. Utilizing 5,754 German neuropsychological assessment recordings, we evaluate six…

Self-supervised learning (SSL) speech models, which can serve as powerful upstream models to extract meaningful speech representations, have achieved unprecedented success in speech representation learning. However, their effectiveness on…

Sound · Computer Science 2023-02-01 Tung-Yu Wu , Chen-An Li , Tzu-Han Lin , Tsu-Yuan Hsu , Hung-Yi Lee

Speech-based depression detection has shown promise as an objective diagnostic tool, yet the cross-linguistic robustness of acoustic markers and their neurobiological underpinnings remain underexplored. This study extends Cross-Data…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Fuxiang Tao , Dongwei Li , Shuning Tang , Xuri Ge , Wei Ma , Anna Esposito , Alessandro Vinciarelli

Major Depressive Disorder (MDD) is a severe illness that affects millions of people, and it is critical to diagnose this disorder as early as possible. Detecting depression from voice signals can be of great help to physicians and can be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Jinhan Wang , Vijay Ravi , Jonathan Flint , Abeer Alwan

Speech emotion recognition (SER) systems find applications in various fields such as healthcare, education, and security and defense. A major drawback of these systems is their lack of generalization across different conditions. This…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-15 Srinivas Parthasarathy , Carlos Busso

Speaker change detection (SCD) is an important task in dialog modeling. Our paper addresses the problem of text-based SCD, which differs from existing audio-based studies and is useful in various scenarios, for example, processing dialog…

Computation and Language · Computer Science 2018-10-01 Zhao Meng , Lili Mou , Zhi Jin

Major depressive disorder (MDD) is a common neuropsychiatric condition whose accurate diagnosis from resting-state functional magnetic resonance imaging (rs-fMRI) remains difficult. Dynamic functional connectivity (DFC) captures…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Muhammad Asif Hasan , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Recently, discrete tokens derived from self-supervised learning (SSL) models via k-means clustering have been actively studied as pseudo-text in speech language models and as efficient intermediate representations for various tasks.…

Sound · Computer Science 2025-08-18 Kentaro Onda , Satoru Fukayama , Daisuke Saito , Nobuaki Minematsu

Depression manifests through a diverse set of symptoms such as sleep disturbance, loss of interest, and concentration difficulties. However, most existing works treat depression prediction either as a binary label or an overall severity…

Computation and Language · Computer Science 2026-02-18 Chaithra Nerella , Chiranjeevi Yarra

Recently, self-supervised learning (SSL) from unlabelled speech data has gained increased attention in the automatic speech recognition (ASR) community. Typical SSL methods include autoregressive predictive coding (APC), Wav2vec2.0, and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-02 Ruchao Fan , Yunzheng Zhu , Jinhan Wang , Abeer Alwan

Automatic speech recognition (ASR) technology can aid in the detection, monitoring, and assessment of depressive symptoms in individuals. ASR systems have been used as a tool to analyze speech patterns and characteristics that are…

Human-Computer Interaction · Computer Science 2023-08-17 Alice Othmani , Muhammad Muzammel

While speech-based depression detection methods that use speaker-identity features, such as speaker embeddings, are popular, they often compromise patient privacy. To address this issue, we propose a speaker disentanglement method that…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-07 Jinhan Wang , Vijay Ravi , Abeer Alwan

Emotion recognition models using audio input data can enable the development of interactive systems with applications in mental healthcare, marketing, gaming, and social media analysis. While the field of affective computing using audio…

Sound · Computer Science 2023-07-25 Peranut Nimitsurachat , Peter Washington

Code-switching (CS) is common in daily conversations where more than one language is used within a sentence. The difficulties of CS speech recognition lie in alternating languages and the lack of transcribed data. Therefore, this paper uses…

Computation and Language · Computer Science 2021-10-08 Liang-Hsuan Tseng , Yu-Kuan Fu , Heng-Jui Chang , Hung-yi Lee

Current automatic depression detection systems provide predictions directly without relying on the individual symptoms/items of depression as denoted in the clinical depression rating scales. In contrast, clinicians assess each item in the…

Multilingual automatic speech recognition (ASR) systems have garnered attention for their potential to extend language coverage globally. While self-supervised learning (SSL) models, like MMS, have demonstrated their effectiveness in…

Computation and Language · Computer Science 2024-04-30 Hongfei Xue , Qijie Shao , Kaixun Huang , Peikun Chen , Jie Liu , Lei Xie

Utilizing Self-Supervised Learning (SSL) models for Speech Emotion Recognition (SER) has proven effective, yet limited research has explored cross-lingual scenarios. This study presents a comparative analysis between human performance and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Zhichen Han , Tianqi Geng , Hui Feng , Jiahong Yuan , Korin Richmond , Yuanchao Li

The lack of labeled data is a common challenge in speech classification tasks, particularly those requiring extensive subjective assessment, such as cognitive state classification. In this work, we propose a Semi-Supervised Learning (SSL)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Yuanchao Li , Zixing Zhang , Jing Han , Peter Bell , Catherine Lai

Self-supervised learning (SSL) based speech foundation models have been applied to a wide range of ASR tasks. However, their application to dysarthric and elderly speech via data-intensive parameter fine-tuning is confronted by in-domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-22 Shujie Hu , Xurong Xie , Mengzhe Geng , Zengrui Jin , Jiajun Deng , Guinan Li , Yi Wang , Mingyu Cui , Tianzi Wang , Helen Meng , Xunying Liu