English
Related papers

Related papers: DEPA: Self-Supervised Audio Embedding for Depressi…

200 papers

Twitter is currently a popular online social media platform which allows users to share their user-generated content. This publicly-generated user data is also crucial to healthcare technologies because the discovered patterns would hugely…

Machine Learning · Computer Science 2021-05-25 Hamad Zogan , Imran Razzak , Shoaib Jameel , Guandong Xu

Recent research has delved into speech enhancement (SE) approaches that leverage audio embeddings from pre-trained models, diverging from time-frequency masking or signal prediction techniques. This paper introduces an efficient and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Xingwei Sun , Heinrich Dinkel , Yadong Niu , Linzhang Wang , Junbo Zhang , Jian Luan

The popular frameworks for self-supervised learning of speech representations have largely focused on frame-level masked prediction of speech regions. While this has shown promising downstream task performance for speech recognition and…

Computation and Language · Computer Science 2025-07-22 Varun Krishna , Sriram Ganapathy

Deep learning models have shown promising results in recognizing depressive states using video-based facial expressions. While successful models typically leverage using 3D-CNNs or video distillation techniques, the different use of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Manuel Lage Cañellas , Constantino Álvarez Casado , Le Nguyen , Miguel Bordallo López

Clinical depression or Major Depressive Disorder (MDD) is a common and serious medical illness. In this paper, a deep recurrent neural network-based framework is presented to detect depression and to predict its severity level from speech.…

Human-Computer Interaction · Computer Science 2020-03-13 Emna Rejaibi , Ali Komaty , Fabrice Meriaudeau , Said Agrebi , Alice Othmani

Improper or erroneous labelling can pose a hindrance to reliable generalization for supervised learning. This can have negative consequences, especially for critical fields such as healthcare. We propose an effective new approach for…

Machine Learning · Computer Science 2021-11-16 Konstantinos Nikolaidis , Thomas Plagemann , Stein Kristiansen , Vera Goebel , Mohan Kankanhalli

Background: Depression is a major public health concern, affecting an estimated five percent of the global population. Early and accurate diagnosis is essential to initiate effective treatment, yet recognition remains challenging in many…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Jana Weber , Marcel Weber , Juan Miguel Lopez Alcaraz

In this paper, we propose an iterative framework for self-supervised speaker representation learning based on a deep neural network (DNN). The framework starts with training a self-supervision speaker embedding network by maximizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Danwei Cai , Weiqing Wang , Ming Li

Recently, self-supervised representation learning relying on vast amounts of unlabeled data has been explored as a pre-training method for autonomous driving. However, directly applying popular contrastive or generative methods to this…

Robotics · Computer Science 2025-10-08 Haoran Zhu , Zhenyuan Dong , Kristi Topollai , Beiyao Sha , Anna Choromanska

Preliminary detection of mild depression could immensely help in effective treatment of the common mental health disorder. Due to the lack of proper awareness and the ample mix of stigmas and misconceptions present within the society,…

In this work, we focus on the detection of depression through speech analysis. Previous research has widely explored features extracted from pre-trained models (PTMs) primarily trained for paralinguistic tasks. Although these features have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Orchid Chetia Phukan , Sarthak Jain , Shubham Singh , Muskaan Singh , Arun Balaji Buduru , Rajesh Sharma

Monocular depth estimation (MDE) has attracted intense study due to its low cost and critical functions for robotic tasks such as localization, mapping and obstacle detection. Supervised approaches have led to great success with the advance…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Shao-Yuan Lo , Wei Wang , Jim Thomas , Jingjing Zheng , Vishal M. Patel , Cheng-Hao Kuo

Dense depth estimation and 3D reconstruction of a surgical scene are crucial steps in computer assisted surgery. Recent work has shown that depth estimation from a stereo images pair could be solved with convolutional neural networks.…

Image and Video Processing · Electrical Eng. & Systems 2021-07-24 Baoru Huang , Jianqing Zheng , Anh Nguyen , David Tuch , Kunal Vyas , Stamatia Giannarou , Daniel S. Elson

Depression is a global mental health problem, the worst case of which can lead to suicide. An automatic depression detection system provides great help in facilitating depression self-assessment and improving diagnostic accuracy. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-17 Ying Shen , Huiyu Yang , Lin Lin

Prior work has shown that analyzing the use of first-person singular pronouns can provide insight into individuals' mental status, especially depression symptom severity. These findings were generated by counting frequencies of first-person…

Computation and Language · Computer Science 2023-10-06 Xinyang Ren , Hannah A Burkhardt , Patricia A Areán , Thomas D Hull , Trevor Cohen

Large scale databases with high-quality manual annotations are scarce in audio domain. We thus explore a self-supervised graph approach to learning audio representations from highly limited labelled data. Considering each audio sample as a…

Machine Learning · Computer Science 2022-11-23 Amir Shirian , Krishna Somandepalli , Tanaya Guha

Linking sheet music images to audio recordings remains a key problem for the development of efficient cross-modal music retrieval systems. One of the fundamental approaches toward this task is to learn a cross-modal embedding space via deep…

Sound · Computer Science 2023-09-22 Luis Carvalho , Tobias Washüttl , Gerhard Widmer

Methods for extracting audio and speech features have been studied since pioneering work on spectrum analysis decades ago. Recent efforts are guided by the ambition to develop general-purpose audio representations. For example, deep neural…

Invariance-based and generative methods have shown a conspicuous performance for 3D self-supervised representation learning (SSRL). However, the former relies on hand-crafted data augmentations that introduce bias not universally applicable…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Naiwen Hu , Haozhe Cheng , Yifan Xie , Shiqi Li , Jihua Zhu

Music Structure Analysis (MSA) aims to uncover the high-level organization of musical pieces. State-of-the-art methods are often based on supervised deep learning, but these methods are bottlenecked by the need for heavily annotated data…

Sound · Computer Science 2026-03-31 Axel Marmoret