English
Related papers

Related papers: Detecting depression in dyadic conversations with …

200 papers

Automatic depression detection provides cues for early clinical intervention by clinicians. Clinical interviews for depression detection involve dialogues centered around multiple themes. Existing studies primarily design end-to-end neural…

Computation and Language · Computer Science 2025-08-12 Xianbing Zhao , Yiqing Lyu , Di Wang , Buzhou Tang

Multimodal sentiment analysis aims to identify the emotions expressed by individuals through visual, language, and acoustic cues. However, most existing research assume that all modalities are available during both training and testing,…

Sound · Computer Science 2026-04-21 Weide Liu , Huijing Zhan

Individual's general well-being is greatly impacted by mental health conditions including depression and Post-Traumatic Stress Disorder (PTSD), underscoring the importance of early detection and precise diagnosis in order to facilitate…

Machine Learning · Computer Science 2025-02-07 Himanshi Singh , Sadhana Tiwari , Sonali Agarwal , Ritesh Chandra , Sanjay Kumar Sonbhadra , Vrijendra Singh

Many professional services are provided through text and voice systems, from voice calls over the internet to messaging and emails. There is a growing need for both individuals and organizations to understand these online conversations…

Human-Computer Interaction · Computer Science 2019-05-16 Joshua Y. Kim , Rafael A. Calvo , Kalina Yacef , N. J. Enfield

Behavioral cues play a significant part in human communication and cognitive perception. In most professional domains, employee recruitment policies are framed such that both professional skills and personality traits are adequately…

Machine Learning · Computer Science 2020-06-17 Anumeha Agrawal , Rosa Anil George , Selvan Sunitha Ravi , Sowmya Kamath S , Anand Kumar M

Social interactions dominate our perceptions of the world and shape our daily behavior by attaching social meaning to acts as simple and spontaneous as gestures, facial expressions, voice, and speech. People mimic and otherwise respond to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Xiang Zhang , Xiaotian Li , Taoyue Wang , Nan Bi , Xin Zhou , Cody Zhou , Zoie Wang , Andrew Yang , Yuming Su , Jeff Cohn , Qiang Ji , Lijun Yin

Traditional screening practices for anxiety and depression pose an impediment to monitoring and treating these conditions effectively. However, recent advances in NLP and speech modelling allow textual, acoustic, and hand-crafted…

Sound · Computer Science 2023-01-02 Brian Diep , Marija Stanojevic , Jekaterina Novikova

Humans express feelings or emotions via different channels. Take language as an example, it entails different sentiments under different visual-acoustic contexts. To precisely understand human intentions as well as reduce the…

Artificial Intelligence · Computer Science 2021-11-17 Ting Wu , Junjie Peng , Wenqiang Zhang , Huiran Zhang , Chuanshuai Ma , Yansong Huang

In this study, we focus on automated approaches to detect depression from clinical interviews using multi-modal machine learning (ML). Our approach differentiates from other successful ML methods such as context-aware analysis through…

Machine Learning · Computer Science 2024-12-30 Genevieve Lam , Huang Dongyan , Weisi Lin

We propose a novel approach to multimodal sentiment analysis using deep neural networks combining visual analysis and natural language processing. Our goal is different than the standard sentiment analysis goal of predicting whether a…

Machine Learning · Statistics 2018-05-28 Anthony Hu , Seth Flaxman

Different from the emotion recognition in individual utterances, we propose a multimodal learning framework using relation and dependencies among the utterances for conversational emotion analysis. The attention mechanism is applied to the…

Computation and Language · Computer Science 2019-10-25 Zheng Lian , Jianhua Tao , Bin Liu , Jian Huang

Automatic depression detection has attracted increasing amount of attention but remains a challenging task. Psychological research suggests that depressive mood is closely related with emotion expression and perception, which motivates the…

Computation and Language · Computer Science 2022-11-18 Wen Wu , Mengyue Wu , Kai Yu

Depression is one of the most prevalent mental health disorders globally. In recent years, multi-modal data, such as speech, video, and transcripts, has been increasingly used to develop AI-assisted depression assessment systems. Large…

Depression is a widespread mental health disorder, yet its automatic detection remains challenging. Prior work has explored unimodal and multimodal approaches, with multimodal systems showing promise by leveraging complementary signals.…

Artificial Intelligence · Computer Science 2026-03-24 Annisaa Fitri Nurfidausi , Eleonora Mancini , Paolo Torroni

Depression has been the leading cause of mental-health illness worldwide. Major depressive disorder (MDD), is a common mental health disorder that affects both psychologically as well as physically which could lead to loss of lives. Due to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Anupama Ray , Siddharth Kumar , Rutvik Reddy , Prerana Mukherjee , Ritu Garg

Characterising how we verbalise our feelings is central to psychological assessment and intervention, yet the mapping between narrative and affective state remains poorly understood. Across two large studies (n=1257), we parameterised the…

Computation and Language · Computer Science 2026-05-22 Jakub Onysk , Quentin J. M. Huys

Automated depression diagnosis aims to analyze multimodal information from interview videos to predict participants' depression scores. Previous studies often lack clear explanations of how these scores were determined, limiting their…

Artificial Intelligence · Computer Science 2026-03-19 Wei Zhang , Juan Chen , En Zhu , Wenhong Cheng , YunPeng Li , Yanbo J. Wang

Depression is a serious mental illness that impacts the way people communicate, especially through their emotions, and, allegedly, the way they interact with others. This work examines depression signals in dialogs, a less studied setting…

Computation and Language · Computer Science 2022-08-23 Chuyuan Li , Chloé Braud , Maxime Amblard

Advances in data collection enable the capture of rich patient-generated data: from passive sensing (e.g., wearables and smartphones) to active self-reports (e.g., cross-sectional surveys and ecological momentary assessments). Although…

Multimodal sentiment analysis aims to recognize people's attitudes from multiple communication channels such as verbal content (i.e., text), voice, and facial expressions. It has become a vibrant and important research topic in natural…

Machine Learning · Computer Science 2022-02-23 Xingbo Wang , Jianben He , Zhihua Jin , Muqiao Yang , Yong Wang , Huamin Qu