English
Related papers

Related papers: Leveraging LLMs to Predict Affective States via Sm…

200 papers

This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language models (MLLMs) to predict the emotions evoked by images. Recent user studies report an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Tianwei Chen , Takuya Furusawa , Yuki Hirakawa , Ryotaro Shimizu , Mo Fan , Takashi Wada

The study of how social media affects the formation of public opinion and its influence on political results has been a popular field of inquiry. However, current approaches frequently offer a limited comprehension of the complex political…

Social and Information Networks · Computer Science 2024-05-14 Pratik Gujral , Kshitij Awaldhi , Navya Jain , Bhavuk Bhandula , Abhijnan Chakraborty

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

The versatility of Large Language Models (LLMs) in natural language understanding has made them increasingly popular in mental health research. While many studies explore LLMs' capabilities in emotion recognition, a critical gap remains in…

Computation and Language · Computer Science 2025-09-12 Bangzhao Shu , Isha Joshi , Melissa Karnaze , Anh C. Pham , Ishita Kakkar , Sindhu Kothe , Arpine Hovasapian , Mai ElSherief

Recent work has investigated the capabilities of large language models (LLMs) as zero-shot models for generating individual-level characteristics (e.g., to serve as risk models or augment survey datasets). However, when should a user have…

Notifications are one of the most prevailing mechanisms on smartphones and personal computers to convey timely and important information. Despite these benefits, smartphone notifications demand individuals' attention and can cause stress…

Human-Computer Interaction · Computer Science 2022-07-08 Judith S. Heinisch , Nan Gao , Christoph Anderson , Shohreh Deldari , Klaus David , Flora Salim

Limited access to mental healthcare resources hinders timely depression diagnosis, leading to detrimental outcomes. Social media platforms present a valuable data source for early detection, yet this task faces two significant challenges:…

Computation and Language · Computer Science 2025-10-10 Xiaochong Lan , Zhiguang Han , Yiming Cheng , Li Sheng , Jie Feng , Chen Gao , Yong Li

Speech-based machine learning (ML) has been heralded as a promising solution for tracking prosodic and spectrotemporal patterns in real-life that are indicative of emotional changes, providing a valuable window into one's cognitive and…

Machine Learning · Computer Science 2021-09-08 Kexin Feng , Theodora Chaspari

Data-driven soft sensors are crucial in predicting key performance indicators in industrial systems. However, current methods predominantly rely on the supervised learning paradigms of parameter updating, which inherently faces challenges…

Machine Learning · Computer Science 2025-01-09 Shuo Tong , Han Liu , Runyuan Guo , Wenqing Wang , Xueqiong Tian , Lingyun Wei , Lin Zhang , Huayong Wu , Ding Liu , Youmin Zhang

Recent advancements in large language models (LLMs) have transformed natural language understanding and generation, leading to extensive benchmarking across diverse tasks. However, cryptanalysis - a critical area for data security and its…

Computation and Language · Computer Science 2025-09-18 Utsav Maskey , Chencheng Zhu , Usman Naseem

Can out-of-the-box pretrained Large Language Models (LLMs) detect human affect successfully when observing a video? To address this question, for the first time, we evaluate comprehensively the capacity of popular LLMs for successfully…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 David Melhart , Matthew Barthet , Georgios N. Yannakakis

Subjective well-being is a cornerstone of individual and societal health, yet its scientific measurement has traditionally relied on self-report methods prone to recall bias and high participant burden. This has left a gap in our…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Ming-Zher Poh , Shun Liao , Marco Andreetto , Daniel McDuff , Jonathan Wang , Paolo Di Achille , Jiang Wu , Yun Liu , Lawrence Cai , Eric Teasley , Mark Malhotra , Anupam Pathak , Shwetak Patel

This paper investigates the challenges of affect control in large language models (LLMs), focusing on their ability to express appropriate emotional states during extended dialogues. We evaluated state-of-the-art open-weight LLMs to assess…

Artificial Intelligence · Computer Science 2025-03-05 Gino Franco Fazzi , Julie Skoven Hinge , Stefan Heinrich , Paolo Burelli

Large language models (LLMs) are supposed to acquire unconscious human knowledge and feelings, such as social common sense and biases, by training models from large amounts of text. However, it is not clear how much the sentiments of…

Computation and Language · Computer Science 2024-08-09 Kunitomo Tanaka , Ryohei Sasano , Koichi Takeda

Emotional states, as indicators of affect, are pivotal to overall health, making their accurate prediction before onset crucial. Current studies are primarily centered on immediate short-term affect detection using data from wearable and…

Smart wearables have played an integral part in our day to day life. From recording ECG signals to analysing body fat composition, the smart wearables can do it all. The smart devices encompass various sensors which can be employed to…

Human-Computer Interaction · Computer Science 2022-08-01 Gayathri S , Akshat Anand , Astha Vijayvargiya , Pushpalatha M , Vaishnavi Moorthy , Sumit Kumar , Harichandana B S S

Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the way how humans process…

Computation and Language · Computer Science 2024-08-19 Hao Yang , Yanyan Zhao , Yang Wu , Shilong Wang , Tian Zheng , Hongbo Zhang , Zongyang Ma , Wanxiang Che , Bing Qin

Digital phenotyping in mental health often consists of collecting behavioral and experience-based information through sensory and self-reported data from devices such as smartphones. Such rich and comprehensive data could be used to develop…

Social and Information Networks · Computer Science 2023-12-05 Andy Davies , Eiko Fried , Hane Aung , Omar Costilla-Reyes

This paper investigates algorithmic bias in language-based models for automated depression detection, focusing on socio-demographic disparities related to gender and race/ethnicity. Models trained using deep neural networks (DNN) based…

Computation and Language · Computer Science 2026-01-28 Obed Junias , Prajakta Kini , Theodora Chaspari

This work investigates the capabilities of large language models (LLMs) in detecting and understanding human emotions through text. Drawing upon emotion models from psychology, we adopt an interdisciplinary perspective that integrates…

Computation and Language · Computer Science 2025-03-10 Florian Lecourt , Madalina Croitoru , Konstantin Todorov