English
Related papers

Related papers: MindMirror: A Local-First Multimodal State-Aware S…

200 papers

We present Tell Me, a mental well-being system that leverages advances in large language models to provide accessible, context-aware support for users and researchers. The system integrates three components: (i) a retrieval-augmented…

Computation and Language · Computer Science 2025-11-19 Trishala Jayesh Ahalpara

Clinical practice in psychiatry is burdened with the increased demand for healthcare services and the scarce resources available. New paradigms of health data powered with machine learning techniques could open the possibility to improve…

Artificial Intelligence · Computer Science 2023-06-08 Juan Sebastian Canas , Francisco Gomez , Omar Costilla-Reyes

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

We are living in the era of the fourth industrial revolution, which also treated as 4IR or Industry 4.0. Generally, 4IR considered as the mixture of robotics, artificial intelligence (AI), quantum computing, the Internet of Things (IoT) and…

Human-Computer Interaction · Computer Science 2021-03-10 Khandaker Mohammad Mohi Uddin , Samrat Kumar Dey , Gias Uddin Parvez , Ayesha Siddika Mukta , Uzzal Kumar Acharjee

Multimodal Large Language Models (MLLMs) have demonstrated remarkable multimodal emotion recognition capabilities, integrating multimodal cues from visual, acoustic, and linguistic contexts in the video to recognize human emotional states.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Liyun Zhang

Facial action unit (FAU) intensities are popular descriptors for the analysis of facial behavior. However, FAUs are sparsely represented when only a few are activated at a time. In this study, we explore the possibility of representing the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Minh Tran , Ellen Bradley , Michelle Matvey , Joshua Woolley , Mohammad Soleymani

Public speaking anxiety affects many individuals, yet opportunities for real-world practice remain limited. This study explores how augmented reality (AR) can provide an accessible training environment for public speaking. Drawing from…

Human-Computer Interaction · Computer Science 2025-04-16 Mark Edison Jim , Jan Benjamin Yap , Gian Chill Laolao , Andrei Zachary Lim , Jordan Aiko Deja

High-quality dialogue is crucial for e-commerce customer service, yet traditional intent-based systems struggle with dynamic, multi-turn interactions. We present MindFlow+, a self-evolving dialogue agent that learns domain-specific behavior…

Computation and Language · Computer Science 2025-07-28 Ming Gong , Xucheng Huang , Ziheng Xu , Vijayan K. Asari

Reflexion is an AI-powered platform designed to enable structured emotional self-reflection at scale. By integrating real-time emotion detection, layered reflective prompting, and metaphorical storytelling generation, Reflexion empowers…

Human-Computer Interaction · Computer Science 2025-04-30 Shou-Tzu Han

Large language models (LLMs) have rapidly evolved from general-purpose systems to multimodal models capable of processing text, images, and audio. As both general-purpose LLMs (GLLMs) and multimodal LLMs (MLLMs) gain widespread adoption,…

Software Engineering · Computer Science 2026-04-08 Yujian Liu , Xiao Yu , Jacky Keung , Xing Hu , Xin Xia , Xiaoxue Ma

Exposure to disturbing imagery can significantly impact individuals, especially professionals who encounter such content as part of their work. This paper presents a user study, involving 107 participants, predominantly journalists and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ioannis Sarridis , Jochen Spangenberg , Olga Papadopoulou , Symeon Papadopoulos

Post-Traumatic Stress Disorder (PTSD) is fundamentally a neuroplastic problem traumatic contact events encode over-reactive neural pathways through Hebbian long-term potentiation, producing hair-triggered amygdala-HPA stress cascades that…

In today's high-pressure and isolated society, the demand for emotional support has surged, necessitating innovative solutions. Socially Assistive Robots (SARs) offer a technological approach to providing emotional assistance by leveraging…

Robotics · Computer Science 2024-11-11 Leanne Oon Hui Yee , Siew Sui Fun , Thit Sar Zin , Zar Nie Aung , Kian Meng Yap , Jiehan Teoh

This work investigates the use of multimodal biometrics to detect distractions caused by smartphone use during tasks that require sustained attention, with a focus on computer-based online learning. Although the methods are applicable to…

Computers and Society · Computer Science 2025-06-25 Alvaro Becerra , Roberto Daza , Ruth Cobos , Aythami Morales , Mutlu Cukurova , Julian Fierrez

Traditional workflow-based agents exhibit limited intelligence when addressing real-world problems requiring tool invocation. Tool-integrated reasoning (TIR) agents capable of autonomous reasoning and tool invocation are rapidly emerging as…

The development of Large Language Models (LLMs) has primarily been driven by resource-rich research groups and industry partners. Due to the lack of on-premise computing resources required for increasingly complex models, many researchers…

Computation and Language · Computer Science 2026-01-05 Liling Tan

Psychological distress is a significant and growing issue in society. Automatic detection, assessment, and analysis of such distress is an active area of research. Compared to modalities such as face, head, and vocal, research investigating…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Weizhe Lin , Indigo Orton , Qingbiao Li , Gabriela Pavarini , Marwa Mahmoud

The increasing demand for mental health services has highlighted the need for innovative solutions, particularly in the realm of psychological conversational AI, where the availability of sensitive data is scarce. In this work, we explored…

Human-Computer Interaction · Computer Science 2024-12-31 Alessandro De Grandi , Federico Ravenda , Andrea Raballo , Fabio Crestani

Throughout history, a prevailing paradigm in mental healthcare has been one in which distressed people may receive treatment with little understanding around how their experience is perceived by their care provider, and in turn, the…

Human-Computer Interaction · Computer Science 2026-02-23 Sachin R. Pendse , Darren Gergle , Rachel Kornfield , Kaylee Kruzan , David Mohr , Jessica Schleider , Jina Suh , Annie Wescott , Jonah Meyerhoff

Integrating mixed reality (MR) with artificial intelligence (AI) technologies, including vision, language, audio, reasoning, and planning, enables the AI-powered MR assistant [1] to substantially elevate human efficiency. This enhancement…

Human-Computer Interaction · Computer Science 2024-05-10 Yan-Ming Chiou , Bob Price , Chien-Chung Shen , Syed Ali Asif