English
Related papers

Related papers: MindMirror: A Local-First Multimodal State-Aware S…

200 papers

Multiple cognitive theories -- Global Workspace Theory, reconstructive episodic memory, inner speech, and complementary learning systems -- converge on a shared set of architectural principles: parallel specialized processing, integrative…

Artificial Intelligence · Computer Science 2026-04-21 Nicole Hsing

Faces and humans are crucial elements in social interaction and are widely included in everyday photos and videos. Therefore, a deep understanding of faces and humans will enable multi-modal assistants to achieve improved response quality…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Lixiong Qin , Shilong Ou , Miaoxuan Zhang , Jiangning Wei , Yuhang Zhang , Xiaoshuai Song , Yuchen Liu , Mei Wang , Weiran Xu

In this paper, we present SAFER, a novel system for emotion recognition from facial expressions. It employs state-of-the-art deep learning techniques to extract various features from facial images and incorporates contextual information,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Mijanur Palash , Bharat Bhargava

In the current age, human lifestyle has become more knowledge oriented leading to generation of sedentary employment. This has given rise to a number of health and mental disorders. Mental wellness is one of the most neglected but crucial…

Machine Learning · Computer Science 2023-06-19 Rahee Walambe , Pranav Nayak , Ashmit Bhardwaj , Ketan Kotecha

The world's healthcare systems and mental health agencies face both a growing demand for youth mental health services, alongside a simultaneous challenge of limited resources. Here, we focus on frontline crisis support, where Crisis…

Traditional screening practices for anxiety and depression pose an impediment to monitoring and treating these conditions effectively. However, recent advances in NLP and speech modelling allow textual, acoustic, and hand-crafted…

Sound · Computer Science 2023-01-02 Brian Diep , Marija Stanojevic , Jekaterina Novikova

Complex tasks involving tool integration pose significant challenges for Large Language Models (LLMs), leading to the emergence of multi-agent workflows as a promising solution. Reflection has emerged as an effective strategy for correcting…

Artificial Intelligence · Computer Science 2025-06-06 Zikang Guo , Benfeng Xu , Xiaorui Wang , Zhendong Mao

People often find it difficult to turn their intentions into real actions -- a challenge that affects both personal growth and mental well-being. While established methods like cognitive-behavioral therapy and mindfulness training help…

Human-Computer Interaction · Computer Science 2025-02-05 Cathy Mengying Fang , Yasith Samaradivakara , Pattie Maes , Suranga Nanayakkara

We investigate the impact of a novel method called "virtual mirroring" to promote employee self-reflection and impact customer satisfaction. The method is based on measuring communication patterns, through social network and semantic…

Social and Information Networks · Computer Science 2021-05-21 P. Gloor , A. Fronzetti Colladon , G. Giacomelli , T. Saran , F. Grippa

As we build towards developing interactive systems that can recognize human emotional states and respond to individual needs more intuitively and empathetically in more personalized and context-aware computing time. This is especially…

Human-Computer Interaction · Computer Science 2024-06-25 Rahul Islam , Sang Won Bae

In the context of education technology, empathic interaction with the user and feedback by the learning system using multiple inputs such as video, voice and text inputs is an important area of research. In this paper, a nonintrusive,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 S L Happy , A. Dasgupta , P. Patnaik , A. Routray

Building effective LLM agents increasingly requires selecting appropriate AI models as tools from large open repositories (e.g., HuggingFace with > 2M models) based on natural language requests. Unlike invoking a fixed set of API tools,…

Artificial Intelligence · Computer Science 2026-02-10 Shaoyin Ma , Chenggong Hu , Huiqiong Wang , Li Sun , Mingli Song , Jie Song

We introduce MIRROR, a benchmark comprising eight experiments across four metacognitive levels that evaluates whether large language models can use self-knowledge to make better decisions. We evaluate 16 models from 8 labs across…

Artificial Intelligence · Computer Science 2026-04-23 Jason Z Wang

Brain-Machine Interaction (BMI) system motivates interesting and promising results in forward/feedback control consistent with human intention. It holds great promise for advancements in patient care and applications to neurorehabilitation.…

Human-Computer Interaction · Computer Science 2017-11-21 Reza Abiri , Soheil Borhani , Xiaopeng Zhao , Yang Jiang

Existing digital mental wellness tools often overlook the nuanced emotional states underlying everyday challenges. For example, pre-sleep anxiety affects more than 1.5 billion people worldwide, yet current approaches remain largely static…

Machine Learning · Computer Science 2025-09-22 Xinchen Wan , Jinhua Liang , Huan Zhang

Whereas most brain-computer interface research has focused on decoding neural signals into behavior or intent, the reverse challenge-using controlled stimuli to steer brain activity-remains far less understood, particularly in the visual…

Neural and Evolutionary Computing · Computer Science 2026-03-03 Dongyang Li , Kunpeng Xie , Mingyang Wu , Yiwei Kong , Jiahua Tang , Haoyang Qin , Chen Wei , Quanying Liu

This work aims to create a multimodal AI system that chats with humans and shares relevant photos. While earlier works were limited to dialogues about specific objects or scenes within images, recent works have incorporated images into…

Computation and Language · Computer Science 2023-05-08 Min Young Lee

Designing 3D User Interfaces (UI) requires adequate evaluation tools to ensure good usability and user experience. While many evaluation tools are already available and widely used, existing approaches generally cannot provide continuous…

Human-Computer Interaction · Computer Science 2015-06-01 Dennis Wobrock , Jérémy Frey , Delphine Graeff , Jean-Baptiste De La Rivière , Julien Castet , Fabien Lotte

Multimodal large language models (MLLMs) have shown remarkable performance in vision-language tasks. However, existing MLLMs are primarily trained on generic datasets, limiting their ability to reason on domain-specific visual cues such as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Hatef Otroshi Shahreza , Sébastien Marcel

Support-seekers' self-disclosure of their suffering experiences, thoughts, and feelings in the post can help them get needed peer support in online mental health communities (OMHCs). However, such mental health self-disclosure could be…

Human-Computer Interaction · Computer Science 2024-09-24 Han Zhang , Jiaqi Zhang , Yuxiang Zhou , Ryan Louie , Taewook Kim , Qingyu Guo , Shuailin Li , Zhenhui Peng