English
Related papers

Related papers: Mirror Ritual: An Affective Interface for Emotiona…

200 papers

This work proposes an interactive art installation "Mood spRing" designed to reflect the mood of the environment through interpretation of language and tone. Mood spRing consists of an AI program that controls an immersive 3D animation of…

Human-Computer Interaction · Computer Science 2023-04-03 Nina Marhamati , Sena Clara Creston

Current approaches to empathetic response generation view the set of emotions expressed in the input text as a flat structure, where all the emotions are treated uniformly. We argue that empathetic responses often mimic the emotion of the…

Computation and Language · Computer Science 2020-10-06 Navonil Majumder , Pengfei Hong , Shanshan Peng , Jiankun Lu , Deepanway Ghosal , Alexander Gelbukh , Rada Mihalcea , Soujanya Poria

This work introduces a new music generation system, called AffectMachine-Classical, that is capable of generating affective Classic music in real-time. AffectMachine was designed to be incorporated into biofeedback systems (such as…

Sound · Computer Science 2023-04-12 Kat R. Agres , Adyasha Dash , Phoebe Chua

An important aspect of human conversation difficult for machines is conversing with empathy, which is to understand the user's emotion and respond appropriately. Recent neural conversation models that attempted to generate empathetic…

Computation and Language · Computer Science 2021-12-30 Jamin Shin , Peng Xu , Andrea Madotto , Pascale Fung

The EMPATHIC project aimed to design an emotionally expressive virtual coach capable of engaging healthy seniors to improve well-being and promote independent aging. One of the core aspects of the system is its human sensing capabilities,…

The increasing demand for mental health services has highlighted the need for innovative solutions, particularly in the realm of psychological conversational AI, where the availability of sensitive data is scarce. In this work, we explored…

Human-Computer Interaction · Computer Science 2024-12-31 Alessandro De Grandi , Federico Ravenda , Andrea Raballo , Fabio Crestani

This in-person studio explores how mixed reality (MR) and biometrics can make intangible emotional states tangible through embodied art practices. We begin with two well-established modalities, clay sculpting and free-form 2D drawing, to…

Human-Computer Interaction · Computer Science 2025-12-16 Mahsa Nasri , Mahnoosh Jahanian , Wei Wu , Binyan Xu , Casper Harteveld

As artificial intelligence becomes more and more ingrained in daily life, we present a novel system that uses deep learning for music recommendation and emotion-based detection. Through the use of facial recognition and the DeepFace…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Swetha Kambham , Hubert Jhonson , Sai Prathap Reddy Kambham

We investigated the potential and limitations of generative artificial intelligence (AI) in reflecting the authors' cognitive processes through creative expression. The focus is on the AI-generated artwork's ability to understand human…

Artificial Intelligence · Computer Science 2023-04-27 Yoon Kyung Lee , Yong-Ha Park , Sowon Hahn

We present Lemotif, an integrated natural language processing and image generation system that uses machine learning to (1) parse a text-based input journal entry describing the user's day for salient themes and emotions and (2) visualize…

Human-Computer Interaction · Computer Science 2020-04-02 X. Alice Li , Devi Parikh

This paper introduces CORAE, a novel web-based open-source tool for COntinuous Retrospective Affect Evaluation, designed to capture continuous affect data about interpersonal perceptions in dyadic interactions. Grounded in behavioral…

Human-Computer Interaction · Computer Science 2023-06-30 Michael J. Sack , Maria Teresa Parreira , Jenny Fu , Asher Lipman , Hifza Javed , Nawid Jamali , Malte Jung

The paper describes BIRAFFE2 data set, which is a result of an affective computing experiment conducted between 2019 and 2020, that aimed to develop computer models for classification and recognition of emotion. Such work is important to…

Human-Computer Interaction · Computer Science 2020-11-11 Krzysztof Kutt , Dominika Drążyk , Maciej Szelążek , Szymon Bobek , Grzegorz J. Nalepa

In traditional journaling practices, authors express and process their thoughts by writing them down. We propose a somaesthetic-inspired alternative that uses the human body, rather than written words, as the medium of expression. We coin…

Human-Computer Interaction · Computer Science 2026-01-23 Michael Yin , Robert Xiao , Nadine Wagener

In the field of affective computing, where research continually advances at a rapid pace, the demand for user-friendly tools has become increasingly apparent. In this paper, we present the AffectToolbox, a novel software system that aims to…

Human-Computer Interaction · Computer Science 2024-02-26 Silvan Mertes , Dominik Schiller , Michael Dietz , Elisabeth André , Florian Lingenfelser

Emotion recognition technology is crucial in providing a personalized user experience. It is especially important in virtual reality(VR) to assess the user's emotions to enhance their sense of immersion. We propose an emotion recognition…

Human-Computer Interaction · Computer Science 2019-12-04 Jaehyun Nam , Hyesun Chung , Young ah Seong , Honggu Lee

Facial mimicry - the automatic, unconscious imitation of others' expressions - is vital for emotional understanding. This study investigates how mimicry differs across emotions using Face Action Units from videos and participants'…

Human-Computer Interaction · Computer Science 2025-08-12 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Jung Barrett , Paolo Burelli

This paper introduces a novel method for generating artistic images that express particular affective states. Leveraging state-of-the-art deep learning methods for visual generation (through generative adversarial networks), semantic models…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Theodoros Galanos , Antonios Liapis , Georgios N. Yannakakis

This paper presents a study on the use of a real-time music-to-image system as a mechanism to support and inspire musicians during their creative process. The system takes MIDI messages from a keyboard as input which are then interpreted…

Human-Computer Interaction · Computer Science 2024-07-09 Meng Yang , Maria Teresa Llano , Jon McCormack

Based on recent advances in realistic language modeling (GPT-3) and cross-modal representations (CLIP), Gaud\'i was developed to help designers search for inspirational images using natural language. In the early stages of the design…

Artificial Intelligence · Computer Science 2021-12-09 Victor S. Bursztyn , Jennifer Healey , Vishwa Vinay

While generative AI systems have gained popularity in diverse applications, their potential to produce harmful outputs limits their trustworthiness and usability in different applications. Recent years have seen growing interest in engaging…

Human-Computer Interaction · Computer Science 2025-04-01 Matheus Kunzler Maldaner , Wesley Hanwen Deng , Jason Hong , Ken Holstein , Motahhare Eslami