English
Related papers

Related papers: Emolysis: A Multimodal Open-Source Group Emotion A…

200 papers

We describe OHBA Software Library for the analysis of electrophysiological data (osl-ephys). This toolbox builds on top of the widely used MNE-Python package and provides unique analysis tools for magneto-/electro-encephalography (M/EEG)…

Quantitative Methods · Quantitative Biology 2024-10-30 Mats W. J. van Es , Chetan Gohil , Andrew J. Quinn , Mark W. Woolrich

Due to the lack of large-scale datasets, the prevailing approach in visual sentiment analysis is to leverage models trained for object classification in large datasets like ImageNet. However, objects are sentiment neutral which hinders the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Ziad Al-Halah , Andrew Aitken , Wenzhe Shi , Jose Caballero

Existing 3D facial emotion modeling have been constrained by limited emotion classes and insufficient datasets. This paper introduces "Emo3D", an extensive "Text-Image-Expression dataset" spanning a wide spectrum of human emotions, each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Mahshid Dehghani , Amirahmad Shafiee , Ali Shafiei , Neda Fallah , Farahmand Alizadeh , Mohammad Mehdi Gholinejad , Hamid Behroozi , Jafar Habibi , Ehsaneddin Asgari

Current approaches to empathetic response generation view the set of emotions expressed in the input text as a flat structure, where all the emotions are treated uniformly. We argue that empathetic responses often mimic the emotion of the…

Computation and Language · Computer Science 2020-10-06 Navonil Majumder , Pengfei Hong , Shanshan Peng , Jiankun Lu , Deepanway Ghosal , Alexander Gelbukh , Rada Mihalcea , Soujanya Poria

Designing emotionally intelligent conversational systems to provide comfort and advice to people experiencing distress is a compelling area of research. Recently, with advancements in large language models (LLMs), end-to-end dialogue agents…

Computation and Language · Computer Science 2025-11-13 Chenwei Wan , Matthieu Labeau , Chloé Clavel

The EmoPain 2020 Challenge is the first international competition aimed at creating a uniform platform for the comparison of machine learning and multimedia processing methods of automatic chronic pain assessment from human expressive…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Joy O. Egede , Siyang Song , Temitayo A. Olugbade , Chongyang Wang , Amanda Williams , Hongying Meng , Min Aung , Nicholas D. Lane , Michel Valstar , Nadia Bianchi-Berthouze

Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the goal of enabling more natural and effective human-computer…

Machine Learning · Computer Science 2024-12-11 Fei Ma , Yukan Li , Yifan Xie , Ying He , Yi Zhang , Hongwei Ren , Zhou Liu , Wei Yao , Fuji Ren , Fei Richard Yu , Shiguang Ni

Internet memes are a central element of online culture, blending images and text. While substantial research has focused on either the visual or textual components of memes, little attention has been given to their interplay. This gap…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Aidos Konyspay , Pakizar Shamoi , Malika Ziyada , Zhusup Smambayev

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Emotional Support Conversation (ESC) is a typical dialogue that can effectively assist the user in mitigating emotional pressures. However, owing to the inherent subjectivity involved in analyzing emotions, current non-artificial…

Computation and Language · Computer Science 2024-08-05 Huaiwen Zhang , Yu Chen , Ming Wang , Shi Feng

With the explosive growth of social media, opinionated postings with emojis have increased explosively. Many emojis are used to express emotions, attitudes, and opinions. Emoji representation learning can be helpful to improve the…

Computation and Language · Computer Science 2022-05-24 Xiaowei Yuan , Jingyuan Hu , Xiaodan Zhang , Honglei Lv

In a world where technology is increasingly embedded in our everyday experiences, systems that sense and respond to human emotions are elevating digital interaction. At the intersection of artificial intelligence and human-computer…

Human-Computer Interaction · Computer Science 2025-05-06 Karishma Hegde , Hemadri Jayalath

Recognising emotions in context involves identifying an individual's apparent emotions while considering contextual cues from the surrounding scene. Previous approaches to this task have typically designed explicit scene-encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Alexandros Xenos , Niki Maria Foteinopoulou , Ioanna Ntinou , Ioannis Patras , Georgios Tzimiropoulos

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

Understanding how online communities discuss and make sense of complex social issues is a central challenge in social media research, yet existing tools for large-scale discourse analysis are often closed-source, difficult to adapt, or…

Social and Information Networks · Computer Science 2026-02-10 Stephanie Birkelbach , Maria Teleki , Peter Carragher , Xiangjue Dong , Nehul Bhatnagar , James Caverlee

Emotion is well-recognized as a distinguished symbol of human beings, and it plays a crucial role in our daily lives. Existing vision-based or sensor-based solutions are either obstructive to use or rely on specialized hardware, hindering…

Human-Computer Interaction · Computer Science 2019-08-28 Yu Gu , Yantong Wang , Tao Liu , Yusheng Ji , Zhi Liu , Peng Li , Xiaoyan Wang , Xin An , Fuji Ren

This paper describes the design and functionality of ConvoKit, an open-source toolkit for analyzing conversations and the social interactions embedded within. ConvoKit provides an unified framework for representing and manipulating…

Computation and Language · Computer Science 2020-05-12 Jonathan P. Chang , Caleb Chiam , Liye Fu , Andrew Z. Wang , Justine Zhang , Cristian Danescu-Niculescu-Mizil

Twitter is one of the popular social media platforms where people share news or reactions towards an event or topic using short text messages called "tweets". Emotion analysis in these tweets can play a vital role in understanding peoples'…

Human-Computer Interaction · Computer Science 2023-09-12 Ilya Nemtsov , MST Jasmine Jahan , Chuting Yan , Shah Rukh Humayoun

Multimodal Emotion Recognition (MER) increasingly depends on fine grained, evidence grounded annotations, yet inspection and label construction are hard to scale when cues are dynamic and misaligned across modalities. We present an…

Human-Computer Interaction · Computer Science 2026-03-04 Zheyuan Kuang , Weiwei Jiang , Nicholas Koemel , Matthew Ahmadi , Emmanuel Stamatakis , Benjamin Tag , Anusha Withana , Zhanna Sarsenbayeva

Analyzing individual emotions during group conversation is crucial in developing intelligent agents capable of natural human-machine interaction. While reliable emotion recognition techniques depend on different modalities (text, audio,…