English
Related papers

Related papers: Enhancing Multimodal Affective Analysis with Learn…

200 papers

Human affect recognition is a well-established research area with numerous applications, e.g., in psychological care, but existing methods assume that all emotions-of-interest are given a priori as annotated training examples. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Kunyu Peng , Alina Roitberg , David Schneider , Marios Koulakis , Kailun Yang , Rainer Stiefelhagen

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

We tackle the crucial challenge of fusing different modalities of features for multimodal sentiment analysis. Mainly based on neural networks, existing approaches largely model multimodal interactions in an implicit and hard-to-understand…

Multimedia · Computer Science 2021-03-23 Qiuchi Li , Dimitris Gkoumas , Christina Lioma , Massimo Melucci

Emotion plays an important role in detecting fake news online. When leveraging emotional signals, the existing methods focus on exploiting the emotions of news contents that conveyed by the publishers (i.e., publisher emotion). However,…

Computation and Language · Computer Science 2021-02-16 Xueyao Zhang , Juan Cao , Xirong Li , Qiang Sheng , Lei Zhong , Kai Shu

NLP tasks are often limited by scarcity of manually annotated data. In social media sentiment analysis and related tasks, researchers have therefore used binarized emoticons and specific hashtags as forms of distant supervision. Our paper…

Machine Learning · Statistics 2019-11-19 Bjarke Felbo , Alan Mislove , Anders Søgaard , Iyad Rahwan , Sune Lehmann

This paper learns multi-modal embeddings from text, audio, and video views/modes of data in order to improve upon down-stream sentiment classification. The experimental framework also allows investigation of the relative contributions of…

Information Retrieval · Computer Science 2019-07-23 Zhongkai Sun , Prathusha K Sarma , William Sethares , Erik P. Bucy

Understanding emotions accurately is essential for fields like human-computer interaction. Due to the complexity of emotions and their multi-modal nature (e.g., emotions are influenced by facial expressions and audio), researchers have…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Qize Yang , Detao Bai , Yi-Xing Peng , Xihan Wei

In the realm of emotion synthesis, the ability to create authentic and nuanced facial expressions continues to gain importance. The GANmut study discusses a recently introduced advanced GAN framework that, instead of relying on predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Maria Surani

With the rapid development of the internet, the richness of User-Generated Contentcontinues to increase, making Multimodal Aspect-Based Sentiment Analysis (MABSA) a research hotspot. Existing studies have achieved certain results in MABSA,…

Artificial Intelligence · Computer Science 2024-10-21 Xiaoyong Huang , Heli Sun , Qunshu Gao , Wenjie Huang , Ruichen Cao

Given the massive market of advertising and the sharply increasing online multimedia content (such as videos), it is now fashionable to promote advertisements (ads) together with the multimedia content. It is exhausted to find relevant ads…

Multimedia · Computer Science 2020-01-06 Huaizheng Zhang , Yong Luo , Qiming Ai , Yonggang Wen

Sentiment analysis is a well-known natural language processing task that involves identifying the emotional tone or polarity of a given piece of text. With the growth of social media and other online platforms, sentiment analysis has become…

Computation and Language · Computer Science 2023-07-03 Mohammad Belal , James She , Simon Wong

Assessing smile genuineness from video sequences is a vital topic concerned with recognizing facial expression and linking them with the underlying emotional states. There have been a number of techniques proposed underpinned with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Benedykt Pawlus , Bogdan Smolka , Jolanta Kawulok , Michal Kawulok

Emotionally annotated databases are repositories of multimedia documents with annotated affective content that elicit emotional responses in exposed human subjects. They are primarily used in research of human emotions, attention and…

Human-Computer Interaction · Computer Science 2012-12-04 Marko Horvat , Siniša Popović , Krešimir Ćosić

Multimodal Sentiment Analysis leverages multimodal signals to detect the sentiment of a speaker. Previous approaches concentrate on performing multimodal fusion and representation learning based on general knowledge obtained from pretrained…

Artificial Intelligence · Computer Science 2023-06-29 Yakun Yu , Mingjun Zhao , Shi-ang Qi , Feiran Sun , Baoxun Wang , Weidong Guo , Xiaoli Wang , Lei Yang , Di Niu

User reviews on e-commerce platforms exhibit dynamic sentiment patterns driven by temporal and contextual factors. Traditional sentiment analysis methods focus on static reviews, failing to capture the evolving temporal relationship between…

Computation and Language · Computer Science 2025-06-18 Xin Zhang , Qiyu Wei , Yingjie Zhu , Linhai Zhang , Deyu Zhou , Sophia Ananiadou

Instant messaging is one of the major channels of computer mediated communication. However, humans are known to be very limited in understanding others' emotions via text-based communication. Aiming on introducing emotion sensing…

Computation and Language · Computer Science 2017-02-10 Chieh-Yang Huang , Ting-Hao , Huang , Lun-Wei Ku

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Sentiment analysis, also referred to as opinion mining, primarily tries to extract opinion from any text-based data. In the context of movie reviews and critics, sentimental analysis can be a helpful tool to predict whether a movie review…

Computation and Language · Computer Science 2026-05-22 Dip Biswas Shanto , Mitali Yadav , Prajwal Panth , Suresh Chandra Satapathy

People come to social media to satisfy a variety of needs, such as being informed, entertained and inspired, or connected to their friends and community. Hence, to design a ranking function that gives useful and personalized post…

Social and Information Networks · Computer Science 2022-06-27 Jane Dwivedi-Yu , Yi-Chia Wang , Lijing Qin , Cristian Canton-Ferrer , Alon Y. Halevy

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu