English
Related papers

Related papers: Meme Similarity and Emotion Detection using Multim…

200 papers

The task of the emotion recognition in the wild (EmotiW) Challenge is to assign one of seven emotions to short video clips extracted from Hollywood style movies. The videos depict acted-out emotions under realistic conditions with a large…

Users from the online environment can create different ways of expressing their thoughts, opinions, or conception of amusement. Internet memes were created specifically for these situations. Their main purpose is to transmit ideas by using…

Computation and Language · Computer Science 2020-11-11 George-Alexandru Vlad , George-Eduard Zaharia , Dumitru-Clementin Cercel , Costin-Gabriel Chiru , Stefan Trausan-Matu

Emotion recognition is involved in several real-world applications. With an increase in available modalities, automatic understanding of emotions is being performed more accurately. The success in Multimodal Emotion Recognition (MER),…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Riccardo Franceschini , Enrico Fini , Cigdem Beyan , Alessandro Conti , Federica Arrigoni , Elisa Ricci

Analyzing memes on the internet has emerged as a crucial endeavor due to the impact this multi-modal form of content wields in shaping online discourse. Memes have become a powerful tool for expressing emotions and sentiments, possibly even…

Trends and opinion mining in social media increasingly focus on novel interactions involving visual media, like images and short videos, in addition to text. In this work, we tackle the problem of visual sentiment analysis of social media…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Alessio Serra , Fabio Carrara , Maurizio Tesconi , Fabrizio Falchi

Automatic emotion recognition is a challenging task. In this paper, we present our effort for the audio-video based sub-challenge of the Emotion Recognition in the Wild (EmotiW) 2018 challenge, which requires participants to assign a single…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Zheng Lian , Ya Li , Jianhua Tao , Jian Huang

We present our submission to the Hume-ABAW10 Emotional Mimicry Intensity (EMI) Challenge, which aims to predict six continuous emotion intensity dimensions: Admiration, Amusement, Determination, Empathic Pain, Excitement, and Joy, from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Dinithi Dissanayake , Shaveen Silva , Ovindu Atukorala , Prasanth Sasikumar , Suranga Nanayakkara

Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the way how humans process…

Computation and Language · Computer Science 2024-08-19 Hao Yang , Yanyan Zhao , Yang Wu , Shilong Wang , Tian Zheng , Hongbo Zhang , Zongyang Ma , Wanxiang Che , Bing Qin

Memes are one of the most popular types of content used in an online disinformation campaign. They are primarily effective on social media platforms since they can easily reach many users. Memes in a disinformation campaign achieve their…

Computation and Language · Computer Science 2024-04-09 Shreenaga Chikoti , Shrey Mehta , Ashutosh Modi

Multimodal sentiment analysis aims to recognize people's attitudes from multiple communication channels such as verbal content (i.e., text), voice, and facial expressions. It has become a vibrant and important research topic in natural…

Machine Learning · Computer Science 2022-02-23 Xingbo Wang , Jianben He , Zhihua Jin , Muqiao Yang , Yong Wang , Huamin Qu

This paper addresses the question of emotion classification. The task consists in predicting emotion labels (taken among a set of possible labels) best describing the emotions contained in short video clips. Building on a standard framework…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Valentin Vielzeuf , Stéphane Pateux , Frédéric Jurie

This work investigates the challenging task of identifying narrative roles - Hero, Villain, Victim, and Other - in Internet memes, across three diverse test sets spanning English and code-mixed (English-Hindi) languages. Building on an…

Computation and Language · Computer Science 2025-07-01 Shivam Sharma , Tanmoy Chakraborty

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

Multimedia · Computer Science 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

Social media has created a global network where people can easily access and exchange vast information. This information gives rise to a variety of opinions, reflecting both positive and negative viewpoints. GIFs stand out as a multimedia…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Aditi Aggarwal , Deepika Varshney , Saurabh Patel

Emotional expressiveness captures the extent to which a person tends to outwardly display their emotions through behavior. Due to the close relationship between emotional expressiveness and behavioral health, as well as the crucial role…

Human-Computer Interaction · Computer Science 2020-09-02 Victoria Lin , Jeffrey M. Girard , Michael A. Sayette , Louis-Philippe Morency

Multimodal emotion recognition plays a key role in many domains, including mental health monitoring, educational interaction, and human-computer interaction. However, existing methods often face three major challenges: unbalanced category…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Feng Li , Ke Wu , Yongwei Li

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Over the past years, memes have evolved from being exclusively a medium of humorous exchanges to one that allows users to express a range of emotions freely and easily. With the ever-growing utilization of memes in expressing depressive…

Computation and Language · Computer Science 2026-01-01 Siddhant Agarwal , Adya Dhuler , Polly Ruhnke , Melvin Speisman , Md Shad Akhtar , Shweta Yadav

In recent years, Internet memes have been widely used in online chatting. Compared with text-based communication, conversations become more expressive and attractive when Internet memes are incorporated. This paper presents our solutions…

Computation and Language · Computer Science 2022-03-09 Hua Lu , Zhen Guo , Chanjuan Li , Yunyi Yang , Huang He , Siqi Bao