English
Related papers

Related papers: Multimodal Emoji Prediction

200 papers

Authors of posts in social media communicate their emotions and what causes them with text and images. While there is work on emotion and stimulus detection for each modality separately, it is yet unknown if the modalities contain…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Anna Khlyzova , Carina Silberer , Roman Klinger

Online writing lacks the non-verbal cues present in face-to-face communication, which provide additional contextual information about the utterance, such as the speaker's intention or affective state. To fill this void, a number of…

Computation and Language · Computer Science 2015-10-30 Umashanthi Pavalanathan , Jacob Eisenstein

We propose a novel approach to multimodal sentiment analysis using deep neural networks combining visual analysis and natural language processing. Our goal is different than the standard sentiment analysis goal of predicting whether a…

Machine Learning · Statistics 2018-05-28 Anthony Hu , Seth Flaxman

In the absence of nonverbal cues during messaging communication, users express part of their emotions using emojis. Thus, having emojis in the vocabulary of text messaging language models can significantly improve many natural language…

Computation and Language · Computer Science 2022-09-21 Moeen Mostafavi , Mahsa Pahlavikhah Varnosfaderani , Fateme Nikseresht , Seyed Ahmad Mansouri

We widely use emojis in social networking to heighten, mitigate or negate the sentiment of the text. Emoji suggestions already exist in many cross-platform applications but an emoji is predicted solely based a few prominent words instead of…

Computation and Language · Computer Science 2021-03-16 Pranav Venkit , Zeba Karishma , Chi-Yang Hsu , Rahul Katiki , Kenneth Huang , Shomir Wilson , Patrick Dudas

Emojis are being frequently used in todays digital world to express from simple to complex thoughts more than ever before. Hence, they are also being used in sentiment analysis and targeted marketing campaigns. In this work, we performed…

Computation and Language · Computer Science 2025-02-20 Sirisha Velampalli , Chandrashekar Muniyappa , Ashutosh Saxena

Emojis come with prepacked semantics making them great candidates to create new forms of more accessible communications. Yet, little is known about how much of this emojis semantic is agreed upon by humans, outside of textual contexts.…

Computation and Language · Computer Science 2022-04-06 Justyna Czestochowska , Kristina Gligoric , Maxime Peyrard , Yann Mentha , Michal Bien , Andrea Grutter , Anita Auer , Aris Xanthos , Robert West

With the rapid development of the internet, online social media welcomes people with different backgrounds through its diverse content. The increasing usage of emoji becomes a noticeable trend thanks to emoji's rich information beyond…

Computation and Language · Computer Science 2023-11-06 Letian Peng , Zilong Wang , Hang Liu , Zihan Wang , Jingbo Shang

Emojis, as a new way of conveying nonverbal cues, are widely adopted in computer-mediated communications. In this paper, first from a message sender perspective, we focus on people's motives in using four types of emojis -- positive,…

Computation and Language · Computer Science 2017-03-09 Tianran Hu , Han Guo , Hao Sun , Thuy-vy Thi Nguyen , Jiebo Luo

Prosodic features such as pitch, timing, and intonation are central to spoken communication, conveying emotion, intent, and discourse structure. In text-based settings, where these cues are absent, emojis act as visual surrogates that add…

Computation and Language · Computer Science 2025-08-04 Giulio Zhou , Tsz Kin Lam , Alexandra Birch , Barry Haddow

Emojis have become ubiquitous in online communication, serving as a universal medium to convey emotions and decorative elements. Their widespread use transcends language and cultural barriers, enhancing understanding and fostering more…

Computation and Language · Computer Science 2024-12-24 Rafid Ishrak Jahan , Heng Fan , Haihua Chen , Yunhe Feng

Emojis, which encapsulate semantics beyond mere words or phrases, have become prevalent in social network communications. This has spurred increasing scholarly interest in exploring their attributes and functionalities. However,…

Computation and Language · Computer Science 2025-04-08 Yuhang Zhou , Paiheng Xu , Xiyao Wang , Xuan Lu , Ge Gao , Wei Ai

With the explosive growth of social media, opinionated postings with emojis have increased explosively. Many emojis are used to express emotions, attitudes, and opinions. Emoji representation learning can be helpful to improve the…

Computation and Language · Computer Science 2022-05-24 Xiaowei Yuan , Jingyuan Hu , Xiaodan Zhang , Honglei Lv

Emoji reactions are a frequently used feature of messaging platforms, yet their communicative role remains understudied. Prior work on emojis has focused predominantly on in-text usage, showing that emojis embedded in messages tend to…

Human-Computer Interaction · Computer Science 2025-12-22 Serena Tardelli , Lorenzo Alvisi , Lorenzo Cima , Stefano Cresci , Maurizio Tesconi

Computing author intent from multimodal data like Instagram posts requires modeling a complex relationship between text and image. For example, a caption might evoke an ironic contrast with the image, so neither caption nor image is a mere…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Julia Kruk , Jonah Lubin , Karan Sikka , Xiao Lin , Dan Jurafsky , Ajay Divakaran

Emojis have been widely used in textual communications as a new way to convey nonverbal cues. An interesting observation is the various emoji usage patterns among different users. In this paper, we investigate the correlation between user…

Social and Information Networks · Computer Science 2018-04-17 Weijian Li , Yuxiao Chen , Tianran Hu , Jiebo Luo

Online media, such as blogs and social networking sites, generate massive volumes of unstructured data of great interest to analyze the opinions and sentiments of individuals and organizations. Novel approaches beyond Natural Language…

With the prevalence of instant messaging and social media platforms, emojis have become important artifacts for expressing emotions and feelings in our daily lives. We ask how HCI researchers have examined the role and evolution of emojis…

Human-Computer Interaction · Computer Science 2024-09-27 Charles Chiang , Diego Gomez-Zara

Emoji have grown to become one of the most important forms of communication on the web. With its widespread use, measuring the similarity of emoji has become an important problem for contemporary text processing since it lies at the heart…

Computation and Language · Computer Science 2017-07-18 Sanjaya Wijeratne , Lakshika Balasuriya , Amit Sheth , Derek Doran

Based on a large data set of emoji using behavior collected from smartphone users over the world, this paper investigates gender-specific usage of emojis. We present various interesting findings that evidence a considerable difference in…

Human-Computer Interaction · Computer Science 2018-04-27 Zhenpeng Chen , Xuan Lu , Wei Ai , Huoran Li , Qiaozhu Mei , Xuanzhe Liu