English
Related papers

Related papers: DravidianMultiModality: A Dataset for Multi-modal …

200 papers

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Despite the abundance of current researches working on the sentiment analysis from videos and audios, finding the best model that gives the highest accuracy rate is still considered a challenge for researchers in this field. The main…

Sound · Computer Science 2024-12-13 Antonio Fernandez , Suzan Awinat

Emotional expressions form a key part of user behavior on today's digital platforms. While multimodal emotion recognition techniques are gaining research attention, there is a lack of deeper understanding on how visual and non-visual…

Multimedia · Computer Science 2021-07-01 Prasanta Bhattacharya , Raj Kumar Gupta , Yinping Yang

The continuous improvement of human-computer interaction technology makes it possible to compute emotions. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). Sentiment…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tao Shu , Xinke Wang , Ruotong Wang , Chuang Chen , Yixin Zhang , Xiao Sun

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

With the fast growth of mobile computing and Web technologies, offensive language has become more prevalent on social networking platforms. Since offensive language identification in local languages is essential to moderate the social media…

Multimodal machine translation and textual chat translation have received considerable attention in recent years. Although the conversation in its natural form is usually multimodal, there still lacks work on multimodal machine translation…

Computation and Language · Computer Science 2022-03-01 Yunlong Liang , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

Offensive content moderation is vital in social media platforms to support healthy online discussions. However, their prevalence in codemixed Dravidian languages is limited to classifying whole comments without identifying part of it…

Sentiment analysis, mostly based on text, has been rapidly developing in the last decade and has attracted widespread attention in both academia and industry. However, the information in the real world usually comes from multiple…

Computation and Language · Computer Science 2019-12-12 Feiyang Chen , Ziqian Luo , Yanyan Xu , Dengfeng Ke

Multimodal sentiment analysis has gained significant attention due to the proliferation of multimodal content on social media. However, existing studies in this area rely heavily on large-scale supervised data, which is time-consuming and…

Computation and Language · Computer Science 2023-08-02 Xiaocui Yang , Shi Feng , Daling Wang , Pengfei Hong , Soujanya Poria

Sarcasm detection is a significant challenge in sentiment analysis, particularly due to its nature of conveying opinions where the intended meaning deviates from the literal expression. This challenge is heightened in social media contexts…

Computation and Language · Computer Science 2025-03-14 Aniket Deroy , Subhankar Maity

The long-standing goal of Artificial Intelligence (AI) has been to create human-like conversational systems. Such systems should have the ability to develop an emotional connection with the users, hence emotion recognition in dialogues is…

Computation and Language · Computer Science 2022-05-30 Gopendra Vikram Singh , Priyanshu Priya , Mauajama Firdaus , Asif Ekbal , Pushpak Bhattacharyya

Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context…

Human-Computer Interaction · Computer Science 2019-03-29 Daniel McDuff , Kael Rowan , Piali Choudhury , Jessica Wolk , ThuVan Pham , Mary Czerwinski

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu

This paper investigates the relationship between utterance sentiment and language choice in English-Tamil code-switched text, using methods from machine learning and statistical modelling. We apply a fine-tuned XLM-RoBERTa model for…

Computation and Language · Computer Science 2026-03-30 Paul Bontempo

As cryptocurrencies gain popularity, the digital asset marketplace becomes increasingly significant. Understanding social media signals offers valuable insights into investor sentiment and market dynamics. Prior research has predominantly…

Computation and Language · Computer Science 2025-09-03 Chenghao Liu , Aniket Mahanti , Ranesh Naha , Guanghao Wang , Erwann Sbai

The human language can be expressed through multiple sources of information known as modalities, including tones of voice, facial gestures, and spoken language. Recent multimodal learning with strong performances on human-centric tasks such…

Computation and Language · Computer Science 2020-10-06 Yao-Hung Hubert Tsai , Martin Q. Ma , Muqiao Yang , Ruslan Salakhutdinov , Louis-Philippe Morency

Tamil, a Dravidian language of South Asia, is a highly diglossic language with two very different registers in everyday use: Literary Tamil (preferred in writing and formal communication) and Spoken Tamil (confined to speech and informal…

Computation and Language · Computer Science 2023-11-15 Kabilan Prasanna , Aryaman Arora

Social media often acts as breeding grounds for different forms of offensive content. For low resource languages like Tamil, the situation is more complex due to the poor performance of multilingual or language-specific models and lack of…

Computation and Language · Computer Science 2021-02-22 Debjoy Saha , Naman Paharia , Debajit Chakraborty , Punyajoy Saha , Animesh Mukherjee

The ability to generate sentiment-controlled feedback in response to multimodal inputs comprising text and images addresses a critical gap in human-computer interaction. This capability allows systems to provide empathetic, accurate, and…

Multimedia · Computer Science 2025-10-07 Puneet Kumar , Sarthak Malik , Balasubramanian Raman , Xiaobai Li