English
Related papers

Related papers: Towards a Robust Framework for Multimodal Hate Det…

200 papers

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

Computation and Language · Computer Science 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

The landscape of social media content has evolved significantly, extending from text to multimodal formats. This evolution presents a significant challenge in combating misinformation. Previous research has primarily focused on single…

Multimedia · Computer Science 2024-09-04 Zhe Fu , Kanlun Wang , Wangjiaxuan Xin , Lina Zhou , Shi Chen , Yaorong Ge , Daniel Janies , Dongsong Zhang

The proliferation of fake news and its serious negative social influence push fake news detection methods to become necessary tools for web managers. Meanwhile, the multi-media nature of social media makes multi-modal fake news detection…

Artificial Intelligence · Computer Science 2022-06-20 Jinyin Chen , Chengyu Jia , Haibin Zheng , Ruoxi Chen , Chenbo Fu

With the rapid progression of deep learning technologies, multi-modality image fusion has become increasingly prevalent in object detection tasks. Despite its popularity, the inherent disparities in how different sources depict scene…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Xingyuan Li , Yang Zou , Jinyuan Liu , Zhiying Jiang , Long Ma , Xin Fan , Risheng Liu

In this paper we compare the use of several features in the task of content filtering for video social networks, a very challenging task, not only because the unwanted content is related to very high-level semantic concepts (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2011-01-13 Eduardo Valle , Sandra de Avila , Antonio da Luz , Fillipe de Souza , Marcelo Coelho , Arnaldo Araújo

Amid a tidal wave of misinformation flooding social media during elections and crises, extensive research has been conducted on misinformation detection, primarily focusing on text-based or image-based approaches. However, only a few…

Machine Learning · Computer Science 2025-07-04 Gautam Kishore Shahi

Multimedia content has become ubiquitous on social media platforms, leading to the rise of multimodal misinformation (MM) and the urgent need for effective strategies to detect and prevent its spread. In recent years, the challenge of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Stefanos-Iordanis Papadopoulos , Christos Koutlis , Symeon Papadopoulos , Panagiotis C. Petrantonakis

While the incipient internet was largely text-based, the modern digital world is becoming increasingly multi-modal. Here, we examine multi-modal classification where one modality is discrete, e.g. text, and the other is continuous, e.g.…

Computation and Language · Computer Science 2018-02-09 D. Kiela , E. Grave , A. Joulin , T. Mikolov

Hate speech in social media is a growing phenomenon, and detecting such toxic content has recently gained significant traction in the research community. Existing studies have explored fine-tuning language models (LMs) to perform hate…

Computation and Language · Computer Science 2023-03-07 Md Rabiul Awal , Roy Ka-Wei Lee , Eshaan Tanwar , Tanmay Garg , Tanmoy Chakraborty

Weakly supervised multimodal video anomaly detection has gained significant attention, yet the potential of the text modality remains under-explored. Text provides explicit semantic information that can enhance anomaly characterization and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Shengyang Sun , Jiashen Hua , Junyi Feng , Xiaojin Gong

The automatic identification of offensive language such as hate speech is important to keep discussions civil in online communities. Identifying hate speech in multimodal content is a particularly challenging task because offensiveness can…

Computation and Language · Computer Science 2024-02-20 Amrita Ganguly , Al Nahian Bin Emran , Sadiya Sayara Chowdhury Puspo , Md Nishat Raihan , Dhiman Goswami , Marcos Zampieri

Detecting and classifying cyberbullying in social media is hard because of the complex nature of online language and the changing nature of content. This study presents a multi-stage BERT fusion framework. It uses hierarchical embeddings,…

Computation and Language · Computer Science 2025-03-04 Jiani Wang , Xiaochuan Xu , Peiyang Yu , Zeqiu Xu

Effective fusion of data from multiple modalities, such as video, speech, and text, is challenging due to the heterogeneous nature of multimodal data. In this paper, we propose adaptive fusion techniques that aim to model context from…

Computation and Language · Computer Science 2021-01-27 Gaurav Sahu , Olga Vechtomova

Internet memes have become a powerful means for individuals to express emotions, thoughts, and perspectives on social media. While often considered as a source of humor and entertainment, memes can also disseminate hateful content targeting…

Computation and Language · Computer Science 2024-09-24 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

With the ever-growing presence of social media platforms comes the increased spread of harmful content and the need for robust hate speech detection systems. Such systems easily overfit to specific targets and keywords, and evaluating them…

Computation and Language · Computer Science 2023-11-20 Maike Züfle , Verna Dankers , Ivan Titov

Internet memes are characterised by the interspersing of text amongst visual elements. State-of-the-art multimodal meme classifiers do not account for the relative positions of these elements across the two modalities, despite the latent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

Combating hate speech on social media is critical for securing cyberspace, yet relies heavily on the efficacy of automated detection systems. As content formats evolve, hate speech is transitioning from solely plain text to complex…

Computation and Language · Computer Science 2026-04-22 Runze Sun , Yu Zheng , Zexuan Xiong , Zhongjin Qu , Lei Chen , Jie Zhou , Jiwen Lu

Warning: this paper contains content that may be offensive or upsetting Hate speech moderation on global platforms poses unique challenges due to the multimodal and multilingual nature of content, along with the varying cultural…

Computation and Language · Computer Science 2025-02-18 Minh Duc Bui , Katharina von der Wense , Anne Lauscher

The prevalence of multi-modal content on social media complicates automated moderation strategies. This calls for an enhancement in multi-modal classification and a deeper understanding of understated meanings in images and memes. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Rongxin Ouyang , Kokil Jaidka , Subhayan Mukerjee , Guangyu Cui

Internet memes have become powerful means to transmit political, psychological, and socio-cultural ideas. Although memes are typically humorous, recent days have witnessed an escalation of harmful memes used for trolling, cyberbullying, and…