English
Related papers

Related papers: Multimodal Hate Detection Using Dual-Stream Graph …

200 papers

Hate speech is harmful content that directly attacks or promotes hatred against members of groups or individuals based on actual or perceived aspects of identity, such as racism, religion, or sexual orientation. This can affect social life…

Computation and Language · Computer Science 2024-03-19 Arijit Das , Somashree Nandy , Rupam Saha , Srijan Das , Diganta Saha

The focus of this survey is on the analysis of two modalities of multimodal deep learning: image and text. Unlike classic reviews of deep learning where monomodal image classifiers such as VGG, ResNet and Inception module are central…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Weiping Wang , Li Liu , Michael S. Lew

Nowadays, numerous online platforms can be described as multi-modal heterogeneous networks (MMHNs), such as Douban's movie networks and Amazon's product review networks. Accurately categorizing nodes within these networks is crucial for…

Machine Learning · Computer Science 2025-06-23 Jiafan Li , Jiaqi Zhu , Liang Chang , Yilin Li , Miaomiao Li , Yang Wang , Hongan Wang

Multimodal hate detection, which aims to identify harmful content online such as memes, is crucial for building a wholesome internet environment. Previous work has made enlightening exploration in detecting explicit hate remarks. However,…

Computation and Language · Computer Science 2023-04-25 Linhao Zhang , Li Jin , Xian Sun , Guangluan Xu , Zequn Zhang , Xiaoyu Li , Nayu Liu , Qing Liu , Shiyao Yan

This paper delves into the formidable challenge of cross-domain generalization in multimodal hate meme detection, presenting compelling findings. We provide enough pieces of evidence supporting the hypothesis that only the textual component…

Computation and Language · Computer Science 2024-02-08 Piush Aggarwal , Jawar Mehrabanian , Weigang Huang , Özge Alacam , Torsten Zesch

Developing a technique for the automatic analysis of surveillance videos in order to identify the presence of violence is of broad interest. In this work, we propose a deep neural network for the purpose of recognizing violent videos. A…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Swathikiran Sudhakaran , Oswald Lanz

Weakly supervised violence detection refers to the technique of training models to identify violent segments in videos using only video-level labels. Among these approaches, multimodal violence detection, which integrates modalities such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Wenping Jin , Li Zhu , Jing Sun

We investigate architectures of discriminatively trained deep Convolutional Networks (ConvNets) for action recognition in video. The challenge is to capture the complementary information on appearance from still frames and motion between…

Computer Vision and Pattern Recognition · Computer Science 2014-11-13 Karen Simonyan , Andrew Zisserman

Video classification has advanced tremendously over the recent years. A large part of the improvements in video classification had to do with the work done by the image classification community and the use of deep convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2015-05-26 Balakrishnan Varadarajan , George Toderici , Sudheendra Vijayanarasimhan , Apostol Natsev

Multi-label image recognition is a practical and challenging task compared to single-label image classification. However, previous works may be suboptimal because of a great number of object proposals or complex attentional region…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Bin-Bin Gao , Hong-Yu Zhou

With the ever-growing presence of social media platforms comes the increased spread of harmful content and the need for robust hate speech detection systems. Such systems easily overfit to specific targets and keywords, and evaluating them…

Computation and Language · Computer Science 2023-11-20 Maike Züfle , Verna Dankers , Ivan Titov

Recent multi-media data such as images and videos have been rapidly spread out on various online services such as social network services (SNS). With the explosive growth of online media services, the number of image content that may harm…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Eungyeom Ha , Heemook Kim , Sung Chul Hong , Dongbin Na

Hate speech detection in Devanagari-scripted social media memes presents compounded challenges: multimodal content structure, script-specific linguistic complexity, and extreme data scarcity in low-resource settings. This paper presents our…

Computation and Language · Computer Science 2026-04-17 Samir Wagle , Reewaj Khanal , Abiral Adhikari

Nowadays, the widespread dissemination of misinformation across numerous social media platforms has led to severe negative effects on society. To address this challenge, the automatic detection of misinformation, particularly under…

Machine Learning · Computer Science 2026-03-24 Bing Wang , Ximing Li , Changchun Li , Jinjin Chi , Tianze Li , Renchu Guan , Shengsheng Wang

Hate speech has grown into a pervasive phenomenon, intensifying during times of crisis, elections, and social unrest. Multiple approaches have been developed to detect hate speech using artificial intelligence, but a generalized model is…

Computation and Language · Computer Science 2024-10-10 Gautam Kishore Shahi , Tim A. Majchrzak

Videos are a commonly-used type of content in learning during Web search. Many e-learning platforms provide quality content, but sometimes educational videos are long and cover many topics. Humans are good in extracting important sections…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Junaid Ahmed Ghauri , Sherzod Hakimov , Ralph Ewerth

The classification of indoor scenes is a critical component in various applications, such as intelligent robotics for assistive living. While deep learning has significantly advanced this field, models often suffer from reduced performance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Willams de Lima Costa , Raul Ismayilov , Nicola Strisciuglio , Estefania Talavera Martinez

Multi-label image and video classification are fundamental yet challenging tasks in computer vision. The main challenges lie in capturing spatial or temporal dependencies between labels and discovering the locations of discriminative…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Renchun You , Zhiyao Guo , Lei Cui , Xiang Long , Yingze Bao , Shilei Wen

Different from the current node-level anomaly detection task, the goal of graph-level anomaly detection is to find abnormal graphs that significantly differ from others in a graph set. Due to the scarcity of research on the work of…

Machine Learning · Computer Science 2023-08-07 Fu Lin , Xuexiong Luo , Jia Wu , Jian Yang , Shan Xue , Zitong Wang , Haonan Gong

Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly employ two relatively…

Sound · Computer Science 2025-06-10 Kuiyuan Zhang , Wenjie Pei , Rushi Lan , Yifang Guo , Zhongyun Hua