English
Related papers

Related papers: ViMGuard: A Novel Multi-Modal System for Video Mis…

200 papers

Deepfakes and manipulated media are becoming a prominent threat due to the recent advances in realistic image and video synthesis techniques. There have been several attempts at combating Deepfakes using machine learning classifiers.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Paarth Neekhara , Shehzeen Hussain , Xinqiao Zhang , Ke Huang , Julian McAuley , Farinaz Koushanfar

Misinformation on the web increasingly appears in multimodal forms, combining text, images, and OCR-rendered content in ways that amplify harm to public trust and vulnerable communities. While prior fact-checking systems often rely on…

Computation and Language · Computer Science 2026-01-14 Aditya Kishore , Gaurav Kumar , Jasabanta Patro

Fact-based Visual Question Answering (FVQA) requires external knowledge beyond visible content to answer questions about an image, which is challenging but indispensable to achieve general VQA. One limitation of existing FVQA solutions is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Zihao Zhu , Jing Yu , Yujing Wang , Yajing Sun , Yue Hu , Qi Wu

In the digital world, memes present a unique challenge for content moderation due to their potential to spread harmful content. Although detection methods have improved, proactive solutions such as intervention are still limited, with…

Computation and Language · Computer Science 2024-06-11 Prince Jha , Raghav Jain , Konika Mandal , Aman Chadha , Sriparna Saha , Pushpak Bhattacharyya

Automatic Speaker Verification (ASV) system is a type of bio-metric authentication. It can be attacked by an intruder, who falsifies data in order to get access to protected information. Countermeasures (CM) are special algorithms that…

Sound · Computer Science 2022-04-01 Petr Grinberg , Vladislav Shikhov

Face manipulation techniques have achieved significant advances, presenting serious challenges to security and social trust. Recent works demonstrate that leveraging multimodal models can enhance the generalization and interpretability of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Ke Sun , Shen Chen , Taiping Yao , Ziyin Zhou , Jiayi Ji , Xiaoshuai Sun , Chia-Wen Lin , Rongrong Ji

Weakly supervised multimodal video anomaly detection has gained significant attention, yet the potential of the text modality remains under-explored. Text provides explicit semantic information that can enhance anomaly characterization and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Shengyang Sun , Jiashen Hua , Junyi Feng , Xiaojin Gong

As Video Large Multimodal Models (VLMMs) rapidly advance, their inherent complexity introduces significant safety challenges, particularly the issue of mismatched generalization where static safety alignments fail to transfer to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yixu Wang , Jiaxin Song , Yifeng Gao , Xin Wang , Yang Yao , Yan Teng , Xingjun Ma , Yingchun Wang , Yu-Gang Jiang

The rapid advancement of Deepfake technologies and video manipulation tools poses a critical challenge to multimedia forensics, judicial evidence integrity, and information authenticity. Current detectors rely on single-modality signals,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hoda Osama Elkhodary , Sherin Mostafa Youssef , Marwa Elshenawy , Dalia Sobhy

Recent deep research systems have improved the ability of large language models to produce long, grounded reports through iterative retrieval and reasoning. However, most text-centered systems rely mainly on textual evidence, while…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhuofan Shi , Peilun Jia , Baoqin Sun , Haiyang Shen , Sixiong Xie , Yun Ma , Xiang Jing

Multimodal large language models (MLLMs) face safety misalignment, where visual inputs enable harmful outputs. To address this, existing methods require explicit safety labels or contrastive data; yet, threat-related concepts are concrete…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Qishun Yang , Shu Yang , Lijie Hu , Di Wang

The goal of this work is to enhance balanced multimodal understanding in audio-visual large language models (AV-LLMs) by addressing modality bias without additional training. In current AV-LLMs, audio and video features are typically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Chaeyoung Jung , Youngjoon Jang , Jongmin Choi , Joon Son Chung

Misinformation on YouTube is a significant concern, necessitating robust detection strategies. In this paper, we introduce a novel methodology for video classification, focusing on the veracity of the content. We convert the conventional…

Computation and Language · Computer Science 2023-07-25 Christos Christodoulou , Nikos Salamanos , Pantelitsa Leonidou , Michail Papadakis , Michael Sirivianos

Humans can intuitively infer sounds from silent videos, but whether multimodal large language models can perform modal-mismatch reasoning without accessing target modalities remains relatively unexplored. Current…

Multimedia · Computer Science 2025-05-29 Yong Ren , Chenxing Li , Le Xu , Hao Gu , Duzhen Zhang , Yujie Chen , Manjie Xu , Ruibo Fu , Shan Yang , Dong Yu

Fact-based Visual Question Answering (FVQA), a challenging variant of VQA, requires a QA-system to include facts from a diverse knowledge graph (KG) in its reasoning process to produce an answer. Large KGs, especially common-sense KGs, are…

Computation and Language · Computer Science 2021-06-22 Kiran Ramnath , Mark Hasegawa-Johnson

ASVspoof5, the fifth edition of the ASVspoof series, is one of the largest global audio security challenges. It aims to advance the development of countermeasure (CM) to discriminate bonafide and spoofed speech utterances. In this paper, we…

Sound · Computer Science 2024-08-14 Yuankun Xie , Xiaopeng Wang , Zhiyong Wang , Ruibo Fu , Zhengqi Wen , Haonan Cheng , Long Ye

Video Temporal Grounding (VTG), which aims to ground target clips from videos (such as consecutive intervals or disjoint shots) according to custom language queries (e.g., sentences or words), is key for video browsing on social media. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Kevin Qinghong Lin , Pengchuan Zhang , Joya Chen , Shraman Pramanick , Difei Gao , Alex Jinpeng Wang , Rui Yan , Mike Zheng Shou

The growing threat posed by deepfake videos, capable of manipulating realities and disseminating misinformation, drives the urgent need for effective detection methods. This work investigates and compares different approaches for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Matheus Martins Batista

Social media becomes the central way for people to obtain and utilise news, due to its rapidness and inexpensive value of data distribution. Though, such features of social media platforms also present it a root cause of fake news…

Social and Information Networks · Computer Science 2021-09-29 Priyanka Meel , Dinesh Kumar Vishwakarma

Deepfakes are synthetic media generated using deep generative algorithms and have posed a severe societal and political threat. Apart from facial manipulation and synthetic voice, recently, a novel kind of deepfakes has emerged with either…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Vinaya Sree Katamneni , Ajita Rattani