English
Related papers

Related papers: ViGText: Deepfake Image Detection with Vision-Lang…

200 papers

In recent years, document processing has flourished and brought numerous benefits. However, there has been a significant rise in reported cases of forged document images. Specifically, recent advancements in deep neural network (DNN)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Yamato Okamoto , Osada Genki , Iu Yahiro , Rintaro Hasegawa , Peifei Zhu , Hirokatsu Kataoka

Text classification is a quintessential and practical problem in natural language processing with applications in diverse domains such as sentiment analysis, fake news detection, medical diagnosis, and document classification. A sizable…

Computation and Language · Computer Science 2024-10-15 Syed Mustafa Haider Rizvi , Ramsha Imran , Arif Mahmood

The increasing popularity of social media promotes the proliferation of fake news. With the development of multimedia technology, fake news attempts to utilize multimedia contents with images or videos to attract and mislead readers for…

Multimedia · Computer Science 2019-08-14 Peng Qi , Juan Cao , Tianyun Yang , Junbo Guo , Jintao Li

Multimodal Large Language Models (MLLMs), such as GPT4o, have shown strong capabilities in visual reasoning and explanation generation. However, despite these strengths, they face significant challenges in the increasingly critical task of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Fanrui Zhang , Jiawei Liu , Jiaying Zhu , Esther Sun , Dong Li , Qiang Zhang , Zheng-Jun Zha

Disinformation on social media poses both societal and technical challenges, requiring robust detection systems. While previous studies have integrated textual information into propagation networks, they have yet to fully leverage the…

Computation and Language · Computer Science 2024-11-26 Bruno Croso Cunha da Silva , Thomas Palmeira Ferraz , Roseli De Deus Lopes

With the rapid development of web technology, more and more software applications have become web-based in the past decades. To ensure software quality and user experience, various techniques have been proposed to automatically test web…

Software Engineering · Computer Science 2024-10-17 Siyi Wang , Sinan Wang , Yujia Fan , Xiaolei Li , Yepang Liu

Leveraging large-scale Text-to-Image (TTI) models have become a common technique for generating exemplar or training dataset in the fields of image synthesis, video editing, 3D reconstruction. However, semantic structural visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bumsoo Kim , Wonseop Shin , Kyuchul Lee , Yonghoon Jung , Sanghyun Seo

Visual grounding (VG) typically focuses on locating regions of interest within an image using natural language, and most existing VG methods are limited to single-image interpretations. This limits their applicability in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Wenxuan Wang , Zijia Zhao , Yisi Zhang , Yepeng Tang , Erdong Hu , Xinlong Wang , Jing Liu

Video-text retrieval has seen significant advancements, yet the ability of models to discern subtle differences in captions still requires verification. In this paper, we introduce a new approach for fine-grained evaluation. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Aozhu Chen , Hazel Doughty , Xirong Li , Cees G. M. Snoek

Deepfake detection methods have shown promising results in recognizing forgeries within a given dataset, where training and testing take place on the in-distribution dataset. However, their performance deteriorates significantly when…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Aminollah Khormali , Jiann-Shiun Yuan

The emergence of text-to-image generative models has revolutionized the field of deepfakes, enabling the creation of realistic and convincing visual content directly from textual descriptions. However, this advancement presents considerably…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Yabin Wang , Zhiwu Huang , Zhiheng Ma , Xiaopeng Hong

Recent generative models have demonstrated impressive capabilities in generating realistic and visually pleasing images grounded on textual prompts. Nevertheless, a significant challenge remains in applying these models for the more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Xiaoqian Shen , Mohamed Elhoseiny

Deep learning has been successfully applied to solve various complex problems ranging from big data analytics to computer vision and human-level control. Deep learning advances however have also been employed to create software that can…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Thanh Thi Nguyen , Quoc Viet Hung Nguyen , Dung Tien Nguyen , Duc Thanh Nguyen , Thien Huynh-The , Saeid Nahavandi , Thanh Tam Nguyen , Quoc-Viet Pham , Cuong M. Nguyen

Vision-Language Models (VLMs) extend the capabilities of Large Language Models (LLMs) by incorporating visual information, yet they remain vulnerable to jailbreak attacks, especially when processing noisy or corrupted images. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiawei Wang , Yushen Zuo , Yuanjun Chai , Zhendong Liu , Yicheng Fu , Yichun Feng , Kin-Man Lam

Securing personal identity against deepfake attacks is increasingly critical in the digital age, especially for celebrities and political figures whose faces are easily accessible and frequently targeted. Most existing deepfake detection…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Kaiqing Lin , Zhiyuan Yan , Ke-Yue Zhang , Li Hao , Yue Zhou , Yuzhen Lin , Weixiang Li , Taiping Yao , Shouhong Ding , Bin Li

The upsurge in pre-trained large models started by ChatGPT has swept across the entire deep learning community. Such powerful models demonstrate advanced generative ability and multimodal understanding capability, which quickly set new…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Ning Ding , Yehui Tang , Zhongqian Fu , Chao Xu , Kai Han , Yunhe Wang

Deepfake detection is a widely researched topic that is crucial for combating the spread of malicious content, with existing methods mainly modeling the problem as classification or spatial localization. The rapid advancements in generative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Wenbo Xu , Wei Lu , Xiangyang Luo , Jiantao Zhou

Image search stands as a pivotal task in multimedia and computer vision, finding applications across diverse domains, ranging from internet search to medical diagnostics. Conventional image search systems operate by accepting textual or…

Multimedia · Computer Science 2024-04-30 Hongyi Zhu , Jia-Hong Huang , Stevan Rudinac , Evangelos Kanoulas

Text classification plays an important role in various downstream text-related tasks, such as sentiment analysis, fake news detection, and public opinion analysis. Recently, text classification based on Graph Neural Networks (GNNs) has made…

Computation and Language · Computer Science 2025-12-24 Zuo Wang , Ye Yuan

Vision-Language Models (VLMs) have achieved impressive performance in cross-modal understanding across textual and visual inputs, yet existing benchmarks predominantly focus on pure-text queries. In real-world scenarios, language also…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Qing'an Liu , Juntong Feng , Yuhao Wang , Xinzhe Han , Yujie Cheng , Yue Zhu , Haiwen Diao , Yunzhi Zhuge , Huchuan Lu