English
Related papers

Related papers: M4-BLIP: Advancing Multi-Modal Media Manipulation …

200 papers

Advancements in the generation quality of various Generative Models (GMs) has made it necessary to not only perform binary manipulation detection but also localize the modified pixels in an image. However, prior works termed as passive for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Vishal Asnani , Xi Yin , Tal Hassner , Xiaoming Liu

Generative models can create entirely new images, but they can also partially modify real images in ways that are undetectable to the human eye. In this paper, we address the challenge of automatically detecting such local manipulations.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Stefan Smeu , Elisabeta Oneata , Dan Oneata

Image manipulation detection algorithms designed to identify local anomalies often rely on the manipulated regions being ``sufficiently'' different from the rest of the non-tampered regions in the image. However, such anomalies might not be…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Rosaura G. VidalMata , Priscila Saboia , Daniel Moreira , Grant Jensen , Jason Schlessman , Walter J. Scheirer

We present ASAP, a new framework for detecting and grounding multi-modal media manipulation (DGM4).Upon thorough examination, we observe that accurate fine-grained cross-modal semantic alignment between the image and text is vital for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Zhenxing Zhang , Yaxiong Wang , Lechao Cheng , Zhun Zhong , Dan Guo , Meng Wang

Fine-grained image classification is a challenging computer vision task where various species share similar visual appearances, resulting in misclassification if merely based on visual clues. Therefore, it is helpful to leverage additional…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Lingfeng Yang , Xiang Li , Renjie Song , Borui Zhao , Juntian Tao , Shihao Zhou , Jiajun Liang , Jian Yang

Face manipulation detection has been receiving a lot of attention for the reliability and security of the face images. Recent studies focus on using auxiliary information or prior knowledge to capture robust manipulation traces, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Haoyue Wang , Meiling Li , Sheng Li , Zhenxing Qian , Xinpeng Zhang

Change detection is a fundamental task in computer vision that processes a bi-temporal image pair to differentiate between semantically altered and unaltered regions. Large language models (LLMs) have been utilized in various domains for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Zhenglin Li , Yangchen Huang , Mengran Zhu , Jingyu Zhang , JingHao Chang , Houze Liu

The key challenge of image manipulation detection is how to learn generalizable features that are sensitive to manipulations in novel data, whilst specific to prevent false alarms on authentic images. Current research emphasizes the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Xinru Chen , Chengbo Dong , Jiaqi Ji , Juan Cao , Xirong Li

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Misinformation has become a pressing issue. Fake media, in both visual and textual forms, is widespread on the web. While various deepfake detection and text fake news detection methods have been proposed, they are only designed for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Rui Shao , Tianxing Wu , Ziwei Liu

Detecting manipulated images and videos is an important topic in digital media forensics. Most detection methods use binary classification to determine the probability of a query being manipulated. Another important topic is locating…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Huy H. Nguyen , Fuming Fang , Junichi Yamagishi , Isao Echizen

With rapid advancements in generative modeling, deepfake techniques are increasingly narrowing the gap between real and synthetic videos, raising serious privacy and security concerns. Beyond traditional face swapping and reenactment, an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tharun Anand , Siva Sankar Sajeev , Pravin Nair

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

Existing deepfake detectors face several challenges in achieving robustness and generalization. One of the primary reasons is their limited ability to extract relevant information from forgery videos, especially in the presence of various…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Zhiyuan Yan , Peng Sun , Yubo Lang , Shuo Du , Shanzhuo Zhang , Wei Wang , Lei Liu

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessments by clinicians. In this paper, we present a multimodal fusion-based deep learning model…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Heng Yim Nicole Oo , Min Hun Lee , Jeong Hoon Lim

The explosive growth of digital images and the widespread availability of image editing tools have made image manipulation detection an increasingly critical challenge. Current deep learning-based manipulation detection methods excel in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Ziyong Wang , Charith Abhayaratne

Detecting maliciously falsified facial images and videos has attracted extensive attention from digital-forensics and computer-vision communities. An important topic in manipulation detection is the localization of the fake regions.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Weinan Guan , Wei Wang , Jing Dong , Bo Peng , Tieniu Tan

Image editing techniques have rapidly advanced, facilitating both innovative use cases and malicious manipulation of digital images. Deep learning-based methods have recently achieved high accuracy in pixel-level forgery localization, yet…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Ju-Hyeon Nam , Dong-Hyun Moon , Sang-Chul Lee

Diffusion models (DMs) have revolutionized image generation, producing high-quality images with applications spanning various fields. However, their ability to create hyper-realistic images poses significant challenges in distinguishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Santosh , Li Lin , Irene Amerini , Xin Wang , Shu Hu

In complex orchard environments, the phenotypic heterogeneity of different apple leaf diseases, characterized by significant variation among lesions, poses a challenge to traditional multi-scale feature fusion methods. These methods only…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Lemin Liu , Fangchao Hu , Honghua Jiang , Yaru Chen , Limin Liu , Yongliang Qiao