English
Related papers

Related papers: Unraveling Hidden Representations: A Multi-Modal L…

200 papers

Sequential modelling of high-dimensional data is an important problem that appears in many domains including model-based reinforcement learning and dynamics identification for control. Latent variable models applied to sequential data…

Machine Learning · Computer Science 2023-01-23 Oliver Limoyo , Trevor Ablett , Jonathan Kelly

Advancements in language foundation models have primarily fueled the recent surge in artificial intelligence. In contrast, generative learning of non-textual modalities, especially videos, significantly trails behind language modeling. This…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Lijun Yu

As synthetic imagery is used more frequently in training deep models, it is important to understand how different synthesis techniques impact the performance of such models. In this work, we perform a thorough evaluation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kristofer Schlachter , Connor DeFanti , Sebastian Herscher , Ken Perlin , Jonathan Tompson

Fake news detection research is still in the early stage as this is a relatively new phenomenon in the interest raised by society. Machine learning helps to solve complex problems and to build AI systems nowadays and especially in those…

Computation and Language · Computer Science 2022-01-20 Sajjad Ahmed , Knut Hinkelmann , Flavio Corradini

Recent advancements in DeepFake generation, along with the proliferation of open-source tools, have significantly lowered the barrier for creating synthetic media. This trend poses a serious threat to the integrity and authenticity of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Spiros Baxavanakis , Manos Schinas , Symeon Papadopoulos

Recent advances in generative models for language have enabled the creation of convincing synthetic text or deepfake text. Prior work has demonstrated the potential for misuse of deepfake text to mislead content consumers. Therefore,…

Cryptography and Security · Computer Science 2022-10-19 Jiameng Pu , Zain Sarwar , Sifat Muhammad Abdullah , Abdullah Rehman , Yoonjin Kim , Parantapa Bhattacharya , Mobin Javed , Bimal Viswanath

Although Generative Adversarial Network (GAN) can be used to generate the realistic image, improper use of these technologies brings hidden concerns. For example, GAN can be used to generate a tampered video for specific people and…

Multimedia · Computer Science 2018-10-19 Chih-Chung Hsu , Chia-Yen Lee , Yi-Xiu Zhuang

The remarkable progress in neural-network-driven visual data generation, especially with neural rendering techniques like Neural Radiance Fields and 3D Gaussian splatting, offers a powerful alternative to GANs and diffusion models. These…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chengdong Dong , Vijayakumar Bhagavatula , Zhenyu Zhou , Ajay Kumar

Recent advances in Generative AI (GenAI) have led to significant improvements in the quality of generated visual content. As AI-generated visual content becomes increasingly indistinguishable from real content, the challenge of detecting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Keerthi Veeramachaneni , Praveen Tirupattur , Amrit Singh Bedi , Mubarak Shah

Generalization is a main issue for current audio deepfake detectors, which struggle to provide reliable results on out-of-distribution data. Given the speed at which more and more accurate synthesis methods are developed, it is very…

Sound · Computer Science 2024-07-02 Alessandro Pianese , Davide Cozzolino , Giovanni Poggi , Luisa Verdoliva

Generative models can now produce photorealistic synthetic data which is virtually indistinguishable from the real data used to train it. This is a significant evolution over previous models which could produce reasonable facsimiles of the…

Machine Learning · Computer Science 2024-12-10 Debargha Ganguly , Warren Morningstar , Andrew Yu , Vipin Chaudhary

Generative Adversarial Networks (GANs) have paved the path towards entirely new media generation capabilities at the forefront of image, video, and audio synthesis. However, they can also be misused and abused to fabricate elaborate lies,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Wei Huang , Michelangelo Valsecchi , Michael Multerer

GAN-generated image detection now becomes the first line of defense against the malicious uses of machine-synthesized image manipulations such as deepfakes. Although some existing detectors work well in detecting clean, known GAN samples,…

Cryptography and Security · Computer Science 2024-01-08 Chi Liu , Tianqing Zhu , Sheng Shen , Wanlei Zhou

The increasing realism of AI-generated images has raised serious concerns about misinformation and privacy violations, highlighting the urgent need for accurate and interpretable detection methods. While existing approaches have made…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tai-Ming Huang , Wei-Tung Lin , Kai-Lung Hua , Wen-Huang Cheng , Junichi Yamagishi , Jun-Cheng Chen

The growing threat posed by deepfake videos, capable of manipulating realities and disseminating misinformation, drives the urgent need for effective detection methods. This work investigates and compares different approaches for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Matheus Martins Batista

New advancements for the detection of synthetic images are critical for fighting disinformation, as the capabilities of generative AI models continuously evolve and can lead to hyper-realistic synthetic imagery at unprecedented scale and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Pantelis Dogoulis , Giorgos Kordopatis-Zilos , Ioannis Kompatsiaris , Symeon Papadopoulos

Despite recent advances in Generative Adversarial Networks (GANs), with special focus to the Deepfake phenomenon there is no a clear understanding neither in terms of explainability nor of recognition of the involved models. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Luca Guarnera , Oliver Giudice , Matthias Niessner , Sebastiano Battiato

Deep generative modeling has the potential to cause significant harm to society. Recognizing this threat, a magnitude of research into detecting so-called "Deepfakes" has emerged. This research most often focuses on the image domain, while…

Machine Learning · Computer Science 2021-11-05 Joel Frank , Lea Schönherr

One of the key challenges of detecting AI-generated images is spotting images that have been created by previously unseen generative models. We argue that the limited diversity of the training data is a major obstacle to addressing this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Jeongsoo Park , Andrew Owens

As generative models are advancing in quality and quantity for creating synthetic content, deepfakes begin to cause online mistrust. Deepfake detectors are proposed to counter this effect, however, misuse of detectors claiming fake content…

Artificial Intelligence · Computer Science 2025-10-29 Neslihan Kose , Anthony Rhodes , Umur Aybars Ciftci , Ilke Demir