English
Related papers

Related papers: SelfSwapper: Self-Supervised Face Swapping via Sha…

200 papers

In this paper, we propose Mixed and Masked AutoEncoder (MixMAE), a simple but efficient pretraining method that is applicable to various hierarchical Vision Transformers. Existing masked image modeling (MIM) methods for hierarchical Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Jihao Liu , Xin Huang , Jinliang Zheng , Yu Liu , Hongsheng Li

Face swapping has gained significant traction, driven by the plethora of human face synthesis facilitated by deep learning methods. However, previous face swapping methods that used generative adversarial networks (GANs) as backbones have…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Xinyu Yang , Hongbo Bo

Face anti-spoofing techniques based on domain generalization have recently been studied widely. Adversarial learning and meta-learning techniques have been adopted to learn domain-invariant representations. However, prior approaches often…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jingyi Yang , Zitong Yu , Xiuming Ni , Jia He , Hui Li

Developing a face anti-spoofing model that meets the security requirements of clients worldwide is challenging due to the domain gap between training datasets and diverse end-user test data. Moreover, for security and privacy reasons, it is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhuowei Li , Tianchen Zhao , Xiang Xu , Zheng Zhang , Zhihua Li , Xuanbai Chen , Qin Zhang , Alessandro Bergamo , Anil K. Jain , Yifan Xing

Part-level features are crucial for image understanding, but few studies focus on them because of the lack of fine-grained labels. Although unsupervised part discovery can eliminate the reliance on labels, most of them cannot maintain…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Jiahao Xia , Yike Wu , Wenjian Huang , Jianguo Zhang , Jian Zhang

Due to the limited availability of anomalous samples for training, video anomaly detection is commonly viewed as a one-class classification problem. Many prevalent methods investigate the reconstruction difference produced by AutoEncoders…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Xiangyu Huang , Caidan Zhao , Chenxing Gao , Lvdong Chen , Zhiqiang Wu

Machine learning based Single Image Intrinsic Decomposition (SIID) methods decompose a captured scene into its albedo and shading images by using the knowledge of a large set of known and realistic ground truth decompositions. Collecting…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Louis Lettry , Kenneth Vanhoey , Luc van Gool

Masked autoencoders are scalable vision learners, as the title of MAE \cite{he2022masked}, which suggests that self-supervised learning (SSL) in vision might undertake a similar trajectory as in NLP. Specifically, generative pretext tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Chaoning Zhang , Chenshuang Zhang , Junha Song , John Seon Keun Yi , Kang Zhang , In So Kweon

We propose ADIOS, a masked image model (MIM) framework for self-supervised learning, which simultaneously learns a masking function and an image encoder using an adversarial objective. The image encoder is trained to minimise the distance…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Yuge Shi , N. Siddharth , Philip H. S. Torr , Adam R. Kosiorek

Pathological anomalies exhibit diverse appearances in medical imaging, making it difficult to collect and annotate a representative amount of data required to train deep learning models in a supervised setting. Therefore, in this work, we…

Image and Video Processing · Electrical Eng. & Systems 2023-07-18 Mariana-Iuliana Georgescu

Sparse Autoencoders (SAEs) have emerged as a promising solution for decomposing large language model representations into interpretable features. However, Paulo and Belrose (2025) have highlighted instability across different initialization…

Machine Learning · Computer Science 2025-06-24 Seonglae Cho , Harryn Oh , Donghyun Lee , Luis Eduardo Rodrigues Vieira , Andrew Bermingham , Ziad El Sayed

We present Face Swapping GAN (FSGAN) for face swapping and reenactment. Unlike previous work, we offer a subject agnostic swapping scheme that can be applied to pairs of faces without requiring training on those faces. We derive a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Yuval Nirkin , Yosi Keller , Tal Hassner

Self-supervised learning guided by masked image modelling, such as Masked AutoEncoder (MAE), has attracted wide attention for pretraining vision transformers in remote sensing. However, MAE tends to excessively focus on pixel details,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yi Wang , Hugo Hernández Hernández , Conrad M Albrecht , Xiao Xiang Zhu

Diffusion Probabilistic Models (DPMs) have shown a powerful capacity of generating high-quality image samples. Recently, diffusion autoencoders (Diff-AE) have been proposed to explore DPMs for representation learning via autoencoding. Their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zijian Zhang , Zhou Zhao , Zhijie Lin

Vision foundation models (FMs) achieve state-of-the-art performance in medical imaging. However, they encode information in abstract latent representations that clinicians cannot interrogate or verify. The goal of this study is to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Philipp Wesp , Robbie Holland , Vasiliki Sideri-Lampretsa , Sergios Gatidis

Remote sensing images present unique challenges to image analysis due to the extensive geographic coverage, hardware limitations, and misaligned multi-scale images. This paper revisits the classical multi-scale representation learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Maofeng Tang , Andrei Cozma , Konstantinos Georgiou , Hairong Qi

Capsule networks (CapsNets) are new neural networks that classify images based on the spatial relationships of features. By analyzing the pose of features and their relative positions, it is more capable to recognize images after affine…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Jiazhu Dai , Siwei Xiong

This study reveals a cutting-edge re-balanced contrastive learning strategy aimed at strengthening face anti-spoofing capabilities within facial recognition systems, with a focus on countering the challenges posed by printed photos, and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Chuanbiao Song , Yan Hong , Jun Lan , Huijia Zhu , Weiqiang Wang , Jianfu Zhang

Increasingly many real world tasks involve data in multiple modalities or views. This has motivated the development of many effective algorithms for learning a common latent space to relate multiple domains. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Tanmoy Mukherjee , Makoto Yamada , Timothy M. Hospedales

Despite the recent success of deep learning in the field of medicine, the issue of data scarcity is exacerbated by concerns about privacy and data ownership. Distributed learning approaches, including federated learning, have been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Sangjoon Park , Ik-Jae Lee , Jun Won Kim , Jong Chul Ye