English
Related papers

Related papers: Self-supervised Video-centralised Transformer for …

200 papers

The problem of faces detection in images or video streams is a classical problem of computer vision. The multiple solutions of this problem have been proposed, but the question of their optimality is still open. Many algorithms achieve a…

Computer Vision and Pattern Recognition · Computer Science 2015-11-24 Ilya Kalinovskii , Vladimir Spitsyn

Face forgery by deepfake is widely spread over the internet and this raises severe societal concerns. In this paper, we propose a novel video transformer with incremental learning for detecting deepfake videos. To better align the input…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Sohail A. Khan , Hang Dai

Open-set face recognition describes a scenario where unknown subjects, unseen during the training stage, appear on test time. Not only it requires methods that accurately identify individuals of interest, but also demands approaches that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Rafael Henrique Vareto , William Robson Schwartz

We propose a simple strategy for masking image patches during visual-language contrastive learning that improves the quality of the learned representations and the training speed. During each iteration of training, we randomly mask clusters…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Zihao Wei , Zixuan Pan , Andrew Owens

The objective of this paper is to learn a compact representation of image sets for template-based face recognition. We make the following contributions: first, we propose a network architecture which aggregates and embeds the face…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Yujie Zhong , Relja Arandjelović , Andrew Zisserman

In this paper, we present the first transformer-based model to address the challenging problem of egocentric gaze estimation. We observe that the connection between the global scene context and local visual information is vital for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Bolin Lai , Miao Liu , Fiona Ryan , James M. Rehg

We present a novel approach for unsupervised activity segmentation which uses video frame clustering as a pretext task and simultaneously performs representation learning and online clustering. This is in contrast with prior works where…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sateesh Kumar , Sanjay Haresh , Awais Ahmed , Andrey Konin , M. Zeeshan Zia , Quoc-Huy Tran

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Subspace clustering aims to group data points that lie in a union of low-dimensional subspaces and finds wide application in computer vision, hyperspectral imaging, and recommendation systems. However, most existing methods assume fully…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Huanran Li , Daniel Pimentel-Alarcón

In this paper, we present TAC-SUM, a novel and efficient training-free approach for video summarization that addresses the limitations of existing cluster-based models by incorporating temporal context. Our method partitions the input video…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Hai-Dang Huynh-Lam , Ngoc-Phuong Ho-Thi , Minh-Triet Tran , Trung-Nghia Le

Deep clustering - joint representation learning and latent space clustering - is a well studied problem especially in computer vision and text processing under the deep learning framework. While the representation learning is generally…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Bishwajit Saha , Dmitry Krotov , Mohammed J. Zaki , Parikshit Ram

Self-supervised learning has been successfully applied to pre-train video representations, which aims at efficient adaptation from pre-training domain to downstream tasks. Existing approaches merely leverage contrastive loss to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yuanze Lin , Xun Guo , Yan Lu

Understanding human activity and being able to explain it in detail surpasses mere action classification by far in both complexity and value. The challenge is thus to describe an activity on the basis of its most fundamental constituents,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Timo Milbich , Miguel Bautista , Ekaterina Sutter , Bjorn Ommer

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slots) against one…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Sindy Löwe , Klaus Greff , Rico Jonschkowski , Alexey Dosovitskiy , Thomas Kipf

This paper presents a novel framework in which video/image segmentation and localization are cast into a single optimization problem that integrates information from low level appearance cues with that of high level localization cues in a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Abhishek Sharma

Deep clustering has recently emerged as a promising technique for complex data clustering. Despite the considerable progress, previous deep clustering works mostly build or learn the final clustering by only utilizing a single layer of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Dong Huang , Ding-Hua Chen , Xiangji Chen , Chang-Dong Wang , Jian-Huang Lai

Despite significant progress made over the past twenty five years, unconstrained face verification remains a challenging problem. This paper proposes an approach that couples a deep CNN-based approach with a low-dimensional discriminative…

Computer Vision and Pattern Recognition · Computer Science 2017-01-19 Swami Sankaranarayanan , Azadeh Alavi , Carlos Castillo , Rama Chellappa

One of the most pressing challenges for the detection of face-manipulated videos is generalising to forgery methods not seen during training while remaining effective under common corruptions such as compression. In this paper, we examine…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Alexandros Haliassos , Rodrigo Mira , Stavros Petridis , Maja Pantic

Human communication is multi-modal; e.g., face-to-face interaction involves auditory signals (speech) and visual signals (face movements and hand gestures). Hence, it is essential to exploit multiple modalities when designing machine…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Marah Halawa , Florian Blume , Pia Bideau , Martin Maier , Rasha Abdel Rahman , Olaf Hellwich

Humans develop visual intelligence through perceiving and interacting with their environment - a self-supervised learning process grounded in egocentric experience. Inspired by this, we ask how can artificial systems learn stable object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuting Tan , Xilong Cheng , Yunxiao Qin , Zhengnan Li , Jingjing Zhang