English
Related papers

Related papers: Self-supervised learning of a facial attribute emb…

200 papers

What is the best way to learn a universal face representation? Recent work on Deep Learning in the area of face analysis has focused on supervised learning for specific tasks of interest (e.g. face recognition, facial landmark localization…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Adrian Bulat , Shiyang Cheng , Jing Yang , Andrew Garbett , Enrique Sanchez , Georgios Tzimiropoulos

The success of deep neural networks generally requires a vast amount of training data to be labeled, which is expensive and unfeasible in scale, especially for video collections. To alleviate this problem, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Longlong Jing , Xiaodong Yang , Jingen Liu , Yingli Tian

The objective of this paper is self-supervised learning of video object segmentation. We develop a unified framework which simultaneously models cross-frame dense correspondence for locally discriminative feature learning and embeds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Liulei Li , Wenguan Wang , Tianfei Zhou , Jianwu Li , Yi Yang

Unsupervised approaches to learning in neural networks are of substantial interest for furthering artificial intelligence, both because they would enable the training of networks without the need for large numbers of expensive annotations,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Chengxu Zhuang , Alex Lin Zhai , Daniel Yamins

Image generating neural networks are mostly viewed as black boxes, where any change in the input can have a number of globally effective changes on the output. In this work, we propose a method for learning disentangled representations to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Maren Awiszus , Hanno Ackermann , Bodo Rosenhahn

We present a novel unsupervised method for face identity learning from video sequences. The method exploits the ResNet deep network for face detection and VGGface fc7 face descriptors together with a smart learning mechanism that exploits…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Federico Pernici , Alberto Del Bimbo

Conventional feature extraction techniques in the face anti-spoofing domain either analyze the entire video sequence or focus on a specific segment to improve model performance. However, identifying the optimal frames that provide the most…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Usman Muhammad , Mourad Oussalah , Jorma Laaksonen

We present a novel end-to-end framework for facial performance capture given a monocular video of an actor's face. Our framework are comprised of 2 parts. First, to extract the information in the frames, we optimize a triplet loss to learn…

Graphics · Computer Science 2018-12-27 Hsien-Yu Meng , Tzu-heng Lin , Xiubao Jiang , Yao Lu , Jiangtao Wen

Models based on self-attention mechanisms have been successful in analyzing temporal data and have been widely used in the natural language domain. We propose a new model architecture for video face representation and recognition based on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Ihor Protsenko , Taras Lehinevych , Dmytro Voitekh , Ihor Kroosh , Nick Hasty , Anthony Johnson

Despite recent advances in face recognition, robust performance remains challenging under large variations in age, pose, and occlusion. A common strategy to address these issues is to guide representation learning with auxiliary supervision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ana Dias , João Ribeiro Pinto , Hugo Proença , João C. Neves

We propose a new self-supervised approach to image feature learning from motion cue. This new approach leverages recent advances in deep learning in two directions: 1) the success of training deep neural network in estimating optical flow…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Bin Ma , Shubao Liu , Yingxuan Zhi , Qi Song

Recently, deep neural network has shown promising performance in face image recognition. The inputs of most networks are face images, and there is hardly any work reported in literature on network with face videos as input. To sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2016-03-23 Zhen Dong , Su Jia , Chi Zhang , Mingtao Pei

Human behavior understanding in videos is a complex, still unsolved problem and requires to accurately model motion at both the local (pixel-wise dense prediction) and global (aggregation of motion cues) levels. Current approaches based on…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 C. Spampinato , S. Palazzo , P. D'Oro , D. Giordano , M. Shah

We propose a self-supervised approach for learning representations and robotic behaviors entirely from unlabeled videos recorded from multiple viewpoints, and study how this representation can be used in two robotic imitation settings:…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Pierre Sermanet , Corey Lynch , Yevgen Chebotar , Jasmine Hsu , Eric Jang , Stefan Schaal , Sergey Levine

Although deep convolutional networks have achieved great performance in face recognition tasks, the challenge of domain discrepancy still exists in real world applications. Lack of domain coverage of training data (source domain) makes the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Chun-Hsien Lin , Bing-Fei Wu

Estimating the parameters of a model describing a set of observations using a neural network is in general solved in a supervised way. In cases when we do not have access to the model's true parameters this approach can not be applied.…

Astrophysics of Galaxies · Physics 2020-09-30 Miguel A. Aragon-Calvo

We introduce an unsupervised feature learning approach that embeds 3D shape information into a single-view image representation. The main idea is a self-supervised training objective that, given only a single 2D image, requires all unseen…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Dinesh Jayaraman , Ruohan Gao , Kristen Grauman

Training deep neural networks to estimate the viewpoint of objects requires large labeled training datasets. However, manually labeling viewpoints is notoriously hard, error-prone, and time-consuming. On the other hand, it is relatively…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Siva Karthik Mustikovela , Varun Jampani , Shalini De Mello , Sifei Liu , Umar Iqbal , Carsten Rother , Jan Kautz

The fast evolution and widespread of deepfake techniques in real-world scenarios require stronger generalization abilities of face forgery detectors. Some works capture the features that are unrelated to method-specific artifacts, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Hanqing Zhao , Wenbo Zhou , Dongdong Chen , Weiming Zhang , Nenghai Yu

Self-supervised learning can significantly improve the performance of downstream tasks, however, the dimensions of learned representations normally lack explicit physical meanings. In this work, we propose a novel self-supervised approach…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-19 Yifan Sun , Xihong Wu