English
Related papers

Related papers: Low-Cost Transfer Learning of Face Tasks

200 papers

This paper proposes a step toward obtaining general models of knowledge for facial analysis, by addressing the question of multi-source transfer learning. More precisely, the proposed approach consists in two successive training steps: the…

Machine Learning · Computer Science 2019-11-11 Valentin Vielzeuf , Alexis Lechervy , Stéphane Pateux , Frédéric Jurie

Transfer learning seeks to improve the generalization performance of a target task by exploiting the knowledge learned from a related source task. Central questions include deciding what information one should transfer and when transfer can…

Machine Learning · Computer Science 2021-04-07 Oussama Dhifallah , Yue M. Lu

In this paper, the multi-task learning of lightweight convolutional neural networks is studied for face identification and classification of facial attributes (age, gender, ethnicity) trained on cropped faces without margins. The necessity…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Andrey V. Savchenko

Transfer learning enables to re-use knowledge learned on a source task to help learning a target task. A simple form of transfer learning is common in current state-of-the-art computer vision models, i.e. pre-training a model for image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Thomas Mensink , Jasper Uijlings , Alina Kuznetsova , Michael Gygli , Vittorio Ferrari

Transfer learning is a standard technique to improve performance on tasks with limited data. However, for medical imaging, the value of transfer learning is less clear. This is likely due to the large domain mismatch between the usual…

We present a novel framework to generate images of different age while preserving identity information, which is known as face aging. Different from most recent popular face aging networks utilizing Generative Adversarial Networks(GANs)…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Zipeng Wang , Zhaoxiang Liu , Jianfeng Huang , Shiguo Lian , Yimin Lin

Large, pre-trained models are problematic to use in resource constrained applications. Fortunately, task-aware structured pruning methods offer a solution. These approaches reduce model size by dropping structural units like layers and…

Computation and Language · Computer Science 2023-11-14 Lucio Dery , David Grangier , Awni Hannun

Scaling machine learning methods to very large datasets has attracted considerable attention in recent years, thanks to easy access to ubiquitous sensing and data from the web. We study face recognition and show that three distinct…

Computer Vision and Pattern Recognition · Computer Science 2015-04-21 Yaniv Taigman , Ming Yang , Marc'Aurelio Ranzato , Lior Wolf

In deep learning, transfer learning (TL) has become the de facto approach when dealing with image related tasks. Visual features learnt for one task have been shown to be reusable for other tasks, improving performance significantly. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Adrian Tormos , Dario Garcia-Gasulla , Victor Gimenez-Abalos , Sergio Alvarez-Napagao

Face attributes are interesting due to their detailed description of human faces. Unlike prior researches working on attribute prediction, we address an inverse and more challenging problem called face attribute manipulation which aims at…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Wei Shen , Rujie Liu

Transfer learning from natural image datasets, particularly ImageNet, using standard large models and corresponding pretrained weights has become a de-facto method for deep learning applications to medical imaging. However, there are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Maithra Raghu , Chiyuan Zhang , Jon Kleinberg , Samy Bengio

Transfer learning allows us to train deep architectures requiring a large number of learned parameters, even if the amount of available data is limited, by leveraging existing models previously trained for another task. Here we explore the…

Software Engineering · Computer Science 2020-03-04 Natalie Best , Jordan Ott , Erik Linstead

We propose a new deep network structure for unconstrained face recognition. The proposed network integrates several key components together in order to characterize complex data distributions, such as in unconstrained face images. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Qiangchang Wang , Guodong Guo , Mohammad Iqbal Nouyed

Transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of…

Learning to transfer considers learning solutions to tasks in a such way that relevant knowledge can be transferred from known task solutions to new, related tasks. This is important for general learning, as well as for improving the…

Machine Learning · Computer Science 2021-07-23 Janith Petangoda , Marc Peter Deisenroth , Nicholas A. M. Monk

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer

Knowledge transfer impacts the performance of deep learning -- the state of the art for image classification tasks, including automated melanoma screening. Deep learning's greed for large amounts of training data poses a challenge for…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Afonso Menegola , Michel Fornaciali , Ramon Pires , Flávia Vasques Bittencourt , Sandra Avila , Eduardo Valle

Transfer learning involves taking information and insight from one problem domain and applying it to a new problem domain. Although widely used in practice, theory for transfer learning remains less well-developed. To address this, we prove…

Machine Learning · Statistics 2020-06-24 Jake Williams , Abel Tadesse , Tyler Sam , Huey Sun , George D. Montanez

The human face constantly conveys information, both consciously and subconsciously. However, as basic as it is for humans to visually interpret this information, it is quite a big challenge for machines. Conventional semantic facial feature…

Machine Learning · Computer Science 2016-10-21 Amogh Gudi

A detailed understanding of users contributes to the understanding of the Web's evolution, and to the development of Web applications. Although for new Web platforms such a study is especially important, it is often jeopardized by the lack…

Social and Information Networks · Computer Science 2019-10-18 Jun Sun , Steffen Staab , Jérôme Kunegis