English
Related papers

Related papers: Low-Rank Head Avatar Personalization with Register…

200 papers

Generating high fidelity identity-preserving faces with different facial attributes has a wide range of applications. Although a number of generative models have been developed to tackle this problem, there is still much room for further…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Dan Ma , Bin Liu , Zhao Kang , Jiayu Zhou , Jianke Zhu , Zenglin Xu

Fine-tuning pre-trained large language models in a parameter-efficient manner is widely studied for its effectiveness and efficiency. LoRA is one of the most widely used methods, which assumes that the optimization process is essentially…

Computation and Language · Computer Science 2024-12-16 Changqun Li , Chaofan Ding , Kexin Luan , Xinhan Di

We present a data-adaptive method for parameter-efficient fine-tuning of large neural networks. Standard low-rank adaptation methods improve efficiency by restricting each layer update to a fixed low-rank form, but this static…

Machine Learning · Computer Science 2026-05-12 Omatharv Bharat Vaidya , Connor T. Jerzak , Nhat Ho , Chandrajit Bajaj

Existing approaches to animatable NeRF-based head avatars are either built upon face templates or use the expression coefficients of templates as the driving signal. Despite the promising progress, their performances are heavily bound by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Yuelang Xu , Hongwen Zhang , Lizhen Wang , Xiaochen Zhao , Han Huang , Guojun Qi , Yebin Liu

Creating realistic animations of human faces with computer graphic models is still a challenging task. It is often solved either with tedious manual work or motion capture based techniques that require specialised and costly hardware.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Wolfgang Paier , Anna Hilsmann , Peter Eisert

Our goal is to create a realistic 3D facial avatar with hair and accessories using only a text description. While this challenge has attracted significant recent interest, existing methods either lack realism, produce unrealistic shapes, or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Hao Zhang , Yao Feng , Peter Kulits , Yandong Wen , Justus Thies , Michael J. Black

Parameter-efficient fine-tuning (PEFT) has emerged as a powerful paradigm for adapting large-scale pre-trained models to downstream tasks with minimal additional parameters. Among PEFT methods, Low-Rank Adaptation (LoRA) stands out for its…

Machine Learning · Computer Science 2026-02-03 Nghiem T. Diep , Dung Le , Tuan Truong , Tan Dinh , Huy Nguyen , Nhat Ho

In this study, our goal is to create interactive avatar agents that can autonomously plan and animate nuanced facial movements realistically, from both visual and behavioral perspectives. Given high-level inputs about the environment and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Duomin Wang , Bin Dai , Yu Deng , Baoyuan Wang

Pre-trained foundation models can be adapted for specific tasks using Low-Rank Adaptation (LoRA). However, the fairness properties of these adapted classifiers remain underexplored. Existing fairness-aware fine-tuning methods rely on direct…

Machine Learning · Computer Science 2025-03-10 Parameswaran Kamalaruban , Mark Anderson , Stuart Burrell , Maeve Madigan , Piotr Skalski , David Sutton

This paper studies the problem of aligning a set of face images of the same individual into a normalized image while removing the outliers like partial occlusion, extreme facial expression as well as significant illumination variation. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jiabo Huang , Xiaohua Xie , Wei-Shi Zheng

Photo-realistic and controllable 3D avatars are crucial for various applications such as virtual and mixed reality (VR/MR), telepresence, gaming, and film production. Traditional methods for avatar creation often involve time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Keqiang Sun , Amin Jourabloo , Riddhish Bhalodia , Moustafa Meshry , Yu Rong , Zhengyu Yang , Thu Nguyen-Phuoc , Christian Haene , Jiu Xu , Sam Johnson , Hongsheng Li , Sofien Bouaziz

While Low-Rank Adaptation (LoRA) has proven beneficial for efficiently fine-tuning large models, LoRA fine-tuned text-to-image diffusion models lack diversity in the generated images, as the model tends to copy data from the observed…

Non-rigid registration is a necessary but challenging task in medical imaging studies. Recently, unsupervised registration models have shown good performance, but they often require a large-scale training dataset and long training times.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Heejung Park , Gyeong Min Lee , Soopil Kim , Ga Hyung Ryu , Areum Jeong , Sang Hyun Park , Min Sagong

Training and fine-tuning large language models (LLMs) come with challenges related to memory and computational requirements due to the increasing size of the model weights and the optimizer states. Various techniques have been developed to…

Machine Learning · Computer Science 2025-12-09 Yehonathan Refael , Jonathan Svirsky , Boris Shustin , Wasim Huleihel , Ofir Lindenbaum

Low-rank adaptation is a popular parameter-efficient fine-tuning method for large language models. In this paper, we analyze the impact of low-rank updating, as implemented in LoRA. Our findings suggest that the low-rank updating mechanism…

Computation and Language · Computer Science 2024-05-21 Ting Jiang , Shaohan Huang , Shengyue Luo , Zihan Zhang , Haizhen Huang , Furu Wei , Weiwei Deng , Feng Sun , Qi Zhang , Deqing Wang , Fuzhen Zhuang

The growing use of portrait images in computer vision highlights the need to protect personal identities. At the same time, anonymized images must remain useful for downstream computer vision tasks. In this work, we propose a unified…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Ali Salar , Qing Liu , Guoying Zhao

Manipulating human facial images between two domains is an important and interesting problem. Most of the existing methods address this issue by applying two generators or one generator with extra conditional inputs. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 X G Tu , Y Luo , H S Zhang , W J Ai , Z Ma , M Xie

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

Self-supervised speech models are a rapidly developing research topic in fake audio detection. Many pre-trained models can serve as feature extractors, learning richer and higher-level speech features. However,when fine-tuning pre-trained…

Sound · Computer Science 2023-06-12 Chenglong Wang , Jiangyan Yi , Xiaohui Zhang , Jianhua Tao , Le Xu , Ruibo Fu

Face recognition systems are usually faced with unseen domains in real-world applications and show unsatisfactory performance due to their poor generalization. For example, a well-trained model on webface data cannot deal with the ID vs.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Jianzhu Guo , Xiangyu Zhu , Chenxu Zhao , Dong Cao , Zhen Lei , Stan Z. Li