English
Related papers

Related papers: FADA: Fast Diffusion Avatar Synthesis with Mixed-S…

200 papers

In latest years plethora of identity-preserving adapters for a personalized generation with diffusion models have been released. Their main disadvantage is that they are dominantly trained jointly with base diffusion models, which suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sergey Karpukhin , Vadim Titov , Andrey Kuznetsov , Aibek Alanov

Communication constraints are one of the major challenges preventing the wide-spread adoption of Federated Learning systems. Recently, Federated Distillation (FD), a new algorithmic paradigm for Federated Learning with fundamentally…

Machine Learning · Computer Science 2020-12-02 Felix Sattler , Arturo Marban , Roman Rischke , Wojciech Samek

While diffusion models effectively generate remarkable synthetic images, a key limitation is the inference inefficiency, requiring numerous sampling steps. To accelerate inference and maintain high-quality synthesis, teacher-student…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Chi Hong , Jiyue Huang , Robert Birke , Dick Epema , Stefanie Roos , Lydia Y. Chen

The LiDAR 3D object detector that strikes a balance between accuracy and speed is crucial for achieving real-time perception in autonomous driving. However, many existing LiDAR detection models depend on complex feature transformations,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Rui Yu , Runkai Zhao , Jiagen Li , Qingsong Zhao , HuaiCheng Yan , Meng Wang

Speech-driven 3D facial animation synthesis has been a challenging task both in industry and research. Recent methods mostly focus on deterministic deep learning methods meaning that given a speech input, the output is always the same.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Stefan Stan , Kazi Injamamul Haque , Zerrin Yumak

Diffusion models have shown tremendous results in image generation. However, due to the iterative nature of the diffusion process and its reliance on classifier-free guidance, inference times are slow. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yi-Ting Hsiao , Siavash Khodadadeh , Kevin Duarte , Wei-An Lin , Hui Qu , Mingi Kwon , Ratheesh Kalarot

Dataset distillation has emerged as an effective strategy, significantly reducing training costs and facilitating more efficient model deployment. Recent advances have leveraged generative models to distill datasets by capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jeffrey A. Chan-Santiago , Praveen Tirupattur , Gaurav Kumar Nayak , Gaowen Liu , Mubarak Shah

Classifier-free guided diffusion models have recently been shown to be highly effective at high-resolution image generation, and they have been widely used in large-scale diffusion frameworks including DALLE-2, Stable Diffusion and Imagen.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Chenlin Meng , Robin Rombach , Ruiqi Gao , Diederik P. Kingma , Stefano Ermon , Jonathan Ho , Tim Salimans

Diffusion models have demonstrated exceptional capabilities in generating high-fidelity images but typically suffer from inefficient sampling. Many solver designs and noise scheduling strategies have been proposed to dramatically improve…

Machine Learning · Statistics 2025-10-01 Tianrong Chen , Huangjie Zheng , David Berthelot , Jiatao Gu , Josh Susskind , Shuangfei Zhai

Diffusion models are instrumental in text-to-audio (TTA) generation. Unfortunately, they suffer from slow inference due to an excessive number of queries to the underlying denoising network per generation. To address this bottleneck, we…

Sound · Computer Science 2024-06-25 Yatong Bai , Trung Dang , Dung Tran , Kazuhito Koishida , Somayeh Sojoudi

Large video diffusion and flow models have achieved remarkable success in high-quality video generation, but their use in real-time interactive applications remains limited due to their inefficient multi-step sampling process. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Weili Nie , Julius Berner , Nanye Ma , Chao Liu , Saining Xie , Arash Vahdat

Diffusion transformers (DiT) have become the de facto choice for generating high-quality images and videos, largely due to their scalability, which enables the construction of larger models for enhanced performance. However, the increased…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Pratheba Selvaraju , Tianyu Ding , Tianyi Chen , Ilya Zharkov , Luming Liang

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiyuan Wang , Muhan Zhang

Audio-visual synchronization aims to determine whether the mouth movements and speech in the video are synchronized. VocaLiST reaches state-of-the-art performance by incorporating multimodal Transformers to model audio-visual interact…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xuanjun Chen , Haibin Wu , Chung-Che Wang , Hung-yi Lee , Jyh-Shing Roger Jang

Prevailing Dataset Distillation (DD) methods leveraging generative models confront two fundamental limitations. First, despite pioneering the use of diffusion models in DD and delivering impressive performance, the vast majority of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Letian Zhou , Songhua Liu , Xinchao Wang

Recent advances in generative diffusion models have enabled the previously unfeasible capability of generating 3D assets from a single input image or a text prompt. In this work, we aim to enhance the quality and functionality of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiyi Chen , Marko Mihajlovic , Shaofei Wang , Sergey Prokudin , Siyu Tang

Diffusion models with transformer architectures have demonstrated promising capabilities in generating high-fidelity images and scalability for high resolution. However, iterative sampling process required for synthesis is very…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yeongmin Kim , Sotiris Anagnostidis , Yuming Du , Edgar Schönfeld , Jonas Kohler , Markos Georgopoulos , Albert Pumarola , Ali Thabet , Artsiom Sanakoyeu

Creating high-quality animatable 3D human avatars from a single image remains a significant challenge in computer vision due to the inherent difficulty of reconstructing complete 3D information from a single viewpoint. Current approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Yonwoo Choi

The generation of high-quality, animatable 3D head avatars from text has enormous potential in content creation applications such as games, movies, and embodied virtual assistants. Current text-to-3D generation methods typically combine…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yiqian Wu , Malte Prinzler , Xiaogang Jin , Siyu Tang

To address the larger computation and storage requirements associated with large video datasets, video dataset distillation aims to capture spatial and temporal information in a significantly smaller dataset, such that training on the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Kunyang Li , Jeffrey A Chan Santiago , Sarinda Dhanesh Samarasinghe , Gaowen Liu , Mubarak Shah