English
Related papers

Related papers: FaSDiff: Balancing Perception and Semantics in Fac…

200 papers

Diffusion probabilistic models have recently achieved remarkable success in generating high-quality images. However, balancing high perceptual quality and low distortion remains challenging in application of diffusion models in image…

Image and Video Processing · Electrical Eng. & Systems 2025-12-23 Juan Song , Jiaxiang He , Lijie Yang , Mingtao Feng , Keyan Wang

Face restoration under complex degradations still remains an ill-posed inverse problem due to severe information loss. Although diffusion models benefit from strong generative priors, most methods still condition only on low-quality inputs,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zirui Wang , Xianhui Lin , Yi Dong , Bo Wei , Gangjian Zhang , Siteng Ma , Zebiao Zheng , Xing Liu , Hong Gu , Minjing Dong

Conditional diffusion models have exhibited superior performance in high-fidelity text-guided visual generation and editing. Nevertheless, prevailing text-guided visual diffusion models primarily focus on incorporating text-visual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ling Yang , Zhilong Zhang , Zhaochen Yu , Jingwei Liu , Minkai Xu , Stefano Ermon , Bin Cui

This study introduces LRDif, a novel diffusion-based framework designed specifically for facial expression recognition (FER) within the context of under-display cameras (UDC). To address the inherent challenges posed by UDC's image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Zhifeng Wang , Kaihao Zhang , Ramesh Sankaranarayana

Speech-driven 3D facial animation synthesis has been a challenging task both in industry and research. Recent methods mostly focus on deterministic deep learning methods meaning that given a speech input, the output is always the same.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Stefan Stan , Kazi Injamamul Haque , Zerrin Yumak

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

Diffusion models have demonstrated excellent performance in image generation. Although various few-shot semantic segmentation (FSS) models with different network structures have been proposed, performance improvement has reached a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Weimin Tan , Siyuan Chen , Bo Yan

Perceptual image compression has shown strong potential for producing visually appealing results at low bitrates, surpassing classical standards and pixel-wise distortion-oriented neural methods. However, existing methods typically improve…

Image and Video Processing · Electrical Eng. & Systems 2025-02-21 Hao Wei , Yanhui Zhou , Yiwen Jia , Chenyang Ge , Saeed Anwar , Ajmal Mian

Pre-trained diffusion models have demonstrated remarkable proficiency in synthesizing images across a wide range of scenarios with customizable prompts, indicating their effective capacity to capture universal features. Motivated by this,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Yuxiang Ji , Boyong He , Chenyuan Qu , Zhuoyue Tan , Chuan Qin , Liaoni Wu

Face anti-spoofing (FAS) and adversarial detection (FAD) have been regarded as critical technologies to ensure the safety of face recognition systems. However, due to limited practicality, complex deployment, and the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Jiawei Chen , Xiao Yang , Yinpeng Dong , Hang Su , Zhaoxia Yin

Federated learning (FL) is severely challenged by non-independent and identically distributed (non-IID) client data, a problem that degrades global model performance, especially in multimodal perception settings. Conventional methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jing Liu , Zhengliang Guo , Yan Wang , Xiaoguang Zhu , Yao Du , Zehua Wang , Victor C. M. Leung

This paper introduces LLDif, a novel diffusion-based facial expression recognition (FER) framework tailored for extremely low-light (LL) environments. Images captured under such conditions often suffer from low brightness and significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Zhifeng Wang , Kaihao Zhang , Ramesh Sankaranarayana

Semantic segmentation is essential in computer vision for various applications, yet traditional approaches face significant challenges, including the high cost of annotation and extensive training for supervised learning. Additionally, due…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yasufumi Kawano , Yoshimitsu Aoki

Face images captured in real-world low light suffer multiple degradations-low illumination, blur, noise, and low visibility, etc. Existing cascaded solutions often suffer from severe error accumulation, while generic joint models lack…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yilin Ni , Wenjie Li , Zhengxue Wang , Juncheng Li , Guangwei Gao , Jian Yang

Image compression methods are usually optimized isolatedly for human perception or machine analysis tasks. We reveal fundamental commonalities between these objectives: preserving accurate semantic information is paramount, as it directly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ruoyu Feng , Yunpeng Qi , Jinming Liu , Yixin Gao , Xin Li , Xin Jin , Zhibo Chen

The performance of single image super-resolution depends heavily on how to generate and complement high-frequency details to low-resolution images. Recently, diffusion-based DDPM models exhibit great potential in generating high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Xingjian Wang , Li Chai , Jiming Chen

Given the audio-visual clip of the speaker, facial reaction generation aims to predict the listener's facial reactions. The challenge lies in capturing the relevance between video and audio while balancing appropriateness, realism, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Jiaming Li , Sheng Wang , Xin Wang , Yitao Zhu , Honglin Xiong , Zixu Zhuang , Qian Wang

JPEG, as a widely used image compression standard, often introduces severe visual artifacts when achieving high compression ratios. Although existing deep learning-based restoration methods have made considerable progress, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Tingyu Yang , Jue Gong , Jinpei Guo , Wenbo Li , Yong Guo , Yulun Zhang

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jianhao Xie , Ziang Zhang , Zhenyu Weng , Yuesheng Zhu , Guibo Luo

Federated learning aims at training models collaboratively across participants while protecting privacy. However, one major challenge for this paradigm is the data heterogeneity issue, where biased data preferences across multiple clients,…

Machine Learning · Computer Science 2025-07-21 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Jiahua Shi , Jun Shen