English
Related papers

Related papers: Leveraging Generative AI Models to Explore Human I…

200 papers

Talking head generation is a significant research topic that still faces numerous challenges. Previous works often adopt generative adversarial networks or regression models, which are plagued by generation quality and average facial shape…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ziyu Yao , Xuxin Cheng , Zhiqi Huang

In this paper, we propose a diffusion-based face swapping framework for the first time, called DiffFace, composed of training ID conditional DDPM, sampling with facial guidance, and a target-preserving blending. In specific, in the training…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Kihong Kim , Yunho Kim , Seokju Cho , Junyoung Seo , Jisu Nam , Kychul Lee , Seungryong Kim , KwangHee Lee

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan

We fine-tuned a foundational stable diffusion model using X-ray scattering images and their corresponding descriptions to generate new scientific images from given prompts. However, some of the generated images exhibit significant…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Zhuowen Zhao , Xiaoya Chong , Tanny Chavez , Alexander Hexemer

Cross-Modal learning tasks have picked up pace in recent times. With plethora of applications in diverse areas, generation of novel content using multiple modalities of data has remained a challenging problem. To address the same, various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Nikhil Verma

The field of visual computing is rapidly advancing due to the emergence of generative artificial intelligence (AI), which unlocks unprecedented capabilities for the generation, editing, and reconstruction of images, videos, and 3D scenes.…

While hundreds of artificial intelligence (AI) algorithms are now approved or cleared by the US Food and Drugs Administration (FDA), many studies have shown inconsistent generalization or latent bias, particularly for underrepresented…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Luke W. Sagers , James A. Diao , Luke Melas-Kyriazi , Matthew Groh , Pranav Rajpurkar , Adewole S. Adamson , Veronica Rotemberg , Roxana Daneshjou , Arjun K. Manrai

The high level of photorealism in state-of-the-art diffusion models like Midjourney, Stable Diffusion, and Firefly makes it difficult for untrained humans to distinguish between real photographs and AI-generated images. To address this…

Human-Computer Interaction · Computer Science 2024-06-14 Negar Kamali , Karyn Nakamura , Angelos Chatzimparmpas , Jessica Hullman , Matthew Groh

Human body restoration plays a vital role in various applications related to the human body. Despite recent advances in general image restoration using generative models, their performance in human body restoration remains mediocre, often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yiming Zhang , Zhe Wang , Xinjie Li , Yunchen Yuan , Chengsong Zhang , Xiao Sun , Zhihang Zhong , Jian Wang

Facial expression recognition is vital for human behavior analysis, and deep learning has enabled models that can outperform humans. However, it is unclear how closely they mimic human processing. This study aims to explore the similarity…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 F. Xavier Gaya-Morey , Silvia Ramis-Guarinos , Cristina Manresa-Yee , Jose M. Buades-Rubio

Generative AI now produces photorealistic portraits that circulate widely in social and newslike contexts. Human ability to distinguish real from synthetic faces is time-sensitive because image generators continue to improve while public…

Human-Computer Interaction · Computer Science 2026-03-26 Sunwhi Kim , Sunyul Kim

Speech-driven animation has gained significant traction in recent years, with current methods achieving near-photorealistic results. However, the field remains underexplored regarding non-verbal communication despite evidence demonstrating…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Antoni Bigata Casademunt , Rodrigo Mira , Nikita Drobyshev , Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

This paper examines the evolving nature of internal representations in generative visual models, focusing on the conceptual and technical shift from GANs and VAEs to diffusion-based architectures. Drawing on Beatrice Fazi's account of…

Machine Learning · Computer Science 2025-11-11 Ludovica Schaerf

The scarcity of accessible, compliant, and ethically sourced data presents a considerable challenge to the adoption of artificial intelligence (AI) in sensitive fields like healthcare, finance, and biomedical research. Furthermore, access…

Machine Learning · Computer Science 2025-04-02 Kumar Kshitij Patel , Weitong Zhang , Lingxiao Wang

Recent advances in text-to-image models have opened new frontiers in human-centric generation. However, these models cannot be directly employed to generate images with consistent newly coined identities. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Qinghe Wang , Baolu Li , Xiaomin Li , Bing Cao , Liqian Ma , Huchuan Lu , Xu Jia

The increasingly pervasive facial recognition (FR) systems raise serious concerns about personal privacy, especially for billions of users who have publicly shared their photos on social media. Several attempts have been made to protect…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jiang Liu , Chun Pong Lau , Zhongliang Guo , Yuxiang Guo , Zhaoyang Wang , Rama Chellappa

The problem of text-guided image generation is a complex task in Computer Vision, with various applications, including creating visually appealing artwork and realistic product images. One popular solution widely used for this task is the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Halil Faruk Karagoz , Gulcin Baykal , Irem Arikan Eksi , Gozde Unal

Image generation using generative AI is rapidly becoming a major new source of visual media, with billions of AI generated images created using diffusion models such as Stable Diffusion and Midjourney over the last few years. In this paper…

Human-Computer Interaction · Computer Science 2024-01-29 Jon McCormack , Maria Teresa Llano , Stephen James Krol , Nina Rajcic

The remarkable progress in 3D face reconstruction has resulted in high-detail and photorealistic facial representations. Recently, Diffusion Models have revolutionized the capabilities of generative methods by surpassing the performance of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Stathis Galanakis , Alexandros Lattas , Stylianos Moschoglou , Stefanos Zafeiriou

The rapid advancement of generative image technology has introduced significant security concerns, particularly in the domain of face generation detection. This paper investigates the vulnerabilities of current AI-generated face detection…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sun Haoxuan , Hong Yan , Zhan Jiahui , Chen Haoxing , Lan Jun , Zhu Huijia , Wang Weiqiang , Zhang Liqing , Zhang Jianfu