English
Related papers

Related papers: RealMat: Realistic Materials with Diffusion and Re…

200 papers

Generative models now produce images with such stunning realism that they can easily deceive the human eye. While this progress unlocks vast creative potential, it also presents significant risks, such as the spread of misinformation.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Yichi Zhang , Xiaogang Xu

Diffusion models have recently become the de-facto approach for generative modeling in the 2D domain. However, extending diffusion models to 3D is challenging due to the difficulties in acquiring 3D ground truth data for training. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jiatao Gu , Qingzhe Gao , Shuangfei Zhai , Baoquan Chen , Lingjie Liu , Josh Susskind

We present novel approaches involving generative adversarial networks and diffusion models in order to synthesize high quality, live and spoof fingerprint images while preserving features such as uniqueness and diversity. We generate live…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 W. Tang , D. Figueroa , D. Liu , K. Johnsson , A. Sopasakis

Diffusion models have recently achieved astonishing performance in generating high-fidelity photo-realistic images. Given their huge success, it is still unclear whether synthetic images are applicable for knowledge distillation when real…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Zheng Li , Yuxuan Li , Penghai Zhao , Renjie Song , Xiang Li , Jian Yang

Data scarcity in medical imaging poses significant challenges due to privacy concerns. Diffusion models, a recent generative modeling technique, offer a potential solution by generating synthetic and realistic data. However, questions…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Abdullah al Nomaan Nafi , Md. Alamgir Hossain , Rakib Hossain Rifat , Md Mahabub Uz Zaman , Md Manjurul Ahsan , Shivakumar Raman

Hard coatings play a critical role in industry, with ceramic materials offering outstanding hardness and thermal stability for applications that demand superior mechanical performance. However, deploying artificial intelligence (AI) for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Binwei Chen , Huachao Leng , Chi Yeung Mang , Tsz Wai Cheung , Yanhua Chen , Wai Keung Anthony Loh , Chi Ho Wong , Chak Yin Tang

We aim to leverage diffusion to address the challenging image matting task. However, the presence of high computational overhead and the inconsistency of noise sampling between the training and inference processes pose significant obstacles…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yihan Hu , Yiheng Lin , Wei Wang , Yao Zhao , Yunchao Wei , Humphrey Shi

In this paper, we rethink the low-light image enhancement task and propose a physically explainable and generative diffusion model for low-light image enhancement, termed as Diff-Retinex. We aim to integrate the advantages of the physical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Xunpeng Yi , Han Xu , Hao Zhang , Linfeng Tang , Jiayi Ma

Text-to-image generative models can generate high-quality humans, but realism is lost when generating hands. Common artifacts include irregular hand poses, shapes, incorrect numbers of fingers, and physically implausible finger…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Supreeth Narasimhaswamy , Uttaran Bhattacharya , Xiang Chen , Ishita Dasgupta , Saayan Mitra , Minh Hoai

Deep learning algorithms require extensive data to achieve robust performance. However, data availability is often restricted in the medical domain due to patient privacy concerns. Synthetic data presents a possible solution to these…

Recently, diffusion-based material transfer methods rely on image fine-tuning or complex architectures with auxiliary networks but face challenges such as text dependency, additional computational costs, and feature misalignment. To address…

Graphics · Computer Science 2026-05-18 Nisha Huang , Yizhou Lin , Jie Guo , Xiu Li , Tong-Yee Lee , Zitong Yu

While modern diffusion models excel at generating diverse single images, extending this to sequential generation reveals a fundamental challenge: balancing narrative dynamism with multi-character coherence. Existing methods often falter at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Qi Zhao , Jun Chen , Ivor Tsang , Guang Dai

Deep neural networks have brought remarkable breakthroughs in medical image analysis. However, due to their data-hungry nature, the modest dataset sizes in medical imaging projects might be hindering their full potential. Generating…

Latent Diffusion Models (LDMs) enable high-quality image synthesis while avoiding excessive compute demands by training a diffusion model in a compressed lower-dimensional latent space. Here, we apply the LDM paradigm to high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Andreas Blattmann , Robin Rombach , Huan Ling , Tim Dockhorn , Seung Wook Kim , Sanja Fidler , Karsten Kreis

Pre-trained Vision-Language Models (VLMs) require Continual Learning (CL) to efficiently update their knowledge and adapt to various downstream tasks without retraining from scratch. However, for VLMs, in addition to the loss of knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Bin Wu , Wuxuan Shi , Jinqiao Wang , Mang Ye

Generative AI has seen remarkable growth over the past few years, with diffusion models being state-of-the-art for image generation. This study investigates the use of diffusion models in generating artificial data generation for electronic…

Machine Learning · Computer Science 2023-10-18 Prasha Srivastava , Pawan Kumar , Zia Abbas

Data augmentation plays a crucial role in deep learning, enhancing the generalization and robustness of learning-based models. Standard approaches involve simple transformations like rotations and flips for generating extra data. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Shichao Dong , Ze Yang , Guosheng Lin

Deep Learning became an ubiquitous paradigm due to its extraordinary effectiveness and applicability in numerous domains. However, the approach suffers from the high demand of data required to achieve the potential of this type of model. An…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Andrei-Robert Alexandrescu , Razvan-Gabriel Petec , Alexandru Manole , Laura-Silvia Diosan

Recent progress in material data mining has been driven by high-capacity models trained on large datasets. However, collecting experimental data (real data) has been extremely costly since the amount of human effort and expertise required.…

Deep generative models have demonstrated remarkable success in medical image synthesis. However, ensuring conditioning faithfulness and high-quality synthetic images for direct or counterfactual generation remains a challenge. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Fangrui Huang , Alan Wang , Binxu Li , Bailey Trang , Ridvan Yesiloglu , Tianyu Hua , Wei Peng , Ehsan Adeli