English
Related papers

Related papers: From Pampas to Pixels: Fine-Tuning Diffusion Model…

200 papers

Histological artifacts pose challenges for both pathologists and Computer-Aided Diagnosis (CAD) systems, leading to errors in analysis. Current approaches for histological artifact restoration, based on Generative Adversarial Networks…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Zhenqi He , Wenrui Liu , Minghao Yin , Kai Han

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

Diffusion models have revolted the field of text-to-image generation recently. The unique way of fusing text and image information contributes to their remarkable capability of generating highly text-related images. From another…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Changming Xiao , Qi Yang , Feng Zhou , Changshui Zhang

Text-to-image generative models, especially those based on latent diffusion models (LDMs), have demonstrated outstanding ability in generating high-quality and high-resolution images from textual prompts. With this advancement, various…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Yingqian Cui , Jie Ren , Yuping Lin , Han Xu , Pengfei He , Yue Xing , Lingjuan Lyu , Wenqi Fan , Hui Liu , Jiliang Tang

AI-generated content has attracted lots of attention recently, but photo-realistic video synthesis is still challenging. Although many attempts using GANs and autoregressive models have been made in this area, the visual quality and length…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yingqing He , Tianyu Yang , Yong Zhang , Ying Shan , Qifeng Chen

Inspired by the remarkable success of Latent Diffusion Models (LDMs) for image synthesis, we study LDM for text-to-video generation, which is a formidable challenge due to the computational and memory constraints during both model training…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jiaxi Gu , Shicong Wang , Haoyu Zhao , Tianyi Lu , Xing Zhang , Zuxuan Wu , Songcen Xu , Wei Zhang , Yu-Gang Jiang , Hang Xu

Diffusion models have attracted significant attention due to the remarkable ability to create content and generate data for tasks like image classification. However, the usage of diffusion models to generate the high-quality object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kai Chen , Enze Xie , Zhe Chen , Yibo Wang , Lanqing Hong , Zhenguo Li , Dit-Yan Yeung

Diffusion models have exhibited remarkable capabilities in text-to-image generation. However, their performance in image-to-text generation, specifically image captioning, has lagged behind Auto-Regressive (AR) models, casting doubt on…

Artificial Intelligence · Computer Science 2024-04-17 Yuchi Wang , Shuhuai Ren , Rundong Gao , Linli Yao , Qingyan Guo , Kaikai An , Jianhong Bai , Xu Sun

Interactive streaming music generation promises the use of generative models for live performance and co-creation that is impossible with offline models. However, SOTA models exist in the discrete-AR regime, requiring industrial levels of…

Latent Diffusion models (LDMs) have achieved remarkable results in synthesizing high-resolution images. However, the iterative sampling process is computationally intensive and leads to slow generation. Inspired by Consistency Models (song…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Simian Luo , Yiqin Tan , Longbo Huang , Jian Li , Hang Zhao

The personalized text-to-image generation has rapidly advanced with the emergence of Stable Diffusion. Existing methods, which typically fine-tune models using embedded identifiers, often struggle with insufficient stylization and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Anran Yu , Wei Feng , Yaochen Zhang , Xiang Li , Lei Meng , Lei Wu , Xiangxu Meng

This article explores the use of recent generative AI algorithms for repairing cultural heritage objects, leveraging a conditional diffusion model designed to reconstruct 3D point clouds effectively. Our study evaluates the model's…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Pablo Jaramillo , Ivan Sipiran

Diffusion models excel in many generative modeling tasks, notably in creating images from text prompts, a task referred to as text-to-image (T2I) generation. Despite the ability to generate high-quality images, these models often replicate…

Multimedia · Computer Science 2024-02-20 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Haonan Wang , Kenji Kawaguchi

Diffusion models have emerged as a powerful paradigm for modern generative modeling, demonstrating strong potential for large language models (LLMs). Unlike conventional autoregressive (AR) models that generate tokens sequentially,…

Machine Learning · Computer Science 2026-01-09 Gen Li , Changxiao Cai

Diffusion-based text-to-image models ignited immense attention from the vision community, artists, and content creators. Broad adoption of these models is due to significant improvement in the quality of generations and efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Tianfu Wang , Menelaos Kanakis , Konrad Schindler , Luc Van Gool , Anton Obukhov

Latent diffusion models have proven to be state-of-the-art in the creation and manipulation of visual outputs. However, as far as we know, the generation of depth maps jointly with RGB is still limited. We introduce LDM3D-VR, a suite of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Gabriela Ben Melech Stan , Diana Wofk , Estelle Aflalo , Shao-Yen Tseng , Zhipeng Cai , Michael Paulitsch , Vasudev Lal

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Structural and appearance changes in brain imaging over time are crucial indicators of neurodevelopment and neurodegeneration. The rapid advancement of large-scale generative models provides a promising backbone for modeling these complex…

Graphics · Computer Science 2025-03-14 Gexin Huang , Zhangsihao Yang , Yalin Wang , Guido Gerig , Mengwei Ren , Xiaoxiao Li

Personalized retrieval and segmentation aim to locate specific instances within a dataset based on an input image and a short description of the reference instance. While supervised methods are effective, they require extensive labeled data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Dvir Samuel , Rami Ben-Ari , Matan Levy , Nir Darshan , Gal Chechik

Research in vision-language models has seen rapid developments off-late, enabling natural language-based interfaces for image generation and manipulation. Many existing text guided manipulation techniques are restricted to specific classes…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Paramanand Chandramouli , Kanchana Vaishnavi Gandikota