English
Related papers

Related papers: Prompt-to-Slate: Diffusion Models for Prompt-Condi…

200 papers

Large pre-trained vision language models (VLMs) have shown impressive zero-shot ability on downstream tasks with manually designed prompt. To further adapt VLMs to downstream tasks, soft prompt is proposed to replace manually designed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Shuanghao Bai , Yuedi Zhang , Wanqi Zhou , Zhirong Luan , Badong Chen

Recently, diffusion models have emerged as a new paradigm for generative models. Despite the success in domains using continuous signals such as vision and audio, adapting diffusion models to natural language is under-explored due to the…

Computation and Language · Computer Science 2023-02-15 Shansan Gong , Mukai Li , Jiangtao Feng , Zhiyong Wu , Lingpeng Kong

Diffusion models have become prevalent in generative modeling due to their ability to sample from complex distributions. To improve the quality of generated samples and their compliance with user requirements, two commonly used methods are:…

Machine Learning · Computer Science 2025-12-01 Shervin Khalafi , Ignacio Hounie , Dongsheng Ding , Alejandro Ribeiro

In real-life conversations, the content is diverse, and there exists the one-to-many problem that requires diverse generation. Previous studies attempted to introduce discrete or Gaussian-based continuous latent variables to address the…

Computation and Language · Computer Science 2024-04-11 Jianxiang Xiang , Zhenhua Liu , Haodong Liu , Yin Bai , Jia Cheng , Wenliang Chen

Artificial Intelligence Generated Content (AIGC) services can efficiently satisfy user-specified content creation demands, but the high computational requirements pose various challenges to supporting mobile users at scale. In this paper,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Shuangwei Gao , Peng Yang , Yuxin Kong , Feng Lyu , Ning Zhang

The success of text-to-image (T2I) generation models has spurred a proliferation of numerous model checkpoints fine-tuned from the same base model on various specialized datasets. This overwhelming specialized model production introduces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Tianhui Song , Weixin Feng , Shuai Wang , Xubin Li , Tiezheng Ge , Bo Zheng , Limin Wang

Diffusion models have recently gained recognition for generating diverse and high-quality content, especially in image synthesis. These models excel not only in creating fixed-size images but also in producing panoramic images. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xiaoyu Zhang , Teng Zhou , Xinlong Zhang , Jia Wei , Yongchuan Tang

Classifier-free guidance (CFG) is a cornerstone of text-to-image diffusion models, yet its effectiveness is limited by the use of static guidance scales. This "one-size-fits-all" approach fails to adapt to the diverse requirements of…

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

Statistical Mechanics · Physics 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

Adapting a pretrained diffusion model to new objectives at inference time remains an open problem in generative modeling. Existing steering methods suffer from inaccurate value estimation, especially at high noise levels, which biases…

Machine Learning · Computer Science 2025-06-27 Vineet Jain , Kusha Sareen , Mohammad Pedramfar , Siamak Ravanbakhsh

While recommender systems have become an integral component of the Web experience, their heavy reliance on user data raises privacy and security concerns. Substituting user data with synthetic data can address these concerns, but accurately…

Information Retrieval · Computer Science 2024-06-21 Derek Lilienthal , Paul Mello , Magdalini Eirinaki , Stas Tiomkin

Recent advances in generative AI have unveiled significant potential for the creation of 3D content. However, current methods either apply a pre-trained 2D diffusion model with the time-consuming score distillation sampling (SDS), or a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yuanxun Lu , Jingyang Zhang , Shiwei Li , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan , Xun Cao , Yao Yao

Modern generative models exhibit unprecedented capabilities to generate extremely realistic data. However, given the inherent compositionality of the real world, reliable use of these models in practical applications requires that they…

Machine Learning · Computer Science 2025-07-29 Maya Okawa , Ekdeep Singh Lubana , Robert P. Dick , Hidenori Tanaka

Recent advancements in generative recommendation systems, particularly in the realm of sequential recommendation tasks, have shown promise in enhancing generalization to new items. Among these approaches, diffusion-based generative…

Information Retrieval · Computer Science 2024-10-23 Guoqing Hu , Zhengyi Yang , Zhibo Cai , An Zhang , Xiang Wang

Traditional recommendation systems represent users and items as dense vectors and learn to align them in a shared latent space for relevance estimation. Recent LLM-based recommenders instead leverage natural-language representations that…

In light of the widespread success of generative models, a significant amount of research has gone into speeding up their sampling time. However, generative models are often sampled multiple times to obtain a diverse set incurring a cost…

Machine Learning · Computer Science 2023-11-27 Gabriele Corso , Yilun Xu , Valentin de Bortoli , Regina Barzilay , Tommi Jaakkola

In this study, we introduce Generative Manufacturing Systems (GMS) as a novel approach to effectively manage and coordinate autonomous manufacturing assets, thereby enhancing their responsiveness and flexibility to address a wide array of…

Machine Learning · Computer Science 2025-01-10 Xingyu Li , Fei Tao , Wei Ye , Aydin Nassehi , John W. Sutherland

Adopting contextually appropriate, audience-tailored linguistic styles is critical to the success of user-centric language generation systems (e.g., chatbots, computer-aided writing, dialog systems). While existing approaches demonstrate…

Computation and Language · Computer Science 2023-01-26 Samraj Moorjani , Adit Krishnan , Hari Sundaram , Ewa Maslowska , Aravind Sankar

The recent innovations and breakthroughs in diffusion models have significantly expanded the possibilities of generating high-quality videos for the given prompts. Most existing works tackle the single-scene scenario with only one video…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Fuchen Long , Zhaofan Qiu , Ting Yao , Tao Mei

Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible…

Machine Learning · Computer Science 2024-04-12 Minshuo Chen , Song Mei , Jianqing Fan , Mengdi Wang