English
Related papers

Related papers: Diff4Steer: Steerable Diffusion Prior for Generati…

200 papers

Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yanbo Xu , Jayanth Srinivasa , Gaowen Liu , Shubham Tulsiani

Interactive streaming music generation promises the use of generative models for live performance and co-creation that is impossible with offline models. However, SOTA models exist in the discrete-AR regime, requiring industrial levels of…

Mainstream solutions to Sequential Recommendation (SR) represent items with fixed vectors. These vectors have limited capability in capturing items' latent aspects and users' diverse preferences. As a new generative paradigm, Diffusion…

Information Retrieval · Computer Science 2023-10-31 Zihao Li , Aixin Sun , Chenliang Li

The slow inference process of image diffusion models significantly degrades interactive user experiences. To address this, we introduce Diffusion Preview, a novel paradigm employing rapid, low-step sampling to generate preliminary outputs…

Machine Learning · Computer Science 2026-04-08 Fu-Yun Wang , Hao Zhou , Liangzhe Yuan , Sanghyun Woo , Boqing Gong , Bohyung Han , Ming-Hsuan Yang , Han Zhang , Yukun Zhu , Ting Liu , Long Zhao

Score-based models generate samples by mapping noise to data (and vice versa) via a high-dimensional diffusion process. We question whether it is necessary to run this entire process at high dimensionality and incur all the inconveniences…

Machine Learning · Computer Science 2023-02-28 Bowen Jing , Gabriele Corso , Renato Berlinghieri , Tommi Jaakkola

Dataset distillation has emerged as an effective strategy, significantly reducing training costs and facilitating more efficient model deployment. Recent advances have leveraged generative models to distill datasets by capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jeffrey A. Chan-Santiago , Praveen Tirupattur , Gaurav Kumar Nayak , Gaowen Liu , Mubarak Shah

Music representations are the backbone of modern recommendation systems, powering playlist generation, similarity search, and personalized discovery. Yet most embeddings offer little control for adjusting a single musical attribute, e.g.,…

3D human motion generation is crucial for creative industry. Recent advances rely on generative models with domain knowledge for text-driven motion generation, leading to substantial progress in capturing common motions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Mingyuan Zhang , Xinying Guo , Liang Pan , Zhongang Cai , Fangzhou Hong , Huirong Li , Lei Yang , Ziwei Liu

Dataset distillation offers a lightweight synthetic dataset for fast network training with promising test accuracy. To imitate the performance of the original dataset, most approaches employ bi-level optimization and the distillation space…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Duo Su , Junjie Hou , Weizhi Gao , Yingjie Tian , Bowen Tang

Generating long-term, coherent, and realistic music-conditioned dance sequences remains a challenging task in human motion synthesis. Existing approaches exhibit critical limitations: motion graph methods rely on fixed template libraries,…

Sound · Computer Science 2025-06-04 Mingyang Huang , Peng Zhang , Bang Zhang

Diffusion-based recommender systems (DR) have gained increasing attention for their advanced generative and denoising capabilities. However, existing DR face two central limitations: (i) a trade-off between enhancing generative capacity via…

Information Retrieval · Computer Science 2025-02-03 Gyuseok Lee , Yaochen Zhu , Hwanjo Yu , Yao Zhou , Jundong Li

Many creative multimedia systems are built upon visual primitives such as strokes or textures, which are difficult to collect at scale and fundamentally different from natural image data. This data scarcity makes it challenging for modern…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Dantong Qin , Alessandro Bozzon , Xian Yang , Xun Zhang , Yike Guo , Pan Wang

Symbolic music generation aims to create musical notes, which can help users compose music, such as generating target instrument tracks based on provided source tracks. In practical scenarios where there's a predefined ensemble of tracks…

Sound · Computer Science 2023-10-02 Ang Lv , Xu Tan , Peiling Lu , Wei Ye , Shikun Zhang , Jiang Bian , Rui Yan

Discrete diffusion models generate sequences by iteratively denoising samples corrupted by categorical noise, offering an appealing alternative to autoregressive decoding for structured and symbolic generation. However, standard training…

Machine Learning · Computer Science 2026-02-04 Huu Binh Ta , Michael Cardei , Alvaro Velasquez , Ferdinando Fioretto

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent \textit{multi-step iterations} and \textit{complex backbone networks} lead to…

Although recent research applying text-to-image (T2I) diffusion models to real-world super-resolution (SR) has achieved remarkable progress, the misalignment of their targets leads to a suboptimal trade-off between inference speed and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yan Wang , Shijie Zhao , Kexin Zhang , Junlin Li , Li Zhang

A dramatic influx of diffusion-generated images has marked recent years, posing unique challenges to current detection technologies. While the task of identifying these images falls under binary classification, a seemingly straightforward…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yewon Lim , Changyeon Lee , Aerin Kim , Oren Etzioni

Recent literature has effectively leveraged diffusion models trained on continuous variables as priors for solving inverse problems. Notably, discrete diffusion models with discrete latent codes have shown strong performance, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Naoki Murata , Chieh-Hsin Lai , Yuhta Takida , Toshimitsu Uesaka , Bac Nguyen , Stefano Ermon , Yuki Mitsufuji

Recent advancements in Natural Language Processing (NLP) have led to the development of NLP-based recommender systems that have shown superior performance. However, current models commonly treat items as mere IDs and adopt discriminative…

Information Retrieval · Computer Science 2023-04-11 Jinming Li , Wentao Zhang , Tian Wang , Guanglei Xiong , Alan Lu , Gerard Medioni

Mixing style transfer automates the generation of a multitrack mix for a given set of tracks by inferring production attributes from a reference song. However, existing systems for mixing style transfer are limited in that they often…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-15 Soumya Sai Vanka , Christian Steinmetz , Jean-Baptiste Rolland , Joshua Reiss , George Fazekas