English
Related papers

Related papers: Diff4Steer: Steerable Diffusion Prior for Generati…

200 papers

This paper aims to apply a new deep learning approach to the task of generating raw audio files. It is based on diffusion models, a recent type of deep generative model. This new type of method has recently shown outstanding results with…

Sound · Computer Science 2023-07-21 Svetlana Pavlova

Interior design is a complex and creative discipline involving aesthetics, functionality, ergonomics, and materials science. Effective solutions must meet diverse requirements, typically producing multiple deliverables such as renderings…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yuxuan Yang , Tao Geng

Generative models such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) are widely utilized to model the generative process of user interactions. However, these generative models suffer from intrinsic…

Information Retrieval · Computer Science 2025-06-26 Wenjie Wang , Yiyan Xu , Fuli Feng , Xinyu Lin , Xiangnan He , Tat-Seng Chua

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

We propose DiffuStereo, a novel system using only sparse cameras (8 in this work) for high-quality 3D human reconstruction. At its core is a novel diffusion-based stereo module, which introduces diffusion models, a type of powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Ruizhi Shao , Zerong Zheng , Hongwen Zhang , Jingxiang Sun , Yebin Liu

We present a novel approach for generating minority samples that live on low-density regions of a data manifold. Our framework is built upon diffusion models, leveraging the principle of guided sampling that incorporates an arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Soobin Um , Jong Chul Ye

Reranking plays a crucial role in modern multi-stage recommender systems by rearranging the initial ranking list to model interplay between items. Considering the inherent challenges of reranking such as combinatorial searching space, some…

Information Retrieval · Computer Science 2023-08-15 Xiao Lin , Xiaokai Chen , Chenyang Wang , Hantao Shu , Linfeng Song , Biao Li , Peng jiang

Music editing is an important step in music production, which has broad applications, including game development and film production. Most existing zero-shot text-guided editing methods rely on pretrained diffusion models by involving…

Guiding unconditional diffusion models typically requires either retraining with conditional inputs or per-step gradient computations (e.g., classifier-based guidance), both of which incur substantial computational overhead. We present a…

Machine Learning · Computer Science 2026-02-13 Qingsong Wang , Mikhail Belkin , Yusu Wang

Dataset bias is a significant challenge in machine learning, where specific attributes, such as texture or color of the images are unintentionally learned resulting in detrimental performance. To address this, previous efforts have focused…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Donggeun Ko , Sangwoo Jo , Dongjun Lee , Namjun Park , Jaekwang Kim

Recent advancements in deep generative models present new opportunities for music production but also pose challenges, such as high computational demands and limited audio quality. Moreover, current systems frequently rely solely on text…

Sound · Computer Science 2024-10-31 Javier Nistal , Marco Pasini , Cyran Aouameur , Maarten Grachten , Stefan Lattner

Current 4D generation methods have achieved noteworthy efficacy with the aid of advanced diffusion generative models. However, these methods lack multi-view spatial-temporal modeling and encounter challenges in integrating diverse prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

Formulating information retrieval as a variant of generative modeling, specifically using autoregressive models to generate relevant identifiers for a given query, has recently attracted considerable attention. However, its application to…

Information Retrieval · Computer Science 2025-10-23 Changjiang Zhou , Ruqing Zhang , Jiafeng Guo , Yu-An Liu , Fan Zhang , Ganyuan Luo , Xueqi Cheng

Recommender systems predict personalized item rankings based on user preference distributions derived from historical behavior data. Recently, diffusion models (DMs) have gained attention in recommendation for their ability to model complex…

Information Retrieval · Computer Science 2025-04-22 Shuo Liu , An Zhang , Guoqing Hu , Hong Qian , Tat-seng Chua

Stereo images are fundamental to numerous applications, including extended reality (XR) devices, autonomous driving, and robotics. Unfortunately, acquiring high-quality stereo images remains challenging due to the precise calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Feng Qiao , Zhexiao Xiong , Eric Xing , Nathan Jacobs

Music editing primarily entails the modification of instrument tracks or remixing in the whole, which offers a novel reinterpretation of the original piece through a series of operations. These music processing methods hold immense…

Sound · Computer Science 2023-12-13 Bing Han , Junyu Dai , Weituo Hao , Xinyan He , Dong Guo , Jitong Chen , Yuxuan Wang , Yanmin Qian , Xuchen Song

This work proposes a novel channel estimator based on diffusion models (DMs), one of the currently top-rated generative models. Contrary to related works utilizing generative priors, a lightweight convolutional neural network (CNN) with…

Signal Processing · Electrical Eng. & Systems 2024-03-07 Benedikt Fesl , Michael Baur , Florian Strasser , Michael Joham , Wolfgang Utschick

Understanding how large audio models represent music, and using that understanding to steer generation, is both challenging and underexplored. Inspired by mechanistic interpretability in language models, where direction vectors in…

When hearing music, it is natural for people to dance to its rhythm. Automatic dance generation, however, is a challenging task due to the physical constraints of human motion and rhythmic alignment with target music. Conventional…

Graphics · Computer Science 2023-08-08 Qiaosong Qi , Le Zhuo , Aixi Zhang , Yue Liao , Fei Fang , Si Liu , Shuicheng Yan

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen