English
Related papers

Related papers: Live Music Diffusion Models: Efficient Fine-Tuning…

200 papers

Predictive models trained on imbalanced data tend to produce biased results. This problem is exacerbated when there is not just one output label, but a set of them. This is the case for multilabel learning (MLL) algorithms used to classify…

Machine Learning · Computer Science 2025-01-22 Francisco Charte , Miguel Ángel Dávila , María Dolores Pérez-Godoy , María José del Jesus

In this paper, we focus on Dynamic Execution techniques that optimize the computation flow based on input. This aims to identify simpler problems that can be solved using fewer resources, similar to human cognition. The techniques discussed…

Machine Learning · Computer Science 2024-11-05 Haim Barad , Jascha Achterberg , Tien Pei Chou , Jean Yu

The ability to automatically generate music that appropriately matches an arbitrary input track is a challenging task. We present a novel controllable system for generating single stems to accompany musical mixes of arbitrary length. At the…

Sound · Computer Science 2024-02-05 Marco Pasini , Maarten Grachten , Stefan Lattner

Generative Diffusion Models (GDMs) have emerged as key components of Generative Artificial Intelligence (GenAI), offering unparalleled expressiveness and controllability for complex data generation tasks. However, their deployment in…

Networking and Internet Architecture · Computer Science 2025-08-13 Hamidreza Mazandarani , Mohammad Farhoudi , Masoud Shokrnezhad , Tarik Taleb

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Jian-Qing Zheng , Yuanhan Mo , Yang Sun , Jiahua Li , Fuping Wu , Ziyang Wang , Tonia Vincent , Bartłomiej W. Papież

Diffusion-based text-to-image generation models trade latency for quality: small models are fast but generate lower-quality images, while large models produce better images but are slow. We present MoDM, a novel caching-based serving system…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-05 Yuchen Xia , Divyam Sharma , Yichao Yuan , Souvik Kundu , Nishil Talati

Diffusion models excel at capturing the natural design spaces of images, molecules, DNA, RNA, and protein sequences. However, rather than merely generating designs that are natural, we often aim to optimize downstream reward functions while…

The ability to generate virtual environments is crucial for applications ranging from gaming to physical AI domains such as robotics, autonomous driving, and industrial AI. Current learning-based 3D reconstruction methods rely on the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Sherwin Bahmani , Tianchang Shen , Jiawei Ren , Jiahui Huang , Yifeng Jiang , Haithem Turki , Andrea Tagliasacchi , David B. Lindell , Zan Gojcic , Sanja Fidler , Huan Ling , Jun Gao , Xuanchi Ren

Consistency models have exhibited remarkable capabilities in facilitating efficient image/video generation, enabling synthesis with minimal sampling steps. It has proven to be advantageous in mitigating the computational burdens associated…

Sound · Computer Science 2024-04-23 Zhengcong Fei , Mingyuan Fan , Junshi Huang

Denoising Diffusion Models (DDMs) have become a popular tool for generating high-quality samples from complex data distributions. These models are able to capture sophisticated patterns and structures in the data, and can generate samples…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Emanuele Aiello , Diego Valsesia , Enrico Magli

While deep neural networks (NN) significantly advance image compressed sensing (CS) by improving reconstruction quality, the necessity of training current CS NNs from scratch constrains their effectiveness and hampers rapid deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Chen , Zhenyu Zhang , Weiqi Li , Chen Zhao , Jiwen Yu , Shijie Zhao , Jie Chen , Jian Zhang

The popularity of applying machine learning techniques in musical domains has created an inherent availability of freely accessible pre-trained neural network (NN) models ready for use in creative applications. This work outlines the…

Human-Computer Interaction · Computer Science 2020-12-07 Rohan Proctor , Charles Patrick Martin

Diffusion and flow-matching models have revolutionized automatic text-to-audio generation in recent times. These models are increasingly capable of generating high quality and faithful audio outputs capturing to speech and acoustic events.…

In this work, we define a diffusion-based generative model capable of both music synthesis and source separation by learning the score of the joint probability density of sources sharing a context. Alongside the classic total inference…

In latent diffusion models (LDMs), denoising diffusion process efficiently takes place on latent space whose dimension is lower than that of pixel space. Decoder is typically used to transform the representation in latent space to that in…

Machine Learning · Computer Science 2024-09-30 Seongmin Hong , Suh Yoon Jeon , Kyeonghyun Lee , Ernest K. Ryu , Se Young Chun

Accelerating diffusion model sampling is crucial for efficient AIGC deployment. While diffusion distillation methods -- based on distribution matching and trajectory matching -- reduce sampling to as few as one step, they fall short on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yihong Luo , Tianyang Hu , Jiacheng Sun , Yujun Cai , Jing Tang

Deep generative models offer a powerful alternative to conventional channel estimation by learning the complex prior distribution of wireless channels. Capitalizing on this potential, this paper proposes a novel channel estimation algorithm…

Information Theory · Computer Science 2025-10-27 Xiaotian Fan , Xingyu Zhou , Le Liang , Shi Jin

The recent developments of Diffusion Models (DMs) enable generation of astonishingly high-quality synthetic samples. Recent work showed that the synthetic samples generated by the diffusion model, which is pre-trained on public data and…

Machine Learning · Computer Science 2024-06-11 Jing Liu , Andrew Lowy , Toshiaki Koike-Akino , Kieran Parsons , Ye Wang

While latent diffusion models (LDMs), such as Stable Diffusion, are designed for high-resolution (HR) image generation, they often struggle with significant structural distortions when generating images at resolutions higher than their…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Boyuan Cao , Jiaxin Ye , Yujie Wei , Hongming Shan

Diffusion models are the de facto approach for generating high-quality images and videos, but learning high-dimensional models remains a formidable task due to computational and optimization challenges. Existing methods often resort to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jiatao Gu , Shuangfei Zhai , Yizhe Zhang , Josh Susskind , Navdeep Jaitly