中文
相关论文

相关论文: DEMON: Diffusion Engine for Musical Orchestrated N…

200 篇论文

Deep denoising models require extensive real-world training data, which is challenging to acquire. Current noise synthesis techniques struggle to accurately model complex noise distributions. We propose a novel Realistic Noise Synthesis…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Qi Wu , Mingyan Han , Ting Jiang , Chengzhi Jiang , Jinting Luo , Man Jiang , Haoqiang Fan , Shuaicheng Liu

In generative modeling, tokenization simplifies complex data into compact, structured representations, creating a more efficient, learnable space. For high-dimensional visual data, it reduces redundancy and emphasizes key features for…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Long Zhao , Sanghyun Woo , Ziyu Wan , Yandong Li , Han Zhang , Boqing Gong , Hartwig Adam , Xuhui Jia , Ting Liu

An ideal music synthesizer should be both interactive and expressive, generating high-fidelity audio in realtime for arbitrary combinations of instruments and notes. Recent neural synthesizers have exhibited a tradeoff between…

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

We introduce MelodyFlow, an efficient text-controllable high-fidelity music generation and editing model. It operates on continuous latent representations from a low frame rate 48 kHz stereo variational auto encoder codec. Based on a…

音频与语音处理 · 电气工程与系统科学 2024-10-17 Gael Le Lan , Bowen Shi , Zhaoheng Ni , Sidd Srinivasan , Anurag Kumar , Brian Ellis , David Kant , Varun Nagaraja , Ernie Chang , Wei-Ning Hsu , Yangyang Shi , Vikas Chandra

Building a robust underwater acoustic recognition system in real-world scenarios is challenging due to the complex underwater environment and the dynamic motion states of targets. A promising optimization approach is to leverage the…

声音 · 计算机科学 2024-11-06 Yuan Xie , Xiaowei Zhang , Jiawei Ren , Ji Xu

Tensor decomposition is an important tool for multiway data analysis. In practice, the data is often sparse yet associated with rich temporal information. Existing methods, however, often under-use the time information and ignore the…

机器学习 · 计算机科学 2023-10-31 Zheng Wang , Shikai Fang , Shibo Li , Shandian Zhe

Anomaly detection has garnered extensive applications in real industrial manufacturing due to its remarkable effectiveness and efficiency. However, previous generative-based models have been limited by suboptimal reconstruction quality,…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Hui Zhang , Zheng Wang , Dan Zeng , Zuxuan Wu , Yu-Gang Jiang

Pretrained language models have significantly advanced performance across various natural language processing tasks. However, adversarial attacks continue to pose a critical challenge to systems built using these models, as they can be…

计算与语言 · 计算机科学 2025-05-20 Zhenhao Li , Huichi Zhou , Marek Rei , Lucia Specia

The denoising process of diffusion models can be interpreted as an approximate projection of noisy samples onto the data manifold. Moreover, the noise level in these samples approximates their distance to the underlying manifold. Building…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Abulikemu Abuduweili , Chenyang Yuan , Changliu Liu , Frank Permenter

In recent years, denoising methods based on deep learning have achieved unparalleled performance at the cost of large computational complexity. In this work, we propose an Efficient Multi-stage Video Denoising algorithm, called EMVD, to…

图像与视频处理 · 电气工程与系统科学 2023-03-31 Matteo Maggioni , Yibin Huang , Cheng Li , Shuai Xiao , Zhongqian Fu , Fenglong Song

We present DiffuScene for indoor 3D scene synthesis based on a novel scene configuration denoising diffusion model. It generates 3D instance properties stored in an unordered object set and retrieves the most similar geometry for each…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Jiapeng Tang , Yinyu Nie , Lev Markhasin , Angela Dai , Justus Thies , Matthias Nießner

Real-time talking avatar generation requires low latency and minute-level temporal stability. Autoregressive (AR) forcing enables streaming inference but suffers from exposure bias, which causes errors to accumulate and become irreversible…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Liyuan Cui , Wentao Hu , Wenyuan Zhang , Zesong Yang , Fan Shi , Xiaoqiang Liu

Diffusion-based video super-resolution (VSR) methods deliver strong perceptual quality but are often unsuitable for latency-sensitive scenarios due to reliance on future frames and expensive multi-step denoising. We propose Stream-DiffVSR,…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Hau-Shiang Shiu , Chin-Yang Lin , Zhixiang Wang , Chi-Wei Hsiao , Po-Fan Yu , Yu-Chih Chen , Yu-Lun Liu

While foundation models demonstrate impressive performance across various tasks, they remain vulnerable to adversarial inputs. Current research explores various approaches to enhance model robustness, with Diffusion Denoised Smoothing…

机器学习 · 计算机科学 2025-05-22 Yury Belousov , Brian Pulfer , Vitaliy Kinakh , Slava Voloshynovskiy

The audio denoising technique has captured widespread attention in the deep neural network field. Recently, the audio denoising problem has been converted into an image generation task, and deep learning-based approaches have been applied…

声音 · 计算机科学 2024-06-14 Junhui Li , Pu Wang , Jialu Li , Youshan Zhang

While diffusion models have achieved great success in generating continuous signals such as images and audio, it remains elusive for diffusion models in learning discrete sequence data like natural languages. Although recent advances…

计算与语言 · 计算机科学 2024-05-02 Jiasheng Ye , Zaixiang Zheng , Yu Bao , Lihua Qian , Mingxuan Wang

Realistic and interactive scene simulation is a key prerequisite for autonomous vehicle (AV) development. In this work, we present SceneDiffuser, a scene-level diffusion prior designed for traffic simulation. It offers a unified framework…

Diffusion-based extreme image compression methods have achieved impressive performance at extremely low bitrates. However, constrained by the iterative denoising process that starts from pure noise, these methods are limited in both…

图像与视频处理 · 电气工程与系统科学 2025-05-27 Zhiyuan Li , Yanhui Zhou , Hao Wei , Chenyang Ge , Ajmal Mian

Many self-supervised denoising approaches have been proposed in recent years. However, these methods tend to overly smooth images, resulting in the loss of fine structures that are essential for medical applications. In this paper, we…

图像与视频处理 · 电气工程与系统科学 2025-04-02 Basar Demir , Yikang Liu , Xiao Chen , Eric Z. Chen , Lin Zhao , Boris Mailhe , Terrence Chen , Shanhui Sun