English
Related papers

Related papers: Noise Consistency Training: A Native Approach for …

200 papers

One-step text-to-image generator models offer advantages such as swift inference efficiency, flexible architectures, and state-of-the-art generation performance. In this paper, we study the problem of aligning one-step generator models with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Weijian Luo

The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shelly Golan , Roy Ganz , Michael Elad

Diffusion models have emerged as powerful tools for generative tasks, producing high-quality outputs across diverse domains. However, how the generated data responds to the initial noise perturbation in diffusion models remains…

Machine Learning · Computer Science 2025-02-10 Bowen Song , Zecheng Zhang , Zhaoxu Luo , Jason Hu , Wei Yuan , Jing Jia , Zhengxu Tang , Guanyang Wang , Liyue Shen

With the rapid development of Large Language Models (LLMs), Controllable Text Generation (CTG) has become a critical technology for enhancing system reliability and user experience. Addressing the limitations of traditional methods, this…

Computation and Language · Computer Science 2025-09-23 Yan Zhuang , Yuan Sun

Diffusion models have demonstrated remarkable performance in speech synthesis, but typically require multi-step sampling, resulting in low inference efficiency. Recent studies address this issue by distilling diffusion models into…

Sound · Computer Science 2025-10-08 Tao Zhu , Yinfeng Yu , Liejun Wang , Fuchun Sun , Wendong Zheng

Transformers (Vaswani et al., 2017) have brought a remarkable improvement in the performance of neural machine translation (NMT) systems but they could be surprisingly vulnerable to noise. In this work, we try to investigate how noise…

Computation and Language · Computer Science 2021-09-13 Peyman Passban , Puneeth S. M. Saladi , Qun Liu

The success of deep learning has brought forth a wave of interest in computer hardware design to better meet the high demands of neural network inference. In particular, analog computing hardware has been heavily motivated specifically for…

Machine Learning · Computer Science 2020-01-15 Chuteng Zhou , Prad Kadambi , Matthew Mattina , Paul N. Whatmough

For deep learning-based speech enhancement (SE) systems, the training-test acoustic mismatch can cause notable performance degradation. To address the mismatch issue, numerous noise adaptation strategies have been derived. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Chi-Chang Lee , Cheng-Hung Hu , Yu-Chen Lin , Chu-Song Chen , Hsin-Min Wang , Yu Tsao

Event-based sensors offer significant advantages over traditional frame-based cameras, especially in scenarios involving rapid motion or challenging lighting conditions. However, event data frequently suffers from considerable noise,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Marcin Kowalczyk , Kamil Jeziorek , Tomasz Kryjak

To enhance the controllability of text-to-image diffusion models, existing efforts like ControlNet incorporated image-based conditional controls. In this paper, we reveal that existing methods still face significant challenges in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Li , Taojiannan Yang , Huafeng Kuang , Jie Wu , Zhaoning Wang , Xuefeng Xiao , Chen Chen

Consistency models have exhibited remarkable capabilities in facilitating efficient image/video generation, enabling synthesis with minimal sampling steps. It has proven to be advantageous in mitigating the computational burdens associated…

Sound · Computer Science 2024-04-23 Zhengcong Fei , Mingyuan Fan , Junshi Huang

Consistency distillation methods have demonstrated significant success in accelerating generative tasks of diffusion models. However, since previous consistency distillation methods use simple and straightforward strategies in selecting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Cunzheng Wang , Ziyuan Guo , Yuxuan Duan , Huaxia Li , Nemo Chen , Xu Tang , Yao Hu

Consistency models have recently been introduced to accelerate sampling from diffusion models by directly predicting the solution (i.e., data) of the probability flow ODE (PF ODE) from initial noise. However, the training of consistency…

Machine Learning · Computer Science 2025-01-24 Sangyun Lee , Yilun Xu , Tomas Geffner , Giulia Fanti , Karsten Kreis , Arash Vahdat , Weili Nie

Multi-object tracking (MOT) is a critical technology in computer vision, designed to detect multiple targets in video sequences and assign each target a unique ID per frame. Existed MOT methods excel at accurately tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Lifan Jiang , Zhihui Wang , Siqi Yin , Guangxiao Ma , Peng Zhang , Boxi Wu

Low-precision deep neural network (DNN) training has gained tremendous attention as reducing precision is one of the most effective knobs for boosting DNNs' training time/energy efficiency. In this paper, we attempt to explore low-precision…

Machine Learning · Computer Science 2025-01-07 Yonggan Fu , Han Guo , Meng Li , Xin Yang , Yining Ding , Vikas Chandra , Yingyan Celine Lin

Recent advancements in video diffusion models have significantly enhanced audio-driven portrait animation. However, current methods still suffer from flickering, identity drift, and poor audio-visual synchronization. These issues primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Zhenjie Liu , Jianzhang Lu , Renjie Lu , Cong Liang , Shangfei Wang

Recently, deep end-to-end learning has been studied for intent classification in Spoken Language Understanding (SLU). However, end-to-end models require a large amount of speech data with intent labels, and highly optimized models are…

Computation and Language · Computer Science 2024-05-27 Suyoung Kim , Jiyeon Hwang , Ho-Young Jung

The wide application of flow-matching methods has greatly promoted the development of robot imitation learning. However, these methods all face the problem of high inference time. To address this issue, researchers have proposed…

Robotics · Computer Science 2025-10-23 Yu Fang , Xinyu Wang , Xuehe Zhang , Wanli Xue , Mingwei Zhang , Shengyong Chen , Jie Zhao

Generative adversarial networks (GANs) are challenging to train stably, and a promising remedy of injecting instance noise into the discriminator input has not been very effective in practice. In this paper, we propose Diffusion-GAN, a…

Machine Learning · Computer Science 2023-08-29 Zhendong Wang , Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

The escalating demand for real-time image synthesis has driven significant advancements in one-step diffusion models, which inherently offer expedited generation speeds compared to traditional multi-step methods. However, this enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Viet Nguyen , Anh Nguyen , Trung Dao , Khoi Nguyen , Cuong Pham , Toan Tran , Anh Tran