English
Related papers

Related papers: Few-Step Diffusion Language Models via Trajectory …

200 papers

Knowledge distillation (KD) is an essential technique to compress large language models (LLMs) into smaller ones. However, despite the distinct roles of the student model and the teacher model in KD, most existing frameworks still use a…

Computation and Language · Computer Science 2026-03-25 Songming Zhang , Xue Zhang , Tong Zhang , Bojie Hu , Yufeng Chen , Jinan Xu

Knowledge distillation allows smaller neural networks to emulate the performance of larger, teacher models with reduced computational demands. Traditional methods for Large Language Models (LLMs) often necessitate extensive fine-tuning,…

Computation and Language · Computer Science 2025-05-02 Tyler McDonald , Ali Emami

Reinforcement learning (RL) can be used to improve the policy (denoiser) of diffusion large language models (dLLMs), while being hindered by the intractability of the policy likelihood. A dominant and efficient family of methods replaces…

Machine Learning · Computer Science 2026-05-29 Xiaohang Tang , Keyue Jiang , Che Liu , Qifang Zhao , Xiaoxiao Xu , Sangwoong Yoon , Ilija Bogunovic

Fast and high-quality language generation is the holy grail that people pursue in the age of AI. In this work, we introduce Discrete Diffusion Divergence Instruct (DiDi-Instruct), a training-based method that initializes from a pre-trained…

Computation and Language · Computer Science 2026-03-13 Haoyang Zheng , Xinyang Liu , Cindy Xiangrui Kong , Nan Jiang , Zheyuan Hu , Weijian Luo , Wei Deng , Guang Lin

Distillation enables compact Vision-Language Models (VLMs) to obtain strong reasoning capabilities, yet the prompts driving this process are typically chosen via simple heuristics or aggregated from off-the-shelf datasets. We reveal a…

Machine Learning · Computer Science 2026-05-20 Jaehun Jung , Hyunwoo Kim , Brandon Cui , Ximing Lu , David Acuna , Prithviraj Ammanabrolu , Yejin Choi

Diffusion language models intrinsically fail to capture correlations between decoded tokens, which leads to a harsh trade-off between sampling quality and throughput. To solve this issue, we propose DiLaDiff, a variant of masked diffusion…

Machine Learning · Computer Science 2026-05-25 Jean-Marie Lemercier , Tomas Geffner , Karsten Kreis , Morteza Mardani , Arash Vahdat , Ante Jukić

Recent advances in few-step diffusion distillation have enabled efficient image generation, yet aligning these models with human preferences remains challenging. We propose Reward-Tilted Distribution Matching Distillation (RTDMD), a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yushi Huang , Xiangxin Zhou , Ruoyu Wang , Chi Zhang , Jun Zhang , Tianyu Pang

The surge in Large Language Models (LLMs) has revolutionized natural language processing, but fine-tuning them for specific tasks often encounters challenges in balancing performance and preserving general instruction-following abilities.…

Computation and Language · Computer Science 2024-05-29 Zhaorui Yang , Tianyu Pang , Haozhe Feng , Han Wang , Wei Chen , Minfeng Zhu , Qian Liu

In the realm of large language model (LLM), as the size of large models increases, it also brings higher training costs. There is a urgent need to minimize the data size in LLM training. Compared with data selection method, the data…

Computation and Language · Computer Science 2025-04-25 Rong Yao , Hailin Hu , Yifei Fu , Hanting Chen , Wenyi Fang , Fanyi Du , Kai Han , Yunhe Wang

Diffusion trajectory distillation accelerates sampling by training a student model to approximate the multi-step denoising trajectories of a pretrained teacher model using far fewer steps. Despite strong empirical results, the trade-off…

Machine Learning · Computer Science 2026-04-28 Weiguo Gao , Ming Li

Diffusion-based stylization methods typically denoise from a specific partial noise state for image-to-image and video-to-video tasks. This multi-step diffusion process is computationally expensive and hinders real-world application. A…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sijie Xu , Runqi Wang , Wei Zhu , Dejia Song , Nemo Chen , Xu Tang , Yao Hu

Knowledge distillation (KD) has shown great promise in transferring knowledge from larger teacher models to smaller student models. However, existing KD strategies for large language models often minimize output distributions between…

Computation and Language · Computer Science 2024-12-23 Yuncheng Song , Liang Ding , Changtong Zan , Shujian Huang

Diffusion Models (DMs) have achieved great success in image generation and other fields. By fine sampling through the trajectory defined by the SDE/ODE solver based on a well-trained score model, DMs can generate remarkable high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Bowen Zheng , Tianming Yang

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chuhan Wang , Hao Chen

Large language models (LLMs) have shown promising self-correction abilities, where iterative refinement improves the quality of generated responses. However, most existing approaches operate at the level of output critique, patching surface…

Artificial Intelligence · Computer Science 2026-02-03 Hossein A. Rahmani , Mengting Wan , Pei Zhou , Longqi Yang , Nick Craswell , Emine Yilmaz , Sujay Kumar Jauhar

Diffusion distillation has emerged as a promising strategy for accelerating text-to-image (T2I) diffusion models by distilling a pretrained score network into a one- or few-step generator. While existing methods have made notable progress,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Mingyuan Zhou , Yi Gu , Zhendong Wang

While diffusion distillation has enabled one-step generation through methods like Variational Score Distillation, adapting distilled models to emerging new controls -- such as novel structural constraints or latest user preferences --…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yihong Luo , Tianyang Hu , Yifan Song , Jiacheng Sun , Zhenguo Li , Jing Tang

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

Machine Learning · Computer Science 2025-06-12 Bowen Zheng , Tianming Yang

This paper studies the problem of pre-training for small models, which is essential for many mobile devices. Current state-of-the-art methods on this problem transfer the representational knowledge of a large network (as a Teacher) into a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mingsheng Li , Lin Zhang , Mingzhen Zhu , Zilong Huang , Gang Yu , Jiayuan Fan , Tao Chen

Recent advances in masked diffusion language models (MDLMs) narrow the quality gap to autoregressive LMs, but their sampling remains expensive because generation requires many full-sequence denoising passes with a large Transformer and,…

Machine Learning · Computer Science 2026-04-14 Ivan Sedykh , Nikita Sorokin , Valentin Malykh