English
Related papers

Related papers: Layer Collapse in Diffusion Language Models

200 papers

Diffusion Language Models (DLMs) enable fast generation, yet training large DLMs from scratch is costly. As a practical shortcut, adapting off-the-shelf Auto-Regressive (AR) model weights into a DLM could quickly equip the DLM with strong…

Computation and Language · Computer Science 2026-02-02 Yuchuan Tian , Yuchen Liang , Shuo Zhang , Yingte Shu , Guangwen Yang , Wei He , Sibo Fang , Tianyu Guo , Kai Han , Chao Xu , Hanting Chen , Xinghao Chen , Yunhe Wang

Diffusion language models intrinsically fail to capture correlations between decoded tokens, which leads to a harsh trade-off between sampling quality and throughput. To solve this issue, we propose DiLaDiff, a variant of masked diffusion…

Machine Learning · Computer Science 2026-05-25 Jean-Marie Lemercier , Tomas Geffner , Karsten Kreis , Morteza Mardani , Arash Vahdat , Ante Jukić

Effective LLM training depends on predictable scaling of key quantities -- such as final loss and optimal hyperparameters -- with model and dataset size. Qiu et al. (2025) recently showed that this predictability can extend beyond scalars:…

Machine Learning · Computer Science 2026-03-03 Shane Bergsma , Bin Claire Zhang , Nolan Dey , Shaheer Muhammad , Gurpreet Gosal , Joel Hestness

The full-size MLPs and the projection layers in attention introduce tremendous model sizes of large language models (LLMs), consuming extensive computational resources in pre-training. We empirically observe that the activations of…

Machine Learning · Computer Science 2025-10-03 Ziyue Liu , Ruijie Zhang , Zhengyang Wang , Mingsong Yan , Zi Yang , Paul Hovland , Bogdan Nicolae , Franck Cappello , Sui Tang , Zheng Zhang

We introduce the Diffusion Chain of Lateral Thought (DCoLT), a reasoning framework for diffusion language models. DCoLT treats each intermediate step in the reverse diffusion process as a latent "thinking" action and optimizes the entire…

Computation and Language · Computer Science 2025-11-03 Zemin Huang , Zhiyang Chen , Zijun Wang , Tiancheng Li , Guo-Jun Qi

Multimodal Large Language Models (MLLMs) have demonstrated strong capabilities across a wide range of vision language tasks. However, when applied to large scale image classification, their performance degrades significantly as the label…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhipeng Ye , Jiaqi Huang , Feng Jiang , Qiufeng Wang , Yikang Duan , Dawei Wang , Xihang Zhou , Qian Qiao

Discrete Diffusion Language Models progressed rapidly as an alternative to autoregressive (AR) models, motivated by their parallel generation abilities. However, for tractability, discrete diffusion models sample from a factorized…

Machine Learning · Computer Science 2026-05-19 Justin Deschenaux , Caglar Gulcehre

Diffusion-based language models are emerging as a promising alternative to autoregressive LMs: they approach the competence of autoregressive LMs while offering nuanced controllability at inference time. While autoregressive LMs have…

Computation and Language · Computer Science 2024-02-15 Xiaochuang Han , Sachin Kumar , Yulia Tsvetkov , Marjan Ghazvininejad

With the emergence of diffusion models as a frontline generative model, many researchers have proposed molecule generation techniques with conditional diffusion models. However, the unavoidable discreteness of a molecule makes it difficult…

Machine Learning · Computer Science 2025-06-05 Jinho Chang , Jong Chul Ye

Post-training improves instruction-following and helpfulness of large language models (LLMs) but often reduces generation diversity, which leads to repetitive outputs in open-ended settings, a phenomenon known as mode collapse. Motivated by…

Computation and Language · Computer Science 2026-02-09 Bowen Zhang , Meiyi Wang , Harold Soh

Large language models (LLMs) excel at capturing global token dependencies via self-attention but face prohibitive compute and memory costs on lengthy inputs. While sub-quadratic methods (e.g., linear attention) can reduce these costs, they…

Machine Learning · Computer Science 2025-06-18 Yeonju Ro , Zhenyu Zhang , Souvik Kundu , Zhangyang Wang , Aditya Akella

Diffusion large language models (dLLMs) offer capabilities beyond those of autoregressive (AR) LLMs, such as parallel decoding and random-order generation. However, realizing these benefits in practice is non-trivial, as dLLMs inherently…

Machine Learning · Computer Science 2026-01-30 Yu-Yang Qian , Junda Su , Lanxiang Hu , Peiyuan Zhang , Zhijie Deng , Peng Zhao , Hao Zhang

Masked diffusion models (MDMs) have emerged as a promising alternative to autoregressive models (ARMs) for language modeling. However, MDMs are known to learn substantially more slowly than ARMs, which may become problematic when scaling…

Machine Learning · Computer Science 2026-05-14 Chunsan Hong , Sanghyun Lee , Chieh-Hsin Lai , Satoshi Hayakawa , Yuhta Takida , Yuki Mitsufuji , Seungryong Kim , Jong Chul Ye

Existing approaches for analyzing neural network activations, such as PCA and sparse autoencoders, rely on strong structural assumptions. Generative models offer an alternative: they can uncover structure without such assumptions and act as…

Machine Learning · Computer Science 2026-02-09 Grace Luo , Jiahai Feng , Trevor Darrell , Alec Radford , Jacob Steinhardt

Latent Dirichlet Allocation (LDA) is a topic model widely used in natural language processing and machine learning. Most approaches to training the model rely on iterative algorithms, which makes it difficult to run LDA on big corpora that…

Machine Learning · Statistics 2020-10-23 Alexander Terenin , Måns Magnusson , Leif Jonsson , David Draper

While Large Language Models (LLMs) demonstrate exceptional performance in surface-level text generation, their nature in handling complex multi-step reasoning tasks often remains one of ``statistical fitting'' rather than systematic logical…

Machine Learning · Computer Science 2026-01-27 Lianlei Shan , Han Chen , Yixuan Wang , Zhenjie Liu , Wei Li

Large Language Models (LLMs) have significantly advanced text understanding and generation, becoming integral to applications across education, software development, healthcare, entertainment, and legal services. Despite considerable…

Cryptography and Security · Computer Science 2025-03-04 Junzhe Yu , Yi Liu , Huijia Sun , Ling Shi , Yuqi Chen

Adapting Large Language Models (LLMs) to downstream tasks using Reinforcement Learning (RL) has proven to be an effective approach. However, LLMs do not inherently define the structure of an agent for RL training, particularly in terms of…

Computation and Language · Computer Science 2025-03-28 Chengxing Jia , Ziniu Li , Pengyuan Wang , Yi-Chen Li , Zhenyu Hou , Yuxiao Dong , Yang Yu

Current Video Large Language Models (Video LLMs) typically encode frames via a vision encoder and employ an autoregressive (AR) LLM for understanding and generation. However, this AR paradigm inevitably faces a dual efficiency bottleneck:…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zhihao He , Tieyuan Chen , Kangyu Wang , Ziran Qin , Yang Shao , Chaofan Gan , Shijie Li , Zuxuan Wu , Weiyao Lin

Diffusion language models (DLMs) generate text through iterative denoising, but inference requires full-sequence attention at every iteration, resulting in substantial redundant computation on masked tokens. Block-wise diffusion can reduce…

Machine Learning · Computer Science 2026-02-03 Fengrui Zuo , Zhiwei Ke , Yiming Liu , Wenqi Lou , Chao Wang , Xuehai Zhou