English
Related papers

Related papers: d2: Improved Techniques for Training Reasoning Dif…

200 papers

While Diffusion Language Models (DLMs) are theoretically well-suited for iterative refinement due to their non-causal structure, they often fail to reliably revise incorrect tokens in practice. The key challenge lies in the model's…

Machine Learning · Computer Science 2026-01-30 Shuibai Zhang , Fred Zhangzhi Peng , Yiheng Zhang , Jin Pan , Grigorios G. Chrysos

The key challenge in semantic search is to create models that are both accurate and efficient in pinpointing relevant sentences for queries. While BERT-style bi-encoders excel in efficiency with pre-computed embeddings, they often miss…

Computation and Language · Computer Science 2024-06-26 Zihan Liao , Hang Yu , Jianguo Li , Jun Wang , Wei Zhang

Diffusion Language Models (DLMs) offer a promising alternative for language modeling by enabling parallel decoding through iterative refinement. However, most DLMs rely on hard binary masking and discrete token assignments, which hinder the…

Computation and Language · Computer Science 2026-01-19 Linhao Zhong , Linyu Wu , Bozhen Fang , Tianjian Feng , Chenchen Jing , Wen Wang , Jiaheng Zhang , Hao Chen , Chunhua Shen

We present LLaDA2.0-Uni, a unified discrete diffusion large language model (dLLM) that supports multimodal understanding and generation within a natively integrated framework. Its architecture combines a fully semantic discrete tokenizer, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Inclusion AI , Tiwei Bie , Haoxing Chen , Tieyuan Chen , Zhenglin Cheng , Long Cui , Kai Gan , Zhicheng Huang , Zhenzhong Lan , Haoquan Li , Jianguo Li , Tao Lin , Qi Qin , Hongjun Wang , Xiaomei Wang , Haoyuan Wu , Yi Xin , Junbo Zhao

Diffusion Large Language Models (dLLMs) have emerged as a promising alternative to autoregressive (AR) LLMs for text generation, with the potential to decode multiple tokens in a single iteration. However, none of the existing open-source…

Machine Learning · Computer Science 2025-08-14 Xu Wang , Chenkai Xu , Yijie Jin , Jiachun Jin , Hao Zhang , Zhijie Deng

Recent advances in diffusion language models (DLMs) have presented a promising alternative to traditional autoregressive large language models (LLMs). However, DLMs still lag behind LLMs in reasoning performance, especially as the number of…

Computation and Language · Computer Science 2025-10-27 Chenglong Wang , Yang Gan , Hang Zhou , Chi Hu , Yongyu Mu , Kai Song , Murun Yang , Bei Li , Chunliang Zhang , Tongran Liu , Jingbo Zhu , Zhengtao Yu , Tong Xiao

We introduce the Diffusion Chain of Lateral Thought (DCoLT), a reasoning framework for diffusion language models. DCoLT treats each intermediate step in the reverse diffusion process as a latent "thinking" action and optimizes the entire…

Computation and Language · Computer Science 2025-11-03 Zemin Huang , Zhiyang Chen , Zijun Wang , Tiancheng Li , Guo-Jun Qi

Diffusion large language models (dLLMs), which offer a promising alternative to traditional autoregressive LLMs, have recently shown strong results in pretraining. However, due to their lack of tractable sequence-level likelihoods, they…

Machine Learning · Computer Science 2026-02-03 Anthony Zhan

Diffusion language models (DLMs) offer a promising path toward low-latency generation through parallel decoding, but their practical efficiency depends heavily on the decoding trajectory. In practice, this advantage often fails to fully…

Computation and Language · Computer Science 2026-04-02 Lingjie Chen , Ruizhong Qiu , Yuyu Fan , Yanjun Zhao , Hanghang Tong

Masked diffusion language models (MDLMs) have recently emerged as a promising alternative to autoregressive (AR) language models, offering properties such as parallel decoding, flexible generation orders, and the potential for fewer…

Computation and Language · Computer Science 2025-09-30 Jingyi Yang , Guanxu Chen , Xuhao Hu , Jing Shao

Reinforcement learning (RL) has been effective for post-training autoregressive (AR) language models, but extending these methods to diffusion language models (DLMs) is challenging due to intractable sequence-level likelihoods. Existing…

Autoregressive (AR) language models and Diffusion Language Models (DLMs) constitute the two principal paradigms of large language models. However, both paradigms suffer from insufficient reasoning capabilities. Human reasoning inherently…

Computation and Language · Computer Science 2025-12-01 Kairong Han , Nuanqiao Shan , Ziyu Zhao , Zijing Hu , Xinpeng Dong , Junjian Ye , Lujia Pan , Fei Wu , Kun Kuang

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive (AR) models for language modeling, allowing flexible generation order and parallel generation of multiple tokens. However, this flexibility…

Machine Learning · Computer Science 2026-03-24 Changxiao Cai , Gen Li

Autoregressive language models decode left-to-right with irreversible commitments, limiting revision during multi-step reasoning. We propose \textbf{VDLM}, a modular variable diffusion language model that separates semantic planning from…

Computation and Language · Computer Science 2026-02-19 Shuhui Qu

Diffusion large language models (dLLMs) enable any-order generation, but this flexibility enlarges the attack surface: harmful spans may appear at arbitrary positions, and template-based prefilling attacks such as DIJA bypass response-level…

Computation and Language · Computer Science 2026-02-04 Wonje Jeung , Sangyeon Yoon , Yoonjun Cho , Dongjae Jeon , Sangwoo Shin , Hyesoo Hong , Albert No

Reasoning is essential for large language models (LLMs), especially in complex tasks such as mathematical problem solving. However, multimodal reasoning still faces challenges in modality alignment and training scalability, as many existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yahan Yu , Yuyang Dong , Masafumi Oyamada

Reinforcement learning has become a central paradigm for improving LLM reasoning, but most existing methods optimize policies over discrete token sequences. This creates a mismatch between the optimization space and the structure of…

Machine Learning · Computer Science 2026-05-19 Haoqiang Kang , Yizhe Zhang , Nikki Lijing Kuang , Yi-An Ma , Lianhui Qin

We propose TraceRL, a trajectory-aware reinforcement learning framework for diffusion language models (DLMs) that incorporates preferred inference trajectory into post-training, and is applicable across different architectures. Equipped…

Computation and Language · Computer Science 2025-09-09 Yinjie Wang , Ling Yang , Bowen Li , Ye Tian , Ke Shen , Mengdi Wang

Diffusion (Large) Language Models (dLLMs) now match the downstream performance of their autoregressive counterparts on many tasks, while holding the promise of being more efficient during inference. One critical design aspect of dLLMs is…

Recent advances in large language models (LLMs) have inspired new paradigms for document reranking. While this paradigm better exploits the reasoning and contextual understanding capabilities of LLMs, most existing LLM-based rerankers rely…

Information Retrieval · Computer Science 2026-02-16 Qi Liu , Kun Ai , Jiaxin Mao , Yanzhao Zhang , Mingxin Li , Dingkun Long , Pengjun Xie , Fengbin Zhu , Ji-Rong Wen