English
Related papers

Related papers: DiffuReason: Bridging Latent Reasoning and Generat…

200 papers

We present DiffusionBERT, a new generative masked language model based on discrete diffusion models. Diffusion models and many pre-trained language models have a shared training objective, i.e., denoising, making it possible to combine the…

Computation and Language · Computer Science 2022-12-02 Zhengfu He , Tianxiang Sun , Kuanning Wang , Xuanjing Huang , Xipeng Qiu

Recommender systems predict personalized item rankings based on user preference distributions derived from historical behavior data. Recently, diffusion models (DMs) have gained attention in recommendation for their ability to model complex…

Information Retrieval · Computer Science 2025-04-22 Shuo Liu , An Zhang , Guoqing Hu , Hong Qian , Tat-seng Chua

Diffusion large language models (dLLMs) are emerging as promising alternatives to autoregressive (AR) LLMs. Recently, this paradigm has been extended to multimodal tasks, leading to the development of diffusion multimodal large language…

Artificial Intelligence · Computer Science 2026-04-08 Keuntae Kim , Mingyu Kang , Yong Suk Choi

Although Large Language Models (LLMs) have made remarkable progress, current preference optimization methods still struggle to align directional consistency while preserving reasoning diversity. To address this limitation, we propose…

Computation and Language · Computer Science 2026-05-12 Mengyi Deng , Zhiwei Li , Xin Li , Tingyu Zhu , Yulan Yuan , Zhijiang Guo , Wei Wang

Diffusion models, known for their strong generative capability derived from iterative noising and denoising processes, have recently emerged as a promising paradigm for sequential recommendation. To incorporate user history for…

Information Retrieval · Computer Science 2026-05-12 Yimeng Bai , Yang Zhang , Sihao Ding , Shaohui Ruan , Han Yao , Danhui Guan , Fuli Feng , Tat-Seng Chua

Recent large reasoning models (LRMs) driven by reinforcement learning algorithms (e.g., GRPO) have achieved remarkable performance on challenging reasoning tasks. However, these models suffer from overthinking, generating unnecessarily long…

Artificial Intelligence · Computer Science 2026-03-03 Gang Li , Yan Chen , Ming Lin , Tianbao Yang

Speculative reasoning has recently been proposed as a means to accelerate reasoning-intensive generation in large multimodal models, but its effectiveness is often constrained by misalignment between speculative drafts and target-verified…

Artificial Intelligence · Computer Science 2026-05-28 Yunhai Hu , Zining Liu , Xiangyang Yin , Tianhua Xia , Bo Bao , Eric Sather , Vithursan Thangarasa , Sai Qian Zhang

Recent work shows that, beyond discrete reasoning through explicit chain-of-thought steps, which are limited by the boundaries of natural languages, large language models (LLMs) can also reason continuously in latent space, allowing richer…

Computation and Language · Computer Science 2026-03-03 Dachuan Shi , Abedelkadir Asi , Keying Li , Xiangchi Yuan , Leyan Pan , Wenke Lee , Wen Xiao

Numerical reasoning over hybrid data containing tables and long texts has recently received research attention from the AI community. To generate an executable reasoning program consisting of math and table operations to answer a question,…

Computation and Language · Computer Science 2022-11-24 Xiao Li , Yin Zhu , Sichen Liu , Jiangzhou Ju , Yuzhong Qu , Gong Cheng

Predicting pedestrian motion trajectories is critical for the path planning and motion control of autonomous vehicles. Recent diffusion-based models have shown promising results in capturing the inherent stochasticity of pedestrian behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yu Liu , Zhijie Liu , Xiao Ren , You-Fu Li , He Kong

Diffusion models have recently shown significant potential in solving decision-making problems, particularly in generating behavior plans -- also known as diffusion planning. While numerous studies have demonstrated the impressive…

Machine Learning · Computer Science 2025-03-04 Haofei Lu , Dongqi Han , Yifei Shen , Dongsheng Li

The Group Relative Policy Optimization (GRPO) algorithm has demonstrated considerable success in enhancing the reasoning capabilities of large language models (LLMs), as evidenced by DeepSeek-R1. However, the absence of intermediate…

Machine Learning · Computer Science 2025-06-06 Fei Ding , Baiqiao Wang , Zijian Zeng , Youwei Wang

Large Language Models (LLMs) have demonstrated significant potential in handling complex reasoning tasks through step-by-step rationale generation. However, recent studies have raised concerns regarding the hallucination and flaws in their…

Artificial Intelligence · Computer Science 2024-10-16 Fangkai Jiao , Chengwei Qin , Zhengyuan Liu , Nancy F. Chen , Shafiq Joty

Session-based recommendation aims to predict the next item that anonymous users may be interested in, based on their current session interactions. Recent studies have demonstrated that retrieving neighbor sessions to augment the current…

Information Retrieval · Computer Science 2026-01-08 Yuhan Yang , Jie Zou , Guojia An , Jiwei Wei , Yang Yang , Heng Tao Shen

Recent progress in diffusion-based audio generation and restoration has substantially improved performance across heterogeneous conditioning regimes, including text-conditioned audio generation and audio-conditioned super-resolution.…

Sound · Computer Science 2026-05-07 Xuanhao Zhang , Chang Li

Depth-recurrence facilitates latent reasoning by sharing parameters across depths. However, prior work lacks combined FLOP-, parameter-, and memory-matched baselines, underutilizes depth-recurrence due to partially fixed layer stacks, and…

Artificial Intelligence · Computer Science 2026-01-30 Jonas Knupp , Jan Hendrik Metzen , Jeremias Bohn , Georg Groh , Kristian Kersting

Large reasoning models (LRMs) excel at complex reasoning tasks but typically generate lengthy sequential chains-of-thought, resulting in long inference times before arriving at the final answer. To address this challenge, we introduce…

Artificial Intelligence · Computer Science 2025-12-04 Emil Biju , Shayan Talaei , Zhemin Huang , Mohammadreza Pourreza , Azalia Mirhoseini , Amin Saberi

Self-conditioning has been central to the success of continuous diffusion language models, as it allows models to correct previous errors. Yet its ability degrades precisely in the regime where diffusion is most attractive for deployment:…

Computation and Language · Computer Science 2026-04-08 Dat Nguyen-Cong , Tung Kieu , Hoang Thanh-Tung

How should future neural reasoning systems implement extended computation? Recursive Reasoning Models (RRMs) offer a promising alternative to autoregressive sequence extension by performing iterative latent-state refinement with shared…

Artificial Intelligence · Computer Science 2026-05-21 Junyeob Baek , Mingyu Jo , Minsu Kim , Mengye Ren , Yoshua Bengio , Sungjin Ahn

Model selection for a given target task can be costly, as it may entail extensive annotation of the quality of outputs of different models. We introduce DiffUse, an efficient method to make an informed decision between candidate text…

Computation and Language · Computer Science 2024-06-07 Shir Ashury-Tahan , Ariel Gera , Benjamin Sznajder , Leshem Choshen , Liat Ein-Dor , Eyal Shnarch