English
Related papers

Related papers: LinkD: AutoRegressive Diffusion Model for Mechanic…

200 papers

Anatomical trees play an important role in clinical diagnosis and treatment planning. Yet, accurately representing these structures poses significant challenges owing to their intricate and varied topology and geometry. Most existing…

Image and Video Processing · Electrical Eng. & Systems 2025-09-18 Paula Feldman , Miguel Fainstein , Viviana Siless , Claudio Delrieux , Emmanuel Iarussi

Diffusion language models enable parallel token generation through block-wise decoding, but their irreversible commitments can lead to stagnation, where the reverse diffusion process fails to make further progress under a suboptimal…

Computation and Language · Computer Science 2026-02-03 Xinyun Wang , Min Zhang , Sen Cui , Zhikang Chen , Bo Jiang , Kun Kuang , Mingbao Lin

Diffusion bridge models establish probabilistic paths between arbitrary paired distributions and exhibit great potential for universal image restoration. Most existing methods merely treat them as simple variants of stochastic interpolants,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Hebaixu Wang , Jing Zhang , Haoyang Chen , Haonan Guo , Di Wang , Jiayi Ma , Bo Du

Discrete diffusion models offer a flexible, controllable approach to structured sequence generation, yet they still lag behind causal language models in expressive power. A key limitation lies in their reliance on the Markovian assumption,…

Large pretrained diffusion models have significantly enhanced the quality of generated videos, and yet their use in real-time streaming remains limited. Autoregressive models offer a natural framework for sequential frame synthesis but…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jinxiu Liu , Xuanming Liu , Kangfu Mei , Yandong Wen , Ming-Hsuan Yang , Weiyang Liu

Post-training pretrained autoregressive models (ARMs) into masked diffusion models (MDMs) has emerged as a cost-effective way to overcome the limitations of sequential generation. Yet it remains unclear whether post-trained MDMs acquire…

Machine Learning · Computer Science 2026-05-29 Injin Kong , Hyoungjoon Lee , Yohan Jo

Robots' behavior and performance are determined both by hardware and software. The design process of robotic systems is a complex journey that involves multiple phases. Throughout this process, the aim is to tackle various criteria…

We propose an autoregressive framework for modelling dynamic networks with dependent edges. It encompasses models that accommodate, for example, transitivity, degree heterogenenity, and other stylized features often observed in real network…

Statistics Theory · Mathematics 2026-03-25 Jinyuan Chang , Qin Fang , Eric D. Kolaczyk , Peter W. MacDonald , Qiwei Yao

Predicting the effect of amino acid mutations on enzyme thermodynamic stability (DDG) is fundamental to protein engineering and drug design. While recent deep learning approaches have shown promise, they often process sequence and structure…

Machine Learning · Computer Science 2025-11-10 Abigail Lin

This paper presents DDTracking, a novel deep generative framework for diffusion MRI tractography that formulates streamline propagation as a conditional denoising diffusion process. In DDTracking, we introduce a dual-pathway encoding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yijie Li , Wei Zhang , Xi Zhu , Ye Wu , Yogesh Rathi , Lauren J. O'Donnell , Fan Zhang

Human motion generation is a challenging task due to its high dimensionality and the difficulty of generating fine-grained motions. Diffusion methods have been proposed due to their high sample quality and expressiveness. Early approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Mirgahney Mohamed , Harry Jake Cunningham , Marc P. Deisenroth , Lourdes Agapito

The ability to computationally generate novel yet physically foldable protein structures could lead to new biological discoveries and new treatments targeting yet incurable diseases. Despite recent advances in protein structure prediction,…

Biomolecules · Quantitative Biology 2022-11-28 Kevin E. Wu , Kevin K. Yang , Rianne van den Berg , James Y. Zou , Alex X. Lu , Ava P. Amini

We considered diffusion-driven processes on small-world networks with distance-dependent random links. The study of diffusion on such networks is motivated by transport on randomly folded polymer chains, synchronization problems in…

Statistical Mechanics · Physics 2007-09-05 Balazs Kozma , Matthew B. Hastings , G. Korniss

Fragment-based drug discovery has been an effective paradigm in early-stage drug development. An open challenge in this area is designing linkers between disconnected molecular fragments of interest to obtain chemically-relevant candidate…

Structure-based drug design (SBDD) aims to design small-molecule ligands that bind with high affinity and specificity to pre-determined protein targets. Generative SBDD methods leverage structural data of drugs in complex with their protein…

Discrete diffusion models offer a promising alternative to autoregressive generation through parallel decoding, but they suffer from a sampling wall: once categorical sampling occurs, rich distributional information collapses into one-hot…

Machine Learning · Computer Science 2026-05-14 Mingyu Jo , Jaesik Yoon , Justin Deschenaux , Caglar Gulcehre , Sungjin Ahn

Most neural models of causality assume static causal graphs, failing to capture the dynamic and sparse nature of physical interactions where causal relationships emerge and dissolve over time. We introduce the Causal Process Framework and…

Machine Learning · Computer Science 2026-04-07 Turan Orujlu , Christian Gumbsch , Martin V. Butz , Charley M Wu

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiyuan Wang , Muhan Zhang

Autoregressive models excel in efficiency and plug directly into the transformer ecosystem, delivering robust generalization, predictable scalability, and seamless workflows such as fine-tuning and parallelized training. However, they…

Machine Learning · Computer Science 2025-06-13 Samuel Belkadi , Steve Hong , Marian Chen , Miruna Cretu , Charles Harris , Pietro Lio

Diffusion-based models decompose sampling into many small Gaussian denoising steps -- an assumption that breaks down when generation is compressed to a few coarse transitions. Existing few-step methods address this through distillation,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Jiatao Gu , Tianrong Chen , Ying Shen , David Berthelot , Shuangfei Zhai , Josh Susskind