English
Related papers

Related papers: Diffusion-Inspired Reconfiguration of Transformers…

200 papers

Diffusion-driven patterns appear on curved surfaces in many settings, initiated by unstable modes of an underlying Laplacian operator. On a flat surface or perfect sphere, the patterns are degenerate, reflecting translational/rotational…

Soft Condensed Matter · Physics 2025-09-09 John R. Frank , Jemal Guven , Mehran Kardar , Leyna Shackleton

We address the problem of uncertainty propagation in the discrete Fourier transform by modeling the fast Fourier transform as a factor graph. Building on this representation, we propose an efficient framework for approximate Bayesian…

Machine Learning · Computer Science 2025-06-09 Luca Schmid , Charlotte Muth , Laurent Schmalen

Scene flow estimation, which aims to predict per-point 3D displacements of dynamic scenes, is a fundamental task in the computer vision field. However, previous works commonly suffer from unreliable correlation caused by locally constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Jiuming Liu , Guangming Wang , Weicai Ye , Chaokang Jiang , Jinru Han , Zhe Liu , Guofeng Zhang , Dalong Du , Hesheng Wang

Autonomous driving in complex traffic requires planners that generalize beyond hand-crafted rules, motivating data-driven approaches that learn behavior from expert demonstrations. Diffusion-based trajectory planners have recently shown…

Robotics · Computer Science 2026-03-12 Eugene Ku , Yiwei Lyu

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

Diffusion models have proven to be highly effective in generating high-quality images. However, adapting large pre-trained diffusion models to new domains remains an open challenge, which is critical for real-world applications. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Enze Xie , Lewei Yao , Han Shi , Zhili Liu , Daquan Zhou , Zhaoqiang Liu , Jiawei Li , Zhenguo Li

Inference-time controllable generation is essential for real-world applications of unconditional diffusion models. However, most existing techniques focus on individual samples, struggling in applications that require the sample population…

Machine Learning · Computer Science 2026-05-11 Hao Luan , See-Kiong Ng , Chun Kai Ling

We present Wideband Back-Projection Diffusion, an end-to-end probabilistic framework for approximating the posterior distribution induced by the inverse scattering map from wideband scattering data. This framework produces highly accurate…

Machine Learning · Computer Science 2025-05-20 Borong Zhang , Martín Guerra , Qin Li , Leonardo Zepeda-Núñez

Uncertainty quantification is essential for the reliable deployment of machine learning models to high-stakes application domains. Uncertainty quantification is all the more challenging when training distribution and test distribution are…

Machine Learning · Computer Science 2022-06-07 Yaodong Yu , Stephen Bates , Yi Ma , Michael I. Jordan

Recently, diffusion transformers have gained wide attention with its excellent performance in text-to-image and text-to-vidoe models, emphasizing the need for transformers as backbone for diffusion models. Transformer-based models have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M. Patel

In this paper, we uncover the hidden potential of Diffusion Transformers (DiTs) to significantly enhance generative tasks. Through an in-depth analysis of the denoising process, we demonstrate that introducing a single learned scaling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Danil Tokhchukov , Aysel Mirzoeva , Andrey Kuznetsov , Konstantin Sobolev

We propose Diffusion-Informed Model Predictive Control (D-I MPC), a generic framework for uncertainty-aware prediction and decision-making in partially observable stochastic systems by integrating diffusion-based time series forecasting…

Machine Learning · Computer Science 2025-03-20 Stelios Zarifis , Ioannis Kordonis , Petros Maragos

Many real-world machine learning tasks require outputs that satisfy hard constraints, such as physical conservation laws, structured dependencies in graphs, or column-level relationships in tabular data. Existing approaches rely either on…

Artificial Intelligence · Computer Science 2025-11-21 Pantelis Dogoulis , Fabien Bernier , Félix Fourreau , Karim Tit , Maxime Cordy

Achieving human-like driving behaviors in complex open-world environments is a critical challenge in autonomous driving. Contemporary learning-based planning approaches such as imitation learning methods often struggle to balance competing…

Offline decision-making via diffusion models often produces trajectories that are misaligned with system dynamics, limiting their reliability for control. We propose Model Predictive Diffuser (MPDiffuser), a compositional diffusion…

Robotics · Computer Science 2026-02-02 Haldun Balim , Na Li , Yilun Du

Diffusion Transformers require repeated denoiser evaluations during iterative sampling, making inference computationally expensive. Cache-based acceleration reduces this cost by reusing intermediate representations across denoising steps,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Mingyu Liang , Dingkun Xu , Jingwei Xu

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

High-fidelity spectrum cartography is pivotal for spectrum management and wireless situational awareness, yet it remains a challenging ill-posed inverse problem due to the sparsity and irregularity of observations. Furthermore, existing…

Information Theory · Computer Science 2025-12-24 Yuntong Gu , Xiangming meng , Zhiyuan Lin , Sheng Wu , Linling Kuang

End-to-end backpropagation requires storing activations throughout all layers, creating memory bottlenecks that limit model scalability. Existing block-wise training methods offer means to alleviate this problem, but they rely on ad-hoc…

Machine Learning · Computer Science 2026-02-19 Makoto Shing , Masanori Koyama , Takuya Akiba

Diffusion models have become popular for policy learning in robotics due to their ability to capture high-dimensional and multimodal distributions. However, diffusion policies are stochastic and typically trained offline, limiting their…

Robotics · Computer Science 2025-05-28 Ralf Römer , Alexander von Rohr , Angela P. Schoellig