中文
相关论文

相关论文: DETNO: A Diffusion-Enhanced Transformer Neural Ope…

200 篇论文

Diffusion models have achieved remarkable success across a range of generative tasks. Recent efforts to enhance diffusion model architectures have reimagined them as a form of multi-task learning, where each task corresponds to a denoising…

计算机视觉与模式识别 · 计算机科学 2024-07-11 Byeongjun Park , Hyojun Go , Jin-Young Kim , Sangmin Woo , Seokil Ham , Changick Kim

Autoregressive neural PDE surrogates predict future states by repeatedly applying a learned one-step operator. This is a simple and widely used method, but small one-step errors can accumulate during long rollouts. The resulting drift often…

机器学习 · 计算机科学 2026-05-18 Jiayi Li , Penghao Jiang , Hira Saleem , Zhaonan Wang , Piotr Koniusz , Flora D. Salim

We propose DiffusionRollout, a novel selective rollout planning strategy for autoregressive diffusion models, aimed at mitigating error accumulation in long-horizon predictions of physical systems governed by partial differential equations…

人工智能 · 计算机科学 2026-02-17 Seungwoo Yoo , Juil Koo , Daehyeon Choi , Minhyuk Sung

Accurate traffic forecasting is essential for effective urban planning and congestion management. Deep learning (DL) approaches have gained colossal success in traffic forecasting but still face challenges in capturing the intricacies of…

人工智能 · 计算机科学 2024-04-19 Songtao Huang , Hongjin Song , Tianqi Jiang , Akbar Telikani , Jun Shen , Qingguo Zhou , Binbin Yong , Qiang Wu

In computational physics, a longstanding challenge lies in finding numerical solutions to partial differential equations (PDEs). Recently, research attention has increasingly focused on Neural Operator methods, which are notable for their…

机器学习 · 计算机科学 2025-09-26 Yichen Song , Yalun Wu , Yunbo Wang , Xiaokang Yang

We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error…

机器学习 · 计算机科学 2026-03-17 Boyuan Yao , Dingcheng Luo , Lianghao Cao , Nikola Kovachki , Thomas O'Leary-Roseberry , Omar Ghattas

Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows. At the core of FNO is a spectral layer that leverages a discretization-convergent representation…

机器学习 · 计算机科学 2024-03-06 Robert Joseph George , Jiawei Zhao , Jean Kossaifi , Zongyi Li , Anima Anandkumar

Accurate vehicle type classification serves a significant role in the intelligent transportation system. It is critical for ruler to understand the road conditions and usually contributive for the traffic light control system to response…

计算机视觉与模式识别 · 计算机科学 2022-09-28 Ruikang Luo , Yaofeng Song , Han Zhao , Yicheng Zhang , Yi Zhang , Nanbin Zhao , Liping Huang , Rong Su

This study proposes a deep learning methodology to predict the propagation of traffic shockwaves. The input to the deep neural network is time-space diagram of the study segment, and the output of the network is the predicted (future)…

机器学习 · 计算机科学 2019-05-08 Mohammadreza Khajeh-Hosseini , Alireza Talebpour

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data…

机器学习 · 计算机科学 2025-05-09 Yuren Zhang , Zhongnan Pu , Lei Jing

Recently, the diffusion model has emerged as a powerful generative technique for robotic policy learning, capable of modeling multi-mode action distributions. Leveraging its capability for end-to-end autonomous driving is a promising…

计算机视觉与模式识别 · 计算机科学 2025-04-11 Bencheng Liao , Shaoyu Chen , Haoran Yin , Bo Jiang , Cheng Wang , Sixu Yan , Xinbang Zhang , Xiangyu Li , Ying Zhang , Qian Zhang , Xinggang Wang

Long-term stability stands as a crucial requirement in data-driven medium-range global weather forecasting. Spectral bias is recognized as the primary contributor to instabilities, as data-driven methods difficult to learn small-scale…

机器学习 · 计算机科学 2024-07-03 Yifan Hu , Fukang Yin , Weimin Zhang , Kaijun Ren , Junqiang Song , Kefeng Deng , Di Zhang

Deep-learning-based data-driven forecasting methods have produced impressive results for traffic forecasting. A major limitation of these methods, however, is that they provide forecasts without estimates of uncertainty, which are critical…

机器学习 · 计算机科学 2022-04-07 Tanwi Mallick , Prasanna Balaprakash , Jane Macfarlane

Generating accurate and stable long rollouts is a notorious challenge for time-dependent PDEs (Partial Differential Equations). Recently, motivated by the importance of high-frequency accuracy, a refiner model called PDERefiner utilizes…

计算工程、金融与科学 · 计算机科学 2025-06-16 Li Luo

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural…

机器学习 · 计算机科学 2025-04-30 W. Diab , M. Al-Kobaisi

Deep neural operators (DNOs) have been utilized to approximate nonlinear mappings between function spaces. However, DNOs face the challenge of increased dimensionality and computational cost associated with unaligned observation data. In…

机器学习 · 计算机科学 2023-08-21 Bo Chen , Chenyu Wang , Weipeng Li , Haiyang Fu

Deep generative models have emerged as promising tools for detecting arbitrary anomalies in data, dispensing with the necessity for manual labelling. Recently, autoregressive transformers have achieved state-of-the-art performance for…

Motion prediction is a challenging problem in autonomous driving as it demands the system to comprehend stochastic dynamics and the multi-modal nature of real-world agent interactions. Diffusion models have recently risen to prominence, and…

机器人学 · 计算机科学 2024-05-03 Jiahui Li , Tianle Shen , Zekai Gu , Jiawei Sun , Chengran Yuan , Yuhang Han , Shuo Sun , Marcelo H. Ang

Neural operators learn to map initial conditions to the terminal solution of partial differential equations (PDEs), providing a surrogate for the full operator mapping. This enables rapid prediction across different input configurations.…

机器学习 · 计算机科学 2026-05-14 Runlong Xie , An Luo

Diffusion Probabilistic Models stand as a critical tool in generative modelling, enabling the generation of complex data distributions. This family of generative models yields record-breaking performance in tasks such as image synthesis,…