中文
相关论文

相关论文: Dynamic Neural Koopman Distillation for Real-Time …

200 篇论文

Over the last few years, several works have proposed deep learning architectures to learn dynamical systems from observation data with no or little knowledge of the underlying physics. A line of work relies on learning representations where…

机器学习 · 计算机科学 2023-03-14 Anthony Frion , Lucas Drumetz , Mauro Dalla Mura , Guillaume Tochon , Abdeldjalil Aissa El Bey

Dynamic Mode Decomposition (DMD) is a technique to approximate generally non-linear dynamical systems using linear techniques, which are better understood and easier to analyze. Koopman theory extends DMD by transforming the original system…

最优化与控制 · 数学 2022-11-15 Sourya Dey

Learning diffusion bridge models is easy; making them fast and practical is an art. Diffusion bridge models (DBMs) are a promising extension of diffusion models for applications in image-to-image translation. However, like many modern…

机器学习 · 计算机科学 2025-08-19 Nikita Gushchin , David Li , Daniil Selikhanovych , Evgeny Burnaev , Dmitry Baranchuk , Alexander Korotin

Diffusion models have recently achieved great success in the synthesis of high-quality images and videos. However, the existing denoising techniques in diffusion models are commonly based on step-by-step noise predictions, which suffers…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Hancheng Ye , Jiakang Yuan , Renqiu Xia , Xiangchao Yan , Tao Chen , Junchi Yan , Botian Shi , Bo Zhang

We address the problem of learning a neural Koopman operator model that provides dissipativity guarantees for an unknown nonlinear dynamical system that is known to be dissipative. We propose a two-stage approach. First, we learn an…

系统与控制 · 电气工程与系统科学 2025-10-03 Yuezhu Xu , S. Sivaranjani , Vijay Gupta

Time series forecasting plays a vital role across scientific, industrial, and environmental domains, especially when dealing with high-dimensional and nonlinear systems. While Transformer-based models have recently achieved state-of-the-art…

机器学习 · 计算机科学 2025-08-05 Ali Forootani , Mohammad Khosravi , Masoud Barati

Discrete diffusion models offer a promising alternative to autoregressive generation through parallel decoding, but they suffer from a sampling wall: once categorical sampling occurs, rich distributional information collapses into one-hot…

机器学习 · 计算机科学 2026-05-14 Mingyu Jo , Jaesik Yoon , Justin Deschenaux , Caglar Gulcehre , Sungjin Ahn

4D radar super-resolution, which aims to reconstruct sparse and noisy point clouds into dense and geometrically consistent representations, is a foundational problem in autonomous perception. However, existing methods often suffer from high…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Minqing Huang , Shouyi Lu , Boyuan Zheng , Ziyao Li , Xiao Tang , Guirong Zhuo

In this paper, we propose an efficient, fast, and versatile distillation method to accelerate the generation of pre-trained diffusion models: Flash Diffusion. The method reaches state-of-the-art performances in terms of FID and CLIP-Score…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Clément Chadebec , Onur Tasar , Eyal Benaroche , Benjamin Aubin

A diffusion model, which is formulated to produce an image using thousands of denoising steps, usually suffers from a slow inference speed. Existing acceleration algorithms simplify the sampling by skipping most steps yet exhibit…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Mengfei Xia , Yujun Shen , Changsong Lei , Yu Zhou , Ran Yi , Deli Zhao , Wenping Wang , Yong-Jin Liu

Forecasting physical systems over long horizons from irregularly sampled observations demands models that are stable, computationally efficient, and free of fixed-timestep assumptions. We address this with a continuous-time Koopman…

机器学习 · 计算机科学 2026-05-11 Rares Grozavescu , Pengyu Zhang , Etienne Meunier , Mark Girolami

Diffusion language models offer parallel token generation and inherent bidirectionality, promising more efficient and powerful sequence modeling compared to autoregressive approaches. However, state-of-the-art diffusion models (e.g., Dream…

计算与语言 · 计算机科学 2025-10-10 Zhanqiu Hu , Jian Meng , Yash Akhauri , Mohamed S. Abdelfattah , Jae-sun Seo , Zhiru Zhang , Udit Gupta

In recent years, humanoid robots have garnered significant attention from both academia and industry due to their high adaptability to environments and human-like characteristics. With the rapid advancement of reinforcement learning,…

机器人学 · 计算机科学 2025-03-12 Qiang Zhang , Gang Han , Jingkai Sun , Wen Zhao , Chenghao Sun , Jiahang Cao , Jiaxu Wang , Yijie Guo , Renjing Xu

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Transformer-based architectures have become the de-facto standard models for diverse vision tasks owing to their superior performance. As the size of the models continues to scale up, model distillation becomes extremely important in…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Cheng Han , Qifan Wang , Sohail A. Dianat , Majid Rabbani , Raghuveer M. Rao , Yi Fang , Qiang Guan , Lifu Huang , Dongfang Liu

This study presents an innovative approach to Model Predictive Control (MPC) by leveraging the powerful combination of Koopman theory and Deep Reinforcement Learning (DRL). By transforming nonlinear dynamical systems into a…

系统与控制 · 电气工程与系统科学 2025-05-22 Md Nur-A-Adam Dony

Although diffusion model has shown great potential for generating higher quality images than GANs, slow sampling speed hinders its wide application in practice. Progressive distillation is thus proposed for fast sampling by progressively…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Wujie Sun , Defang Chen , Can Wang , Deshi Ye , Yan Feng , Chun Chen

Diffusion models have demonstrated excellent performance for real-world image super-resolution (Real-ISR), albeit at high computational costs. Most existing methods are trying to derive one-step diffusion models from multi-step counterparts…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Jianze Li , Jiezhang Cao , Zichen Zou , Xiongfei Su , Xin Yuan , Yulun Zhang , Yong Guo , Xiaokang Yang

This paper presents a generalizable methodology for data-driven identification of nonlinear dynamics that bounds the model error in terms of the prediction horizon and the magnitude of the derivatives of the system states. Using…

机器学习 · 统计学 2021-05-03 Giorgos Mamakoukas , Maria L. Castano , Xiaobo Tan , Todd D. Murphey

We propose a noise-robust learning framework for the Koopman operator of nonlinear dynamical systems, with guaranteed long-term stability and improved model performance for better model-based predictive control tasks. Unlike some existing…

动力系统 · 数学 2025-08-25 Shahriar Akbar Sakib , Shaowu Pan