English
Related papers

Related papers: Diffusion Transformer-to-Mamba Distillation for Hi…

200 papers

Diffusion models excel in high-fidelity image generation but face scalability limits due to transformers' quadratic attention complexity. Plug-and-play token reduction methods like ToMeSD and ToFu reduce FLOPs by merging redundant tokens in…

Machine Learning · Computer Science 2025-12-02 Wenbo Lu , Shaoyi Zheng , Yuxuan Xia , Shengjie Wang

Controllable music generation methods are critical for human-centered AI-based music creation, but are currently limited by speed, quality, and control design trade-offs. Diffusion Inference-Time T-optimization (DITTO), in particular,…

Sound · Computer Science 2024-05-31 Zachary Novack , Julian McAuley , Taylor Berg-Kirkpatrick , Nicholas Bryan

Text-to-motion generation, which converts motion language descriptions into coherent 3D human motion sequences, has attracted increasing attention in fields, such as avatar animation and humanoid robotic interaction. Though existing models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xingzu Zhan , Chen Xie , Honghang Chen , Yixun Lin , Xiaochun Mai

Accurate estimation of wheat spike volume is important for yield component analysis and stress resilience assessment, yet field-based measurement remains challenging. Active 3D sensing methods such as Light Detection and Ranging (LiDAR) or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Olivia Zumsteg , Jannis Widmer , Yann Bourdé , Norbert Kirchgessner , Andreas Hund , Lukas Roth , Paraskevi Nousi

Mamba has recently garnered attention as an effective backbone for vision tasks. However, its underlying mechanism in visual domains remains poorly understood. In this work, we systematically investigate Mamba's representational properties…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Timing Yang , Guoyizhe Wei , Alan Yuille , Feng Wang

The Transformer architecture has shown a remarkable ability in modeling global relationships. However, it poses a significant computational challenge when processing high-dimensional medical images. This hinders its development and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhaohu Xing , Tian Ye , Yijun Yang , Guang Liu , Lei Zhu

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

Machine Learning · Computer Science 2025-06-12 Bowen Zheng , Tianming Yang

Diffusion models are the main driver of progress in image and video synthesis, but suffer from slow inference speed. Distillation methods, like the recently introduced adversarial diffusion distillation (ADD) aim to shift the model from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Axel Sauer , Frederic Boesel , Tim Dockhorn , Andreas Blattmann , Patrick Esser , Robin Rombach

Text-to-image (T2I) generation with Stable Diffusion models (SDMs) involves high computing demands due to billion-scale parameters. To enhance efficiency, recent studies have reduced sampling steps and applied network quantization while…

Machine Learning · Computer Science 2024-12-03 Bo-Kyeong Kim , Hyoung-Kyu Song , Thibault Castells , Shinkook Choi

Point cloud enhancement is the process of generating a high-quality point cloud from an incomplete input. This is done by filling in the missing details from a reference like the ground truth via regression, for example. In addition to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Sai Tarun Inaganti , Gennady Petrenko

Exposure correction is a fundamental problem in computer vision and image processing. Recently, frequency domain-based methods have achieved impressive improvement, yet they still struggle with complex real-world scenarios under extreme…

Image and Video Processing · Electrical Eng. & Systems 2025-05-07 Gehui Li , Bin Chen , Chen Zhao , Lei Zhang , Jian Zhang

Transformers have become one of the foundational architectures in point cloud analysis tasks due to their excellent global modeling ability. However, the attention mechanism has quadratic complexity, making the design of a linear complexity…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Dingkang Liang , Xin Zhou , Wei Xu , Xingkui Zhu , Zhikang Zou , Xiaoqing Ye , Xiao Tan , Xiang Bai

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading…

Machine Learning · Computer Science 2025-12-16 Peng Lu , Jerry Huang , Qiuhao Zeng , Xinyu Wang , Boxing Chen , Philippe Langlais , Yufei Cui

Multimodal Machine Translation (MMT) typically enhances text-only translation by incorporating aligned visual features. Despite the remarkable progress, state-of-the-art MMT approaches often rely on paired image-text inputs at inference and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jie Wang , Zhendong Yang , Liansong Zong , Xiaobo Zhang , Dexian Wang , Ji Zhang

While diffusion models have achieved great success in the field of video generation, this progress is accompanied by a rapidly escalating computational burden. Among the existing acceleration methods, Feature Caching is popular due to its…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chang Zou , Changlin Li , Yang Li , Patrol Li , Jianbing Wu , Xiao He , Songtao Liu , Zhao Zhong , Kailin Huang , Linfeng Zhang

Parametric Computer-Aided Design (CAD) is crucial in industrial applications, yet existing approaches often struggle to generate long sequence parametric commands due to complex CAD models' geometric and topological constraints. To address…

Machine Learning · Computer Science 2025-11-25 Liyuan Deng , Yunpeng Bai , Yongkang Dai , Xiaoshui Huang , Hongping Gan , Dongshuo Huang , Hao jiacheng , Yilei Shi

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Recent advancements in diffusion models have significantly improved symbolic music generation. However, most approaches rely on transformer-based architectures with self-attention mechanisms, which are constrained by quadratic computational…

Sound · Computer Science 2026-03-04 Shenghua Yuan , Xing Tang , Jiatao Chen , Tianming Xie , Jing Wang , Bing Shi

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

Machine Learning · Computer Science 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu